Loading…
AI DevSummit 2025 + DeveloperWeek Leadership 2025
← Back to schedule
OPEN Session: Efficient Serverless Inferencing: Scaling and Optimization
Thursday May 29, 2025 11:30am - 11:55am PDT
AI DevSummit Expo Stage
Yann Léger, Koyeb, Co-Founder

Today, AI Infrastructure doesn’t rhyme with efficiency. Massive investments are made in GPUs sold mainly by a single vendor and these GPUs end up underused due to poor software solutions.

This is not a fatality and we, as an industry, are working on increasing average utilization and increasing diversity of accelerators. I’ll walk you through the different technical solutions to implement Serverless Inferencing and the trade-offs, from the chips to the virtualization software through the storage layers.
Speakers
avatar for Yann Léger

Yann Léger

Co-Founder, Koyeb
Yann Leger is co-founder of Koyeb, a serverless platform for AI workloads, and spent the last 12 years building large-scale cloud service providers from scratch.Passionate about cloud computing, he has a deep understanding of the underlying infrastructure, from data centers to the... Read More →
Thursday May 29, 2025 11:30am - 11:55am PDT
AI DevSummit Expo Stage
  4. Hackathon
Log in to leave feedback.

Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!

Tweet Share
Need help? View Support Guides
Event questions? Contact Event Planner
©2025 Sched • About • Privacy • Terms
Share Modal

Share this link via

Or copy link