Name: PRO Session: Decoding Enterprise AI for Devs: Choosing Between Private LLMs and Public Generative AI Services
Start: 2025-05-29T14:00:00-0700
End: 2025-05-29T14:25:00-0700

Thursday May 29, 2025 2:00pm - 2:25pm PDT

AI DevSummit Main Stage

Shomron Jacob, Iterate.ai, Head of Applied Machine Learning & Platform

This AIDev Summit session will navigate an increasingly pivotal crossroads: the decision between investing in proprietary, custom-tailored Large Language Models (LLM) or capitalizing on the versatility and ease of public generative AI services.

The session will begin by demystifying the complexities of private LLMs. With domain-specific capabilities and enhanced data security, these models have faster customization and compliance with industry-specific regulations. Yet, they also pose challenges: a bigger investment, infrastructure requirements, and ongoing maintenance. These elements necessitate a thorough examination.

Next, the session will scrutinize public generative AI services, exploring the inherent benefits of these ready-to-use solutions. With their scalability, diverse applications, and lower upfront costs, they hold significant appeal. But they also come with their own set of considerations, such as data privacy, standardized performance, and reduced control over the model’s behavior.
With real-world examples, we will walk through how various organizations have approached this decision, the results they achieved, and the invaluable lessons learned.

The session will then go into a decision-making framework, with the purpose of enabling attendees to assess their options between private LLMs and public generative AI services more effectively.

Speakers

Shomron Jacob

Head of Applied Machine Learning & Platform, Iterate.ai

Shomron Jacob is the Head of Applied Machine Learning & Platform at Iterate.ai. Shomron began his career as a software engineer but soon found himself learning ML/AI and switched his professional direction to follow it. He lives in Silicon Valley.

Thursday May 29, 2025 2:00pm - 2:25pm PDT
AI DevSummit Main Stage

AI DevSummit

Additional Topics Generative AI, LLMs, Governance and Regulation, AI Integration Strategy, AI Product Strategy
Session Type PRO Session
Tracks AI DevSummit, AI Leadership & Strategy (AI DevSummit)
In-Person/Virtual In Person

AI DevSummit 2025 + DeveloperWeek Leadership 2025

Shomron Jacob

Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!