Loading…
AI DevSummit 2025 + DeveloperWeek Leadership 2025
Company: LLMs clear filter
arrow_back View All Dates
Wednesday, June 4
 

9:30am PDT

[Virtual] OPEN Session: The Rise of Small Language Models: Unlocking Efficient & Secure AI
Wednesday June 4, 2025 9:30am - 9:55am PDT
Shrinath Thube, IBM, Software Developer
Vaibhav Tupe, Equinix, Technology Lead


As AI adoption grows, the need for efficient, cost-effective, and privacy-conscious solutions has never been greater. Small Language Models (SLMs) are emerging as a powerful alternative to resource-intensive Large Language Models (LLMs), addressing challenges like high computational costs, latency, and environmental impact while also enhancing security and compliance.

This session will explore the evolution of small language models, covering their training, fine-tuning, and deployment for key NLP tasks such as text generation, summarization, and question-answering. We will also examine the security implications of using SLMs, including on-device processing for data privacy, reducing attack surfaces, mitigating prompt injection risks, and ensuring robust model governance. Techniques like model distillation, quantization, and retrieval-augmented generation (RAG) will be discussed in the context of optimizing both performance and security.

Attendees will gain insights into leading open-source models like Mistral, Gemma, Phi, and IBM Granite, learning how to harness them for real-world applications while implementing best practices for AI security and compliance. We will also discuss strategies for integrating SLMs into enterprise environments, edge computing, and secure on-premise AI deployments to achieve scalable, efficient, and trustworthy AI solutions.
Speakers
avatar for Shrinath Thube

Shrinath Thube

Software Developer, IBM
IEEE Senior Member | Software Developer, IBM | Technology Advisory Board MemberShrinath Thube is a Software Developer at IBM with 8+ years of experience in security, cloud, microservices, observability. An IEEE Senior Member, he is part of the IEEE CISOSE 2025 Organizing Committee... Read More →
avatar for Vaibhav Tupe

Vaibhav Tupe

Technology Lead, Equinix
Vaibhav Tupe is a distinguished Technology Advisory Board Member and Engineering Leader specializing in cybersecurity, cloud, and AI-ready data center infrastructure. With over 13 years of experience, he currently serves as a Technology Leader at Equinix USA, where he drives high-performance... Read More →
Wednesday June 4, 2025 9:30am - 9:55am PDT
VIRTUAL AI DevSummit Expo Stage

1:00pm PDT

[Virtual] OPEN Session: From LLM to SLM - How and Where to Use Specialized Language Models
Wednesday June 4, 2025 1:00pm - 1:25pm PDT
Iddo Gino, Datawizz, CEO

LLMs have transformed many applications - putting advanced AI within any developers reach. This unlocked amazing progress - but also introduced a dependency on model providers and ballooning inference costs. This talk will discuss an alternative approach - fine tuning and deploying smaller, specialized language models to cut costs & improve performance. We'll discuss how to identify the right use cases for SLMs, evaluate their performance and deploy them effectively. 
Speakers
avatar for Iddo Gino

Iddo Gino

CEO, Datawizz
Part of Forbes 30 Under 30 list, he's a 2017 Thiel Fellow. Previously, he was a Co-organizer of Hacking Gen Y. Iddo has been programming since he was a kid and continues to contribute to open-source projects. Originally from Haifa, Israel, Iddo is based in San Francisco, CA.
Wednesday June 4, 2025 1:00pm - 1:25pm PDT
VIRTUAL AI DevSummit Expo Stage
  AI DevSummit

1:30pm PDT

[Virtual] KEYNOTE (Leadership): Snowflake -- Harnessing the Power of Generative AI for Intelligent Applications
Wednesday June 4, 2025 1:30pm - 1:55pm PDT
Shivali Naik, Snowflake, Data and Technology Enthusiast

Generative AI is transforming industries by enabling businesses to create content, automate decision-making, and enhance user experiences. But how can organizations effectively build and deploy AI-powered solutions while maintaining security, efficiency, and scalability?

In this session, we will explore the fundamentals of Generative AI models, their real-world applications, and how they can be leveraged to drive innovation.

🔹 Key Takeaways:
✅ Understanding Generative AI models and their capabilities
✅ How to implement LLMs for text generation, summarization, and automation
✅ Building Retrieval-Augmented Generation (RAG) workflows for AI-driven insights
✅ Best practices for AI model governance, optimization, and ethical considerations
Speakers
avatar for Shivali Naik

Shivali Naik

Data and Technology Enthusiast, Snowflake
I'm Shivali Naik, a Solutions Architect with a passion for data engineering and cloud tech. With over two years of experience, I love tackling tough problems and optimizing data workflows to help businesses thrive. I’m a lifelong learner, always sharing insights on tech blogs and... Read More →
Wednesday June 4, 2025 1:30pm - 1:55pm PDT
VIRTUAL DeveloperWeek Leadership Main Stage

3:00pm PDT

[Virtual] OPEN Session: The Road to Use OpenTelemetry for LLM Observability
Wednesday June 4, 2025 3:00pm - 3:25pm PDT
Nir Gazit, Traceloop, CEO

If 2024 is the year of LLMs, then 2025 will be the year Agents. With the rise MCP, A2A and numerous other protocols, the need to monitor and comprehend their behaviors intensifies.

Observability plays a crucial role in this context. It involves the systematic collection and analysis of data to enhance LLM performance, identify and correct biases, troubleshoot issues, and ensure AI systems are both reliable and trustworthy.

In this discussion, we will explore the concept of LLM observability in depth, focusing on how OpenTelemetry can fit into the world of LLM observability . Additionally, we will talk about challenges around modeling of prompts, completions, events, semantic conventions, and basically our path with the llm-sem-conv working group.  
Speakers
avatar for Nir Gazit

Nir Gazit

CEO, Traceloop
CEO @ traceloop; ex-chief architect @ Fiverr, ex-tech lead @ Google; OpenTelemetry contributor
Wednesday June 4, 2025 3:00pm - 3:25pm PDT
VIRTUAL AI DevSummit Expo Stage
  AI DevSummit

4:00pm PDT

[Virtual] KEYNOTE (AI): Scale AI -- Ignore Previous Instructions: Embracing AI Red Teaming
Wednesday June 4, 2025 4:00pm - 4:50pm PDT
David Campbell, Scale AI, AI Risk Security Platform Lead

In this talk, we will explore the journey of Red Teaming from its origins to its transformation into AI Red Teaming, highlighting its pivotal role in shaping the future of Large Language Models (LLMs) and beyond. Drawing from my firsthand experiences developing and deploying the largest generative red teaming platform to date, I will share insightful antidotes and real-world examples. We will explore how adversarial red teaming fortifies AI applications at every layer—protecting platforms, businesses, and consumers. This includes safeguarding the external application interface, reinforcing LLM guardrails, and enhancing the security of the LLMs' internal algorithms. Join me as we uncover the critical importance of adversarial strategies in securing the AI landscape. 
Speakers
avatar for David Campbell

David Campbell

AI Risk Security Platform Lead, Scale AI
David Campbell is a seasoned technology leader with nearly 20 years of experience in Silicon Valley's startup ecosystem, now spearheading Responsible AI initiatives at Scale AI. As the Lead AI Risk Engineer, David has been pivotal in developing a cutting-edge AI Red Teaming platform... Read More →
Wednesday June 4, 2025 4:00pm - 4:50pm PDT
VIRTUAL AI DevSummit Main Stage
 

Share Modal

Share this link via

Or copy link

Filter sessions
Apply filters to sessions.
Filtered by Date -