AI DevSummit 2025 + DeveloperWeek Leadership 2025: Full Schedule

arrow_back View All Dates

1:00pm PDT

PRO Session: Numaflow: Powering Scalable Inference on Real-Time Data Streams at Intuit

Thursday May 29, 2025 1:00pm - 1:25pm PDT

Sri Harsha Yayi, intuit, Staff Product Manager
Vigith Maurice, Intuit, Principal Engineer

At Intuit, the ML teams encountered challenges when managing and executing inference on high-throughput streaming data. Integrating with diverse messaging systems like Kafka, Pulsar, and SQS required considerable effort, while enabling intermediate data transformations and inference added complexity. Additionally, dynamically scaling inference workflows to handle fluctuating event volumes posed unique challenges.

To address these issues, we developed Numaflow, an open-source, Kubernetes-native platform designed for scalable event processing. Numaflow simplifies connections to various event sources, empowers teams to process and infer on streaming data with ease, and integrates effortlessly with existing infrastructure. This session is ideal for ML engineers, data scientists, and anyone interested in asynchronous inference on streaming data. We’ll dive into how Numaflow eliminates bottlenecks and optimizes inference on streaming data.

Speakers

Vigith Maurice

Principal Engineer, Intuit

Vigith is a co-creator of Numaproj and Principal Software Engineer for the Intuit Core Platform team in Mountain View, California. One of Vigith's current day-to-day focus areas is the various challenges in building scalable data and AIOps solutions for both batch and high-throughput... Read More →

Sri Harsha Yayi

Staff Product Manager, Intuit

Sri Harsha Yayi is a Product Manager at Intuit, where he primarily focuses on the company's Modern SaaS Kubernetes platform, specifically within the real time event processing domain. He is the PM for Numaflow, an open-source, Kubernetes native platform designed for the real time... Read More →

Thursday May 29, 2025 1:00pm - 1:25pm PDT
AI DevSummit Main Stage

AI DevSummit

Additional Topics AI Product Strategy, AI Integration Strategy, Machine Learning
Session Type PRO Session
Tracks AI DevSummit, Frameworks / Tools & Applied AI (AI DevSummit), Productizing AI (AI DevSummit)
In-Person/Virtual In Person

2:30pm PDT

PRO Session: Building Robust Data Pipelines for Scalable Machine Learning

Thursday May 29, 2025 2:30pm - 2:55pm PDT

AI DevSummit Main Stage

Rachita Naik, Lyft, Machine Learning Engineer

This session will provide a comprehensive, hands-on guide to designing efficient, production-ready data pipelines for machine learning model training. Tailored for engineers, ML practitioners, and architects, this talk will break down key technical aspects of data processing, feature management, and pipeline optimization at scale.
Key takeaways include -
1. Optimized Data Ingestion: Efficiently processing real-time and batch data from multiple sources while minimizing latency and ensuring smooth data flow for ML models.
2. Reusable & Scalable Features: Designing centralized feature stores that enable cross-model sharing, reduce redundancy, and support large-scale ML operations.
3. Robust Data Preprocessing: Implementing techniques to clean, transform, and structure raw data, ensuring high-quality inputs that improve model accuracy and efficiency.
4. Ensuring Data Consistency: Maintaining parity between offline training and real-time inference by preventing schema mismatches, data drift, and inconsistencies.
5. Proactive Monitoring & Debugging: Using automated tracking, anomaly detection, and logging to identify bottlenecks, optimize pipeline performance, and ensure data reliability.

This session will combine technical deep dives with real-world lessons from deploying ML pipelines at scale in rideshare applications. Whether you’re designing your first ML pipeline or optimizing existing workflows, you’ll walk away with practical strategies to enhance data efficiency, model reliability, and overall system performance.

Speakers

Rachita Naik

Machine Learning Engineer, Lyft

Rachita Naik is a Machine Learning (ML) Engineer at Lyft, Inc., and a distinguished graduate of Columbia University. With a strong foundation in AI and two years of professional experience, she is dedicated to creating transformative solutions that address complex, real-world challenges... Read More →

Thursday May 29, 2025 2:30pm - 2:55pm PDT
AI DevSummit Main Stage

AI DevSummit

Additional Topics Machine Learning
Session Type PRO Session
Tracks AI DevSummit, Machine Learning / Models & Architectures (AI DevSummit), Data Access / Management & Operations (AI DevSummit)
In-Person/Virtual In Person