MLOps.community - podcast cover

MLOps.community

Demetrios mlops.community
Relaxed Conversations around getting AI into production, whatever shape that may come in (agentic, traditional ML, LLMs, Vibes, etc)

Episodes

All Data Scientists Should Learn Software Engineering Principles // Catherine Nelson // #245

Catherine Nelson is a freelance data scientist and writer. She is currently working on the forthcoming O’Reilly book " Software Engineering for Data Scientists ”. Why All Data Scientists Should Learn Software Engineering Principles // MLOps podcast #245 with Catherine Nelson, a freelance Data Scientist. A big thank you to LatticeFlow AI for sponsoring this episode! LatticeFlow AI - https://latticeflow.ai/ // Abstract Data scientists have a reputation for writing bad code. This quote from Reddit ...

Jul 05, 202453 min

Meta GenAI Infra Blog Review // Special MLOps Podcast

Meta GenAI Infra Blog Review // Special MLOps Podcast episode by Demetrios. // Abstract Demetrios explores Meta's innovative infrastructure for large-scale AI operations, highlighting three blog posts on training large language models, maintaining AI capacity, and building Meta's GenAI infrastructure. The discussion reveals Meta's handling of hundreds of trillions of AI model executions daily, focusing on scalability, cost efficiency, and robust networking. Key elements include the Ops planner w...

Jul 03, 202439 min

AI Agents for Consumers // Shaun Wei // #244

Sean Wei , the CEO and co-founder of RealChar , shares his journey from working in the autonomous vehicle industry to creating an open-source voice assistant project called Realchar, which eventually evolved into Rivia , a voice AI assistant focused on managing personal phone calls. The Future of AI and Consumer Empowerment // MLOps podcast #244 with Shaun Wei, CEO & Co-Founder of RealChar. A big thank you to LatticeFlow for sponsoring this episode! LatticeFlow - https://latticeflow.ai/ // A...

Jun 28, 202457 min

ML and AI as Distinct Control Systems in Heavy Industrial Settings // Richard Howes // #243

Join us at our first in-person conference today all about AI Quality: https://www.aiqualityconference.com/ ML and AI as Distinct Control Systems in Heavy Industrial Settings // MLOps podcast #243 with Richard Howes, CTO of Metaformed. Richard Howes is a dedicated engineer who is passionate about control systems whether it be embedded systems, industrial automation, or AI/ML in a business application. Huge thank you to AWS for sponsoring this episode. AWS - https://aws.amazon.com/ // Abstract How...

Jun 25, 202457 min

Accelerating Multimodal AI // Ethan Rosenthal // #242

Join us at our first in-person conference on June 25 all about AI Quality: https://www.aiqualityconference.com/ Accelerating Multimodal AI // MLOps podcast #241 with Ethan Rosenthal, Member of Technical Staff of Runway. Huge thank you to AWS for sponsoring this episode. AWS - https://aws.amazon.com/ // Abstract We’re still trying to figure out systems and processes for training and serving “regular” machine learning models, and now we have multimodal AI to contend with! These new systems present...

Jun 21, 202455 min

Navigating the AI Frontier: The Power of Synthetic Data and Agent Evaluations in LLM Development // Boris Selitser // #241

Join us at our first in-person conference on June 25 all about AI Quality: https://www.aiqualityconference.com/ Navigating the AI Frontier: The Power of Synthetic Data and Agent Evaluations in LLM Development // MLOps podcast #241 with Boris Selitser, Co-Founder and CTO/CPO of Okareo. A big thank you to LatticeFlow for sponsoring this episode! LatticeFlow - https://latticeflow.ai/ // Abstract Explore the evolving landscape of building LLM applications, focusing on the critical roles of synthetic...

Jun 18, 202457 min

How to Build Production-Ready AI Models for Manufacturing // [Exclusive] LatticeFlow Roundtable

Join us at our first in-person conference on June 25 all about AI Quality: https://www.aiqualityconference.com/ MLOps Coffee Sessions Special episode with LatticeFlow, How to Build Production-Ready AI Models for Manufacturing, fueled by our Premium Brand Partner, LatticeFlow . Deploying AI models in manufacturing involves navigating several technical challenges such as costly data acquisition, class imbalances, data shifts, leakage, and model degradation over time. How can you uncover the causes...

Jun 14, 202457 min

From Robotics to Recommender Systems // Miguel Fierro // #240

Join us at our first in-person conference on June 25 all about AI Quality: https://www.aiqualityconference.com/ Miguel Fierro is a Principal Data Science Manager at Microsoft and holds a PhD in robotics. From Robotics to Recommender Systems // MLOps Podcast #240 with Miguel Fierro, Principal Data Science Manager at Microsoft. Huge thank you to Zilliz for sponsoring this episode. Zilliz - https://zilliz.com/ . // Abstract Miguel explains the limitations and considerations of applying ML in roboti...

Jun 11, 202458 min

Uber's Michelangelo: Strategic AI Overhaul and Impact // #239

Uber's Michelangelo: Strategic AI Overhaul and Impact // MLOps podcast #239 with Demetrios Brinkmann. Huge thank you to Weights & Biases for sponsoring this episode. WandB Free Courses - http://wandb.me/courses_mlops // Abstract Uber's Michelangelo platform has evolved significantly through three major phases, enhancing its capabilities from basic ML predictions to sophisticated uses in deep learning and generative AI. Initially, Michelangelo 1.0 faced several challenges such as a lack of de...

Jun 07, 202436 min

AWS Tranium and Inferentia // Kamran Khan and Matthew McClean // #238

Join us at our first in-person conference on June 25 all about AI Quality: https://www.aiqualityconference.com/ Matthew McClean is a Machine Learning Technology Leader with the leading Amazon Web Services (AWS) cloud platform. He leads the customer engineering teams at Annapurna ML helping customers adopt AWS Trainium and Inferentia for their Gen AI workloads. Kamran Khan , Sr Technical Business Development Manager for AWS Inferentina/Trianium at AWS. He has over a decade of experience helping c...

Jun 04, 202445 min

Build Reliable Systems with Chaos Engineering // Benjamin Wilms // #237

Join us at our first in-person conference on June 25 all about AI Quality: https://www.aiqualityconference.com/. Benjamin Wilms is a developer and software architect at heart, with 20 years of experience. He fell in love with chaos engineering. Benjamin now spreads his enthusiasm and new knowledge as a speaker and author – especially in the field of chaos and resilience engineering. Retrieval Augmented Generation // MLOps podcast #237 with Benjamin Wilms, CEO & Co-Founder of Steadybit. Huge ...

May 31, 202447 min

Managing Small Knowledge Graphs for Multi-agent Systems // Tom Smoker // #236

Join us at our first in-person conference on June 25 all about AI Quality: https://www.aiqualityconference.com/ Tom Smoker is the cofounder of an early stage tech company empowering developers to create knowledge graphs within their RAG pipelines. Tom is a technical founder, and owns the research and development of knowledge graphs tooling for the company. Managing Small Knowledge Graphs for Multi-agent Systems // MLOps podcast #236 with Tom Smoker, Technical Founder of whyhow.ai. A big thank yo...

May 28, 20241 hr 5 min

Just when we Started to Solve Software Docs, AI Blew Everything Up // Dave Nunez // #235

Join us at our first in-person conference on June 25 all about AI Quality: https://www.aiqualityconference.com/ David Nunez , based in Santa Barbara, CA, US, is currently a Co-Founder and Partner at Abstract Group , bringing experience from previous roles at First Round Capital, Stripe, and Slab. Just when we Started to Solve Software Docs, AI Blew Everything Up // MLOps Podcast #235 with Dave Nunez, Partner of Abstract Group co-hosted by Jakub Czakon . Huge thank you to Zilliz for sponsoring th...

May 27, 20241 hr 2 min

Open Standards Make MLOps Easier and Silos Harder // Cody Peterson // #234

Join us at our first in-person conference on June 25 all about AI Quality: https://www.aiqualityconference.com/ Cody Peterson has a diverse work experience in the field of product management and engineering. Cody is currently working as a Technical Product Manager at Voltron Data , starting from May 2023. Previously, they worked as a Product Manager at dbt Labs from July 2022 to March 2023. MLOps podcast #234 with Cody Peterson, Senior Technical Product Manager at Voltron Data | Ibis project // ...

May 21, 202446 min

Retrieval Augmented Generation

Join us at our first in-person conference on June 25 all about AI Quality: https://www.aiqualityconference.com/ Syed Asad is an Innovator, Generative AI & Machine Learning Engineer, and a Champion for Ethical AI MLOps podcast #233 with Syed Asad, Lead AI/ML Engineer at KiwiTech // Retrieval Augmented Generation. A big thank you to @ for sponsoring this episode! AWS - // Abstract Everything and anything around RAG. // Bio Currently Exploring New Horizons: Syed is diving deep into the exciting...

May 17, 202444 min

RecSys at Spotify // Sanket Gupta // #232

Join us at our first in-person conference on June 25 all about AI Quality: https://www.aiqualityconference.com/ Sanket works as a Senior Machine Learning Engineer at Spotify working on building end-to-end audio recommender systems. Models built by his team are used across Spotify in many different products including Discover Weekly and Autoplay. MLOps podcast #232 with Sanket Gupta, Senior Machine Learning Engineer at Spotify // RecSys at Spotify. A big thank you to LatticeFlow for sponsoring th...

May 16, 202450 min

From A Coding Startup to AI Development in the Enterprise // Ryan Carson // #231

Join us at our first in-person conference on June 25 all about AI Quality: https://www.aiqualityconference.com/ Ryan Carson . CEO Founder for 20 years Built and sold 3 startups Helping build a global community of AI devs with Intel . MLOps podcast #231 with Ryan Carson, Senior AI Dev Community Lead at Intel Huge thank you to Zilliz for sponsoring this episode. Zilliz - https://zilliz.com/ // Abstract Ryan shares his professional journey, tracing his transition from building Treehouse to joining ...

May 10, 202458 min

FedML Nexus AI: Your Generative AI Platform at Scale // Salman Avestimehr // #230

Salman Avestimehr is a Dean's Professor, the inaugural director of the USC-Amazon Center for Secure and Trusted Machine Learning (Trusted AI), and director of the Information Theory and Machine Learning (vITAL) research lab. He is also the CEO and co-founder of FedML. MLOps podcast #230 with Salman Avestimehr, CEO & Founder of FedML, FedML Nexus AI: Your Generative AI Platform at Scale. A big thank you to FEDML for sponsoring this episode! // Abstract FedML is your generative AI platform at ...

May 07, 202453 min

What is AI Quality? // Mohamed Elgendy // #228

Mohamed Elgend y is the Co-Founder & CEO at Kolena . Additionally, Mohamed Elgendy has had 1 past job as the Director Of Product and Engineering at Synapse Technology Corporation . Join us at our first in-person conference on June 25 all about AI Quality: https://www.aiqualityconference.com/ MLOps podcast #228 with Mohamed Elgendy, Co-founder & CEO of Kolena Inc., What is AI Quality? // Abstract Delve into the multifaceted concept of AI Quality. Demetrios and Mo explore the idea that AI ...

May 03, 202446 min

Handling Multi-Terabyte LLM Checkpoints // Simon Karasik // #228

Join us at our first in-person conference on June 25 all about AI Quality: https://www.aiqualityconference.com Simon Karasik ⁠ is a proactive and curious ML Engineer with 5 years of experience. Developed & deployed ML models at WEB and Big scale for Ads and Tax. Huge thank you to Nebius AI for sponsoring this episode. Nebius AI - https://nebius.ai/ MLOps podcast #228 with Simon Karasik, Machine Learning Engineer at Nebius AI, Handling Multi-Terabyte LLM Checkpoints. // Abstract The talk prov...

Apr 30, 202456 min

Leading Enterprise Data Teams // Sol Rashidi // #227

Sol Rashidi is an esteemed executive, leader, and influencer within the AI, Data, and Technology space. Having helped IBM launch Watson in 2011 as one of the earliest world applications of Artificial Intelligence, Sol has pioneered some of the early advancements of space. Join us at our first in-person conference on June 25 all about AI Quality: https://www.aiqualityconference.com/ Huge thank you to @WeightsBiases for sponsoring this episode. WandB Free Courses - http://wandb.me/courses_mlops ML...

Apr 26, 202443 min

The Rise of Modern Data Management // Chad Sanderson // #226

Join us at our first in-person conference on June 25 all about AI Quality: https://www.aiqualityconference.com/ Chad Sanderson is passionate about data quality, and fixing the muddy relationship between data producers and consumers . He is a former Head of Data at Convoy, a LinkedIn writer, and a published author. He lives in Seattle, Washington, and is the Chief Operator of the Data Quality Camp. Huge thank you to @amazonwebservices for sponsoring this episode. AWS - https://aws.amazon.com/ MLO...

Apr 23, 202458 min

Beyond AGI, Can AI Help Save the Planet? // Patrick Beukema // #225

Patrick Beukema has a Ph.D. in neuroscience and has worked on AI models for brain decoding, which analyzes the brain's activity to decipher what people are seeing and thinking. Join us at our first in-person conference on June 25 all about AI Quality: https://www.aiqualityconference.com/ Huge thank you to LatticeFlow for sponsoring this episode. LatticeFlow - https://latticeflow.ai/ MLOps podcast #225 with Patrick Beukema, Head / Technical Lead of the Environmental AI, Applied Science Organizati...

Apr 19, 202454 min

GenAI in Production - Challenges and Trends // Verena Weber // #224

Join us at our first in-person conference on June 25 all about AI Quality: https://www.aiqualityconference.com/ Verena Weber believes that GenAI is going to transform the way we work and interact with devices. Her mission is to help companies prepare for this transformation. She has strong expertise in NLP and over 7 years of experience in Machine Learning. Huge thank you to @zilliz for sponsoring this episode. Zilliz - https://zilliz.com/ MLOps podcast #224 with Verena Weber, Generative AI Cons...

Apr 17, 202449 min

Introducing DBRX: The Future of Language Models // [Exclusive] Databricks Roundtable

Join us at our first in-person conference on June 25 all about AI Quality: https://www.aiqualityconference.com/ MLOps Coffee Sessions Special episode with Databricks, Introducing DBRX: The Future of Language Models, fueled by our Premium Brand Partner, Databricks . DBRX is designed to be especially capable of a wide range of tasks and outperforms other open LLMs on standard benchmarks. It also promises to excel at code and math problems, areas where others have struggled. Our panel of experts wi...

Apr 12, 202449 min

From MVP to Production // AI in Production Conference

Join us at our first in-person conference on June 25 all about AI Quality: https://www.aiqualityconference.com/ // Abstract Dive into the challenges of scaling AI models from Minimum Viable Product (MVP) to full production. The panel emphasizes the importance of continually updating knowledge and data, citing examples like teaching AI systems nuanced concepts and handling brand name translations. User feedback's role in model training, alongside evaluation steps like human annotation and heurist...

Apr 09, 202436 min

Data Engineering in the Federal Sector // Shane Morris // #223

Shane Morris is now a Senior Executive Advisor at Devis . Join us at our first in-person conference on June 25 all about AI Quality: https://www.aiqualityconference.com/ Huge thank you to @WeightsBiases for sponsoring this episode. WandB Free Courses - https://wandb.ai/telidavies/ml-news/reports/Introducing-W-B-MLOps-Courses-Free-Course-Effective-MLOps-Model-Development--VmlldzozMDk2ODA2 MLOps podcast #223 with Shane Morris, Senior Executive Advisor of Devis, Data Engineering in the Federal Sect...

Apr 05, 20241 hr 3 min

What Business Stakeholders Want to See from the ML Teams // Peter Guagenti // #222

Join us at our first in-person conference on June 25 all about AI Quality: https://www.aiqualityconference.com/ ⁠ Peter Guagenti ⁠ is an accomplished business builder and entrepreneur with expertise in strategy, product development, marketing, sales, and operations. Peter has helped build multiple successful start-ups to exits, fueling high growth in each company along the way. He brings a broad perspective, deep problem-solving skills, the ability to drive innovation amongst teams, and a proven...

Apr 02, 20241 hr 21 min

MLOps - Design Thinking to Build ML Infra for ML and LLM Use Cases // Amritha Arun Babu & Abhik Choudhury // #221

Join us at our first in-person conference on June 25 all about AI Quality: https://www.aiqualityconference.com/ Amritha Arun Babu Mysore has been an expert in the field of consumer electronics, software products, and online marketplaces for the past 15 years. She has experience developing supply chains from the ground up, delivering AI-based products to millions of users, and advocating for ethical AI across Amazon, Wayfair, Salesforce, and NetApp. Abhik Choudhury is a Senior Analytics Managing ...

Mar 29, 20241 hr

4 Years of the MLOps Community // Demetrios Brinkmann // #220

Join us at our first in-person conference on June 25 all about AI Quality: https://www.aiqualityconference.com/ Demetrios Brinkmann is the founder of the MLOps Community . Brinkmann fell into the Machine Learning Operations world, and since, has interviewed the leading names around MLOps, Data Science, and Machine Learning. Huge thank you to Weights & Biases for sponsoring this episode. Weights & Biases - https://wandb.ai/site MLOps podcast #220 with our very own Founder of MLOps Communi...

Mar 26, 20241 hr 4 min
For the best experience, listen in Metacast app for iOS or Android
Open in Metacast