MLOps.community - podcast cover

MLOps.community

Demetrios mlops.community
Relaxed Conversations around getting AI into production, whatever shape that may come in (agentic, traditional ML, LLMs, Vibes, etc)

Episodes

Uber's Michelangelo: Strategic AI Overhaul and Impact // #239

Uber's Michelangelo: Strategic AI Overhaul and Impact // MLOps podcast #239 with Demetrios Brinkmann. Huge thank you to Weights & Biases for sponsoring this episode. WandB Free Courses - http://wandb.me/courses_mlops // Abstract Uber's Michelangelo platform has evolved significantly through three major phases, enhancing its capabilities from basic ML predictions to sophisticated uses in deep learning and generative AI. Initially, Michelangelo 1.0 faced several challenges such as a la...

Jun 07, 202436 min

AWS Tranium and Inferentia // Kamran Khan and Matthew McClean // #238

Join us at our first in-person conference on June 25 all about AI Quality: https://www.aiqualityconference.com/ Matthew McClean is a Machine Learning Technology Leader with the leading Amazon Web Services (AWS) cloud platform. He leads the customer engineering teams at Annapurna ML helping customers adopt AWS Trainium and Inferentia for their Gen AI workloads. Kamran Khan , Sr Technical Business Development Manager for AWS Inferentina/Trianium at AWS. He has over a decade of experience helping c...

Jun 04, 202445 min

Build Reliable Systems with Chaos Engineering // Benjamin Wilms // #237

Join us at our first in-person conference on June 25 all about AI Quality: https://www.aiqualityconference.com/. Benjamin Wilms is a developer and software architect at heart, with 20 years of experience. He fell in love with chaos engineering. Benjamin now spreads his enthusiasm and new knowledge as a speaker and author – especially in the field of chaos and resilience engineering. Retrieval Augmented Generation // MLOps podcast #237 with Benjamin Wilms, CEO & Co-Founder of Steadybit. Huge ...

May 31, 202447 min

Managing Small Knowledge Graphs for Multi-agent Systems // Tom Smoker // #236

Join us at our first in-person conference on June 25 all about AI Quality: https://www.aiqualityconference.com/ Tom Smoker is the cofounder of an early stage tech company empowering developers to create knowledge graphs within their RAG pipelines. Tom is a technical founder, and owns the research and development of knowledge graphs tooling for the company. Managing Small Knowledge Graphs for Multi-agent Systems // MLOps podcast #236 with Tom Smoker, Technical Founder of whyhow.ai. A big thank yo...

May 28, 20241 hr 5 min

Just when we Started to Solve Software Docs, AI Blew Everything Up // Dave Nunez // #235

Join us at our first in-person conference on June 25 all about AI Quality: https://www.aiqualityconference.com/ David Nunez , based in Santa Barbara, CA, US, is currently a Co-Founder and Partner at Abstract Group , bringing experience from previous roles at First Round Capital, Stripe, and Slab. Just when we Started to Solve Software Docs, AI Blew Everything Up // MLOps Podcast #235 with Dave Nunez, Partner of Abstract Group co-hosted by Jakub Czakon . Huge thank you to Zilliz for sponsoring th...

May 27, 20241 hr 2 min

Open Standards Make MLOps Easier and Silos Harder // Cody Peterson // #234

Join us at our first in-person conference on June 25 all about AI Quality: https://www.aiqualityconference.com/ Cody Peterson has a diverse work experience in the field of product management and engineering. Cody is currently working as a Technical Product Manager at Voltron Data , starting from May 2023. Previously, they worked as a Product Manager at dbt Labs from July 2022 to March 2023. MLOps podcast #234 with Cody Peterson, Senior Technical Product Manager at Voltron Data | Ibis project // ...

May 21, 202446 min

Retrieval Augmented Generation

Join us at our first in-person conference on June 25 all about AI Quality: https://www.aiqualityconference.com/ Syed Asad is an Innovator, Generative AI & Machine Learning Engineer, and a Champion for Ethical AI MLOps podcast #233 with Syed Asad, Lead AI/ML Engineer at KiwiTech // Retrieval Augmented Generation. A big thank you to @ for sponsoring this episode! AWS - // Abstract Everything and anything around RAG. // Bio Currently Exploring New Horizons: Syed is diving deep into the exciting...

May 17, 202444 min

RecSys at Spotify // Sanket Gupta // #232

Join us at our first in-person conference on June 25 all about AI Quality: https://www.aiqualityconference.com/ Sanket works as a Senior Machine Learning Engineer at Spotify working on building end-to-end audio recommender systems. Models built by his team are used across Spotify in many different products including Discover Weekly and Autoplay. MLOps podcast #232 with Sanket Gupta, Senior Machine Learning Engineer at Spotify // RecSys at Spotify. A big thank you to LatticeFlow for sponsoring th...

May 16, 202450 min

From A Coding Startup to AI Development in the Enterprise // Ryan Carson // #231

Join us at our first in-person conference on June 25 all about AI Quality: https://www.aiqualityconference.com/ Ryan Carson . CEO Founder for 20 years Built and sold 3 startups Helping build a global community of AI devs with Intel . MLOps podcast #231 with Ryan Carson, Senior AI Dev Community Lead at Intel Huge thank you to Zilliz for sponsoring this episode. Zilliz - https://zilliz.com/ // Abstract Ryan shares his professional journey, tracing his transition from building Treehouse to joining ...

May 10, 202458 min

FedML Nexus AI: Your Generative AI Platform at Scale // Salman Avestimehr // #230

Salman Avestimehr is a Dean's Professor, the inaugural director of the USC-Amazon Center for Secure and Trusted Machine Learning (Trusted AI), and director of the Information Theory and Machine Learning (vITAL) research lab. He is also the CEO and co-founder of FedML. MLOps podcast #230 with Salman Avestimehr, CEO & Founder of FedML, FedML Nexus AI: Your Generative AI Platform at Scale. A big thank you to FEDML for sponsoring this episode! // Abstract FedML is your generative AI platform...

May 07, 202453 min

What is AI Quality? // Mohamed Elgendy // #228

Mohamed Elgend y is the Co-Founder & CEO at Kolena . Additionally, Mohamed Elgendy has had 1 past job as the Director Of Product and Engineering at Synapse Technology Corporation . Join us at our first in-person conference on June 25 all about AI Quality: https://www.aiqualityconference.com/ MLOps podcast #228 with Mohamed Elgendy, Co-founder & CEO of Kolena Inc., What is AI Quality? // Abstract Delve into the multifaceted concept of AI Quality. Demetrios and Mo explore the idea that AI ...

May 03, 202446 min

Handling Multi-Terabyte LLM Checkpoints // Simon Karasik // #228

Join us at our first in-person conference on June 25 all about AI Quality: https://www.aiqualityconference.com Simon Karasik ⁠ is a proactive and curious ML Engineer with 5 years of experience. Developed & deployed ML models at WEB and Big scale for Ads and Tax. Huge thank you to Nebius AI for sponsoring this episode. Nebius AI - https://nebius.ai/ MLOps podcast #228 with Simon Karasik, Machine Learning Engineer at Nebius AI, Handling Multi-Terabyte LLM Checkpoints. // Abstract The talk prov...

Apr 30, 202456 min

Leading Enterprise Data Teams // Sol Rashidi // #227

Sol Rashidi is an esteemed executive, leader, and influencer within the AI, Data, and Technology space. Having helped IBM launch Watson in 2011 as one of the earliest world applications of Artificial Intelligence, Sol has pioneered some of the early advancements of space. Join us at our first in-person conference on June 25 all about AI Quality: https://www.aiqualityconference.com/ Huge thank you to @WeightsBiases for sponsoring this episode. WandB Free Courses - http://wandb.me/courses_mlops ML...

Apr 26, 202443 min

The Rise of Modern Data Management // Chad Sanderson // #226

Join us at our first in-person conference on June 25 all about AI Quality: https://www.aiqualityconference.com/ Chad Sanderson is passionate about data quality, and fixing the muddy relationship between data producers and consumers . He is a former Head of Data at Convoy, a LinkedIn writer, and a published author. He lives in Seattle, Washington, and is the Chief Operator of the Data Quality Camp. Huge thank you to @amazonwebservices for sponsoring this episode. AWS - https://aws.amazon.com/ MLO...

Apr 23, 202458 min

Beyond AGI, Can AI Help Save the Planet? // Patrick Beukema // #225

Patrick Beukema has a Ph.D. in neuroscience and has worked on AI models for brain decoding, which analyzes the brain's activity to decipher what people are seeing and thinking. Join us at our first in-person conference on June 25 all about AI Quality: https://www.aiqualityconference.com/ Huge thank you to LatticeFlow for sponsoring this episode. LatticeFlow - https://latticeflow.ai/ MLOps podcast #225 with Patrick Beukema, Head / Technical Lead of the Environmental AI, Applied Science Organi...

Apr 19, 202454 min

GenAI in Production - Challenges and Trends // Verena Weber // #224

Join us at our first in-person conference on June 25 all about AI Quality: https://www.aiqualityconference.com/ Verena Weber believes that GenAI is going to transform the way we work and interact with devices. Her mission is to help companies prepare for this transformation. She has strong expertise in NLP and over 7 years of experience in Machine Learning. Huge thank you to @zilliz for sponsoring this episode. Zilliz - https://zilliz.com/ MLOps podcast #224 with Verena Weber, Generative AI Cons...

Apr 17, 202449 min

Introducing DBRX: The Future of Language Models // [Exclusive] Databricks Roundtable

Join us at our first in-person conference on June 25 all about AI Quality: https://www.aiqualityconference.com/ MLOps Coffee Sessions Special episode with Databricks, Introducing DBRX: The Future of Language Models, fueled by our Premium Brand Partner, Databricks . DBRX is designed to be especially capable of a wide range of tasks and outperforms other open LLMs on standard benchmarks. It also promises to excel at code and math problems, areas where others have struggled. Our panel of experts wi...

Apr 12, 202449 min

From MVP to Production // AI in Production Conference

Join us at our first in-person conference on June 25 all about AI Quality: https://www.aiqualityconference.com/ // Abstract Dive into the challenges of scaling AI models from Minimum Viable Product (MVP) to full production. The panel emphasizes the importance of continually updating knowledge and data, citing examples like teaching AI systems nuanced concepts and handling brand name translations. User feedback's role in model training, alongside evaluation steps like human annotation and heu...

Apr 09, 202436 min

Data Engineering in the Federal Sector // Shane Morris // #223

Shane Morris is now a Senior Executive Advisor at Devis . Join us at our first in-person conference on June 25 all about AI Quality: https://www.aiqualityconference.com/ Huge thank you to @WeightsBiases for sponsoring this episode. WandB Free Courses - https://wandb.ai/telidavies/ml-news/reports/Introducing-W-B-MLOps-Courses-Free-Course-Effective-MLOps-Model-Development--VmlldzozMDk2ODA2 MLOps podcast #223 with Shane Morris, Senior Executive Advisor of Devis, Data Engineering in the Federal Sect...

Apr 05, 20241 hr 3 min

What Business Stakeholders Want to See from the ML Teams // Peter Guagenti // #222

Join us at our first in-person conference on June 25 all about AI Quality: https://www.aiqualityconference.com/ ⁠ Peter Guagenti ⁠ is an accomplished business builder and entrepreneur with expertise in strategy, product development, marketing, sales, and operations. Peter has helped build multiple successful start-ups to exits, fueling high growth in each company along the way. He brings a broad perspective, deep problem-solving skills, the ability to drive innovation amongst teams, and a proven...

Apr 02, 20241 hr 21 min

MLOps - Design Thinking to Build ML Infra for ML and LLM Use Cases // Amritha Arun Babu & Abhik Choudhury // #221

Join us at our first in-person conference on June 25 all about AI Quality: https://www.aiqualityconference.com/ Amritha Arun Babu Mysore has been an expert in the field of consumer electronics, software products, and online marketplaces for the past 15 years. She has experience developing supply chains from the ground up, delivering AI-based products to millions of users, and advocating for ethical AI across Amazon, Wayfair, Salesforce, and NetApp. Abhik Choudhury is a Senior Analytics Managing ...

Mar 29, 20241 hr

4 Years of the MLOps Community // Demetrios Brinkmann // #220

Join us at our first in-person conference on June 25 all about AI Quality: https://www.aiqualityconference.com/ Demetrios Brinkmann is the founder of the MLOps Community . Brinkmann fell into the Machine Learning Operations world, and since, has interviewed the leading names around MLOps, Data Science, and Machine Learning. Huge thank you to Weights & Biases for sponsoring this episode. Weights & Biases - https://wandb.ai/site MLOps podcast #220 with our very own Founder of MLOps Communi...

Mar 26, 20241 hr 4 min

The Art and Science of Training LLMs // Bandish Shah and Davis Blalock // #219

Join us at our first in-person conference on June 25 all about AI Quality: https://www.aiqualityconference.com/ Huge thank you to ⁠Databricks⁠ AI for sponsoring this episode. Databricks - http://databricks.com/ Bandish Shah is an Engineering Manager at MosaicML/Databricks, where he focuses on making generative AI training and inference efficient, fast, and accessible by bridging the gap between deep learning, large-scale distributed systems, and performance computing. Davis Blalock is a Research...

Mar 22, 20241 hr 15 min

Security and Privacy // Day 2 Panel 1 // AI in Production Conference

// Abstract Diego, David, Ads, and Katharine, bring to light the risks, vulnerabilities, and evolving security landscape of machine learning as we venture into the AI-driven future. They underscore the importance of education in managing AI risks and the critical role privacy engineering plays in this narrative. They explore the legal and ethical implications of AI technologies, fostering a vital conversation on the balance between utility and privacy. // Bio Diego Oppenheimer - Moderator Diego ...

Mar 19, 202435 min

[Exclusive] Zilliz Roundtable // Why Purpose-built Vector Databases Matter for Your Use Case

Frank Liu is the Director of Operations & ML Architect at Zilliz , where he serves as a maintainer for the Towhee open-source project. Jiang Chen is the Head of AI Platform and Ecosystem at Zilliz . Yujian Tang is a developer advocate at Zilliz . He has a background as a software engineer working on AutoML at Amazon. MLOps Coffee Sessions Special episode with Zilliz, Why Purpose-built Vector Databases Matter for Your Use Case, fueled by our Premium Brand Partner, Zilliz . Engineering deep-di...

Mar 15, 202459 min

A Decade of AI Safety and Trust // Petar Tsankov // MLOps Podcast #218

Huge thank you to LatticeFlow AI for sponsoring this episode. LatticeFlow AI - https://latticeflow.ai/. Dr. Petar Tsankov is a researcher and entrepreneur in the field of Computer Science and Artificial Intelligence. MLOps podcast #218 with Petar Tsankov, Co-Founder and CEO at LatticeFlow AI, A Decade of AI Safety and Trust. // Abstract // Bio Co-founder & CEO at LatticeFlow AI, building the world's first product enabling organizations to build performant, safe, and trustworthy AI system...

Mar 12, 202458 min

The Real E2E RAG Stack // Sam Bean, Rewind AI // #217

Thank you to Zilliz our wonderful sponsors of this episode create some amazing stuff with Zilliz RAG - https://zilliz.com/vector-database-use-cases/llm-retrieval-augmented-generation Sam Bean is a seasoned AI and machine learning expert, specializing in Large Language Models (LLMs) and search tech. With a computer science background and a drive for innovation, Sam leads the team at Rewind AI in leveraging advanced tech to tackle complex challenges. MLOps podcast #217 with Sam Bean, Software Engi...

Mar 08, 20241 hr 10 min

Managing Data for Effective GenAI Application // Anu Arora and Anass Bensrhir // #215

Anass Bensrhir is the Associate Partner of McKinsey & Company Casablanca. Anu Arora is the Principal Data Engineering at McKinsey & Company. Check out mckinsey.com/quantumblack MLOps podcast #214 with QuantumBlack AI by McKinsey's Principal Data Engineer, Anu Arora and Associate Partner, Anass Bensrhir, Managing Data for Effective GenAI Application brought to you by our Premium Brand Partner QuantumBlack AI by @McKinsey . // Abstract Generative AI is poised to bring impact across all...

Mar 05, 202451 min

Becoming an AI Evangelist // Alex Volkov // #215

Alex Volkov serves as the AI Evangelist with Weights & Biases , Host of ThursdAI , Founder and CEO Targum and AI Consultant GPU POOR Def. not an owl. MLOps podcast #215 with Alex Volkov, AI Evangelist at Weights & Biases, Becoming an AI Evangelist. // Abstract Follow Alex's journey into the world of AI, from being interested in running his first AI models to founding an AI startup, running a successful weekly AI news podcast & newsletter, and landing a job with @WeightsBiases . // Bi...

Mar 01, 20241 hr 15 min

LLM Use Cases in Production // AI in Production Conference // Panel 1

// Abstract From startups achieving significant value with minor capabilities to AI revolutionizing sales calls and raising sales by 30%, we explore a series of interesting real-world use cases. Understanding the objectives and complexities of various industries, exploring the challenges of launching products, and highlighting the vital integration of the human touch with technology, this episode is a treasure trove of insights. // Bio Greg Kamradt - Moderator Greg has mentored thousands of deve...

Feb 28, 202431 min
For the best experience, listen in Metacast app for iOS or Android
Open in Metacast