MLOps.community - podcast cover

MLOps.community

Demetrios mlops.community
Relaxed Conversations around getting AI into production, whatever shape that may come in (agentic, traditional ML, LLMs, Vibes, etc)

Episodes

Retrieval Augmented Generation

Join us at our first in-person conference on June 25 all about AI Quality: https://www.aiqualityconference.com/ Syed Asad is an Innovator, Generative AI & Machine Learning Engineer, and a Champion for Ethical AI MLOps podcast #233 with Syed Asad, Lead AI/ML Engineer at KiwiTech // Retrieval Augmented Generation. A big thank you to @ for sponsoring this episode! AWS - // Abstract Everything and anything around RAG. // Bio Currently Exploring New Horizons: Syed is diving deep into the exciting...

May 17, 202444 min

RecSys at Spotify // Sanket Gupta // #232

Join us at our first in-person conference on June 25 all about AI Quality: https://www.aiqualityconference.com/ Sanket works as a Senior Machine Learning Engineer at Spotify working on building end-to-end audio recommender systems. Models built by his team are used across Spotify in many different products including Discover Weekly and Autoplay. MLOps podcast #232 with Sanket Gupta, Senior Machine Learning Engineer at Spotify // RecSys at Spotify. A big thank you to LatticeFlow for sponsoring th...

May 16, 202450 min

From A Coding Startup to AI Development in the Enterprise // Ryan Carson // #231

Join us at our first in-person conference on June 25 all about AI Quality: https://www.aiqualityconference.com/ Ryan Carson . CEO Founder for 20 years Built and sold 3 startups Helping build a global community of AI devs with Intel . MLOps podcast #231 with Ryan Carson, Senior AI Dev Community Lead at Intel Huge thank you to Zilliz for sponsoring this episode. Zilliz - https://zilliz.com/ // Abstract Ryan shares his professional journey, tracing his transition from building Treehouse to joining ...

May 10, 202458 min

FedML Nexus AI: Your Generative AI Platform at Scale // Salman Avestimehr // #230

Salman Avestimehr is a Dean's Professor, the inaugural director of the USC-Amazon Center for Secure and Trusted Machine Learning (Trusted AI), and director of the Information Theory and Machine Learning (vITAL) research lab. He is also the CEO and co-founder of FedML. MLOps podcast #230 with Salman Avestimehr, CEO & Founder of FedML, FedML Nexus AI: Your Generative AI Platform at Scale. A big thank you to FEDML for sponsoring this episode! // Abstract FedML is your generative AI platform...

May 07, 202453 min

What is AI Quality? // Mohamed Elgendy // #228

Mohamed Elgend y is the Co-Founder & CEO at Kolena . Additionally, Mohamed Elgendy has had 1 past job as the Director Of Product and Engineering at Synapse Technology Corporation . Join us at our first in-person conference on June 25 all about AI Quality: https://www.aiqualityconference.com/ MLOps podcast #228 with Mohamed Elgendy, Co-founder & CEO of Kolena Inc., What is AI Quality? // Abstract Delve into the multifaceted concept of AI Quality. Demetrios and Mo explore the idea that AI ...

May 03, 202446 min

Handling Multi-Terabyte LLM Checkpoints // Simon Karasik // #228

Join us at our first in-person conference on June 25 all about AI Quality: https://www.aiqualityconference.com Simon Karasik ⁠ is a proactive and curious ML Engineer with 5 years of experience. Developed & deployed ML models at WEB and Big scale for Ads and Tax. Huge thank you to Nebius AI for sponsoring this episode. Nebius AI - https://nebius.ai/ MLOps podcast #228 with Simon Karasik, Machine Learning Engineer at Nebius AI, Handling Multi-Terabyte LLM Checkpoints. // Abstract The talk prov...

Apr 30, 202456 min

Leading Enterprise Data Teams // Sol Rashidi // #227

Sol Rashidi is an esteemed executive, leader, and influencer within the AI, Data, and Technology space. Having helped IBM launch Watson in 2011 as one of the earliest world applications of Artificial Intelligence, Sol has pioneered some of the early advancements of space. Join us at our first in-person conference on June 25 all about AI Quality: https://www.aiqualityconference.com/ Huge thank you to @WeightsBiases for sponsoring this episode. WandB Free Courses - http://wandb.me/courses_mlops ML...

Apr 26, 202443 min

The Rise of Modern Data Management // Chad Sanderson // #226

Join us at our first in-person conference on June 25 all about AI Quality: https://www.aiqualityconference.com/ Chad Sanderson is passionate about data quality, and fixing the muddy relationship between data producers and consumers . He is a former Head of Data at Convoy, a LinkedIn writer, and a published author. He lives in Seattle, Washington, and is the Chief Operator of the Data Quality Camp. Huge thank you to @amazonwebservices for sponsoring this episode. AWS - https://aws.amazon.com/ MLO...

Apr 23, 202458 min

Beyond AGI, Can AI Help Save the Planet? // Patrick Beukema // #225

Patrick Beukema has a Ph.D. in neuroscience and has worked on AI models for brain decoding, which analyzes the brain's activity to decipher what people are seeing and thinking. Join us at our first in-person conference on June 25 all about AI Quality: https://www.aiqualityconference.com/ Huge thank you to LatticeFlow for sponsoring this episode. LatticeFlow - https://latticeflow.ai/ MLOps podcast #225 with Patrick Beukema, Head / Technical Lead of the Environmental AI, Applied Science Organi...

Apr 19, 202454 min

GenAI in Production - Challenges and Trends // Verena Weber // #224

Join us at our first in-person conference on June 25 all about AI Quality: https://www.aiqualityconference.com/ Verena Weber believes that GenAI is going to transform the way we work and interact with devices. Her mission is to help companies prepare for this transformation. She has strong expertise in NLP and over 7 years of experience in Machine Learning. Huge thank you to @zilliz for sponsoring this episode. Zilliz - https://zilliz.com/ MLOps podcast #224 with Verena Weber, Generative AI Cons...

Apr 17, 202449 min

Introducing DBRX: The Future of Language Models // [Exclusive] Databricks Roundtable

Join us at our first in-person conference on June 25 all about AI Quality: https://www.aiqualityconference.com/ MLOps Coffee Sessions Special episode with Databricks, Introducing DBRX: The Future of Language Models, fueled by our Premium Brand Partner, Databricks . DBRX is designed to be especially capable of a wide range of tasks and outperforms other open LLMs on standard benchmarks. It also promises to excel at code and math problems, areas where others have struggled. Our panel of experts wi...

Apr 12, 202449 min

From MVP to Production // AI in Production Conference

Join us at our first in-person conference on June 25 all about AI Quality: https://www.aiqualityconference.com/ // Abstract Dive into the challenges of scaling AI models from Minimum Viable Product (MVP) to full production. The panel emphasizes the importance of continually updating knowledge and data, citing examples like teaching AI systems nuanced concepts and handling brand name translations. User feedback's role in model training, alongside evaluation steps like human annotation and heu...

Apr 09, 202436 min

Data Engineering in the Federal Sector // Shane Morris // #223

Shane Morris is now a Senior Executive Advisor at Devis . Join us at our first in-person conference on June 25 all about AI Quality: https://www.aiqualityconference.com/ Huge thank you to @WeightsBiases for sponsoring this episode. WandB Free Courses - https://wandb.ai/telidavies/ml-news/reports/Introducing-W-B-MLOps-Courses-Free-Course-Effective-MLOps-Model-Development--VmlldzozMDk2ODA2 MLOps podcast #223 with Shane Morris, Senior Executive Advisor of Devis, Data Engineering in the Federal Sect...

Apr 05, 20241 hr 3 min

What Business Stakeholders Want to See from the ML Teams // Peter Guagenti // #222

Join us at our first in-person conference on June 25 all about AI Quality: https://www.aiqualityconference.com/ ⁠ Peter Guagenti ⁠ is an accomplished business builder and entrepreneur with expertise in strategy, product development, marketing, sales, and operations. Peter has helped build multiple successful start-ups to exits, fueling high growth in each company along the way. He brings a broad perspective, deep problem-solving skills, the ability to drive innovation amongst teams, and a proven...

Apr 02, 20241 hr 21 min

MLOps - Design Thinking to Build ML Infra for ML and LLM Use Cases // Amritha Arun Babu & Abhik Choudhury // #221

Join us at our first in-person conference on June 25 all about AI Quality: https://www.aiqualityconference.com/ Amritha Arun Babu Mysore has been an expert in the field of consumer electronics, software products, and online marketplaces for the past 15 years. She has experience developing supply chains from the ground up, delivering AI-based products to millions of users, and advocating for ethical AI across Amazon, Wayfair, Salesforce, and NetApp. Abhik Choudhury is a Senior Analytics Managing ...

Mar 29, 20241 hr

4 Years of the MLOps Community // Demetrios Brinkmann // #220

Join us at our first in-person conference on June 25 all about AI Quality: https://www.aiqualityconference.com/ Demetrios Brinkmann is the founder of the MLOps Community . Brinkmann fell into the Machine Learning Operations world, and since, has interviewed the leading names around MLOps, Data Science, and Machine Learning. Huge thank you to Weights & Biases for sponsoring this episode. Weights & Biases - https://wandb.ai/site MLOps podcast #220 with our very own Founder of MLOps Communi...

Mar 26, 20241 hr 4 min

The Art and Science of Training LLMs // Bandish Shah and Davis Blalock // #219

Join us at our first in-person conference on June 25 all about AI Quality: https://www.aiqualityconference.com/ Huge thank you to ⁠Databricks⁠ AI for sponsoring this episode. Databricks - http://databricks.com/ Bandish Shah is an Engineering Manager at MosaicML/Databricks, where he focuses on making generative AI training and inference efficient, fast, and accessible by bridging the gap between deep learning, large-scale distributed systems, and performance computing. Davis Blalock is a Research...

Mar 22, 20241 hr 15 min

Security and Privacy // Day 2 Panel 1 // AI in Production Conference

// Abstract Diego, David, Ads, and Katharine, bring to light the risks, vulnerabilities, and evolving security landscape of machine learning as we venture into the AI-driven future. They underscore the importance of education in managing AI risks and the critical role privacy engineering plays in this narrative. They explore the legal and ethical implications of AI technologies, fostering a vital conversation on the balance between utility and privacy. // Bio Diego Oppenheimer - Moderator Diego ...

Mar 19, 202435 min

[Exclusive] Zilliz Roundtable // Why Purpose-built Vector Databases Matter for Your Use Case

Frank Liu is the Director of Operations & ML Architect at Zilliz , where he serves as a maintainer for the Towhee open-source project. Jiang Chen is the Head of AI Platform and Ecosystem at Zilliz . Yujian Tang is a developer advocate at Zilliz . He has a background as a software engineer working on AutoML at Amazon. MLOps Coffee Sessions Special episode with Zilliz, Why Purpose-built Vector Databases Matter for Your Use Case, fueled by our Premium Brand Partner, Zilliz . Engineering deep-di...

Mar 15, 202459 min

A Decade of AI Safety and Trust // Petar Tsankov // MLOps Podcast #218

Huge thank you to LatticeFlow AI for sponsoring this episode. LatticeFlow AI - https://latticeflow.ai/. Dr. Petar Tsankov is a researcher and entrepreneur in the field of Computer Science and Artificial Intelligence. MLOps podcast #218 with Petar Tsankov, Co-Founder and CEO at LatticeFlow AI, A Decade of AI Safety and Trust. // Abstract // Bio Co-founder & CEO at LatticeFlow AI, building the world's first product enabling organizations to build performant, safe, and trustworthy AI system...

Mar 12, 202458 min

The Real E2E RAG Stack // Sam Bean, Rewind AI // #217

Thank you to Zilliz our wonderful sponsors of this episode create some amazing stuff with Zilliz RAG - https://zilliz.com/vector-database-use-cases/llm-retrieval-augmented-generation Sam Bean is a seasoned AI and machine learning expert, specializing in Large Language Models (LLMs) and search tech. With a computer science background and a drive for innovation, Sam leads the team at Rewind AI in leveraging advanced tech to tackle complex challenges. MLOps podcast #217 with Sam Bean, Software Engi...

Mar 08, 20241 hr 10 min

Managing Data for Effective GenAI Application // Anu Arora and Anass Bensrhir // #215

Anass Bensrhir is the Associate Partner of McKinsey & Company Casablanca. Anu Arora is the Principal Data Engineering at McKinsey & Company. Check out mckinsey.com/quantumblack MLOps podcast #214 with QuantumBlack AI by McKinsey's Principal Data Engineer, Anu Arora and Associate Partner, Anass Bensrhir, Managing Data for Effective GenAI Application brought to you by our Premium Brand Partner QuantumBlack AI by @McKinsey . // Abstract Generative AI is poised to bring impact across all...

Mar 05, 202451 min

Becoming an AI Evangelist // Alex Volkov // #215

Alex Volkov serves as the AI Evangelist with Weights & Biases , Host of ThursdAI , Founder and CEO Targum and AI Consultant GPU POOR Def. not an owl. MLOps podcast #215 with Alex Volkov, AI Evangelist at Weights & Biases, Becoming an AI Evangelist. // Abstract Follow Alex's journey into the world of AI, from being interested in running his first AI models to founding an AI startup, running a successful weekly AI news podcast & newsletter, and landing a job with @WeightsBiases . // Bi...

Mar 01, 20241 hr 15 min

LLM Use Cases in Production // AI in Production Conference // Panel 1

// Abstract From startups achieving significant value with minor capabilities to AI revolutionizing sales calls and raising sales by 30%, we explore a series of interesting real-world use cases. Understanding the objectives and complexities of various industries, exploring the challenges of launching products, and highlighting the vital integration of the human touch with technology, this episode is a treasure trove of insights. // Bio Greg Kamradt - Moderator Greg has mentored thousands of deve...

Feb 28, 202431 min

Information Retrieval & Relevance // Daniel Svonava // #214

Daniel Svonava is the Co-Founder of Superlinked . Daniel Svonava attended the Faculty of Informatics and Information Technologies, Slovak University of Technology. MLOps podcast #214 with Daniel Svonava, CEO & Co-founder at Superlinked, Information Retrieval & Relevance: Vector Embeddings for Semantic Search // Abstract In today's information-rich world, the ability to retrieve relevant information effectively is essential. This lecture explores the transformative power of vector embeddi...

Feb 24, 202456 min

Evaluating and Integrating ML Models // Morgan McGuire and Anish Shah // #213

Morgan McGuire has held a variety of roles in the past 13 years. In 2008, he completed a Research Internship at Queen Mary, University of London. Currently, he is the Head of Growth ML and Growth ML Engineer at Weights & Biases. Anish Shah has been working in the tech industry since 2015. In 2015, he was a Technical Support at Fox School of Business at Temple University. In 2021, he has been an MLOps Engineer - Growth and a Tier 2 Support Machine Learning Engineer at Weights & Biases. __...

Feb 21, 202452 min

Data Governance and AI // Alexandra Diem // #212

Alexandra Diem, PhD , has extensive experience in the field of AI, machine learning, and cloud analytics. Alexandra currently holds the position of Head of Cloud Analytics and MLOps at Gjensidige . Large Language Models have taken the world by storm. But what are the real use cases? What are the challenges in productionizing them? In this event, you will hear from practitioners about how they are dealing with things such as cost optimization, latency requirements, trust of output, and debugging....

Feb 16, 20241 hr 6 min

Ads Ranking Evolution at Pinterest // Aayush Mudgal // #211

Aayush Mudgal is a Senior Machine Learning Engineer at Pinterest , currently leading the efforts around Privacy-Aware Conversion Modeling. Large Language Models have taken the world by storm. But what are the real use cases? What are the challenges in productionizing them? In this event, you will hear from practitioners about how they are dealing with things such as cost optimization, latency requirements, trust of output, and debugging. You will also get the opportunity to join workshops that w...

Feb 13, 202453 min

LLM Evaluation with Arize AI's Aparna Dhinakaran // #210

Large Language Models have taken the world by storm. But what are the real use cases? What are the challenges in productionizing them? In this event, you will hear from practitioners about how they are dealing with things such as cost optimization, latency requirements, trust of output, and debugging. You will also get the opportunity to join workshops that will teach you how to set up your use cases and skip over all the headaches. Join the AI in Production Conference on February 15 and 22 here...

Feb 09, 202456 min

Powering MLOps: The Story of Tecton's Rift // Matt Bleifer & Mike Eastham // #209

Matt Bleifer is a Group Product Manager at Tecton, where he focuses on the core product experience such as building, testing, and productionizing feature pipelines as scale. Michael Eastham works as a Chief Architect at Tecton, which is a Business Intelligence (BI) Software company with an estimated 100 employees Large Language Models have taken the world by storm. But what are the real use cases? What are the challenges in productionizing them? In this event, you will hear from practitioners ab...

Feb 06, 20241 hr 4 min