MLOps.community - podcast cover

MLOps.community

Demetrios mlops.community
Relaxed Conversations around getting AI into production, whatever shape that may come in (agentic, traditional ML, LLMs, Vibes, etc)

Episodes

The Art and Science of Training LLMs // Bandish Shah and Davis Blalock // #219

Join us at our first in-person conference on June 25 all about AI Quality: https://www.aiqualityconference.com/ Huge thank you to ⁠Databricks⁠ AI for sponsoring this episode. Databricks - http://databricks.com/ Bandish Shah is an Engineering Manager at MosaicML/Databricks, where he focuses on making generative AI training and inference efficient, fast, and accessible by bridging the gap between deep learning, large-scale distributed systems, and performance computing. Davis Blalock is a Research...

Mar 22, 20241 hr 15 min

Security and Privacy // Day 2 Panel 1 // AI in Production Conference

// Abstract Diego, David, Ads, and Katharine, bring to light the risks, vulnerabilities, and evolving security landscape of machine learning as we venture into the AI-driven future. They underscore the importance of education in managing AI risks and the critical role privacy engineering plays in this narrative. They explore the legal and ethical implications of AI technologies, fostering a vital conversation on the balance between utility and privacy. // Bio Diego Oppenheimer - Moderator Diego ...

Mar 19, 202435 min

[Exclusive] Zilliz Roundtable // Why Purpose-built Vector Databases Matter for Your Use Case

Frank Liu is the Director of Operations & ML Architect at Zilliz , where he serves as a maintainer for the Towhee open-source project. Jiang Chen is the Head of AI Platform and Ecosystem at Zilliz . Yujian Tang is a developer advocate at Zilliz . He has a background as a software engineer working on AutoML at Amazon. MLOps Coffee Sessions Special episode with Zilliz, Why Purpose-built Vector Databases Matter for Your Use Case, fueled by our Premium Brand Partner, Zilliz . Engineering deep-di...

Mar 15, 202459 min

A Decade of AI Safety and Trust // Petar Tsankov // MLOps Podcast #218

Huge thank you to LatticeFlow AI for sponsoring this episode. LatticeFlow AI - https://latticeflow.ai/. Dr. Petar Tsankov is a researcher and entrepreneur in the field of Computer Science and Artificial Intelligence. MLOps podcast #218 with Petar Tsankov, Co-Founder and CEO at LatticeFlow AI, A Decade of AI Safety and Trust. // Abstract // Bio Co-founder & CEO at LatticeFlow AI, building the world's first product enabling organizations to build performant, safe, and trustworthy AI systems. B...

Mar 12, 202458 min

The Real E2E RAG Stack // Sam Bean, Rewind AI // #217

Thank you to Zilliz our wonderful sponsors of this episode create some amazing stuff with Zilliz RAG - https://zilliz.com/vector-database-use-cases/llm-retrieval-augmented-generation Sam Bean is a seasoned AI and machine learning expert, specializing in Large Language Models (LLMs) and search tech. With a computer science background and a drive for innovation, Sam leads the team at Rewind AI in leveraging advanced tech to tackle complex challenges. MLOps podcast #217 with Sam Bean, Software Engi...

Mar 08, 20241 hr 10 min

Managing Data for Effective GenAI Application // Anu Arora and Anass Bensrhir // #215

Anass Bensrhir is the Associate Partner of McKinsey & Company Casablanca. Anu Arora is the Principal Data Engineering at McKinsey & Company. Check out mckinsey.com/quantumblack MLOps podcast #214 with QuantumBlack AI by McKinsey's Principal Data Engineer, Anu Arora and Associate Partner, Anass Bensrhir, Managing Data for Effective GenAI Application brought to you by our Premium Brand Partner QuantumBlack AI by @McKinsey . // Abstract Generative AI is poised to bring impact across all ind...

Mar 05, 202451 min

Becoming an AI Evangelist // Alex Volkov // #215

Alex Volkov serves as the AI Evangelist with Weights & Biases , Host of ThursdAI , Founder and CEO Targum and AI Consultant GPU POOR Def. not an owl. MLOps podcast #215 with Alex Volkov, AI Evangelist at Weights & Biases, Becoming an AI Evangelist. // Abstract Follow Alex's journey into the world of AI, from being interested in running his first AI models to founding an AI startup, running a successful weekly AI news podcast & newsletter, and landing a job with @WeightsBiases . // Bi...

Mar 01, 20241 hr 15 min

LLM Use Cases in Production // AI in Production Conference // Panel 1

// Abstract From startups achieving significant value with minor capabilities to AI revolutionizing sales calls and raising sales by 30%, we explore a series of interesting real-world use cases. Understanding the objectives and complexities of various industries, exploring the challenges of launching products, and highlighting the vital integration of the human touch with technology, this episode is a treasure trove of insights. // Bio Greg Kamradt - Moderator Greg has mentored thousands of deve...

Feb 28, 202431 min

Information Retrieval & Relevance // Daniel Svonava // #214

Daniel Svonava is the Co-Founder of Superlinked . Daniel Svonava attended the Faculty of Informatics and Information Technologies, Slovak University of Technology. MLOps podcast #214 with Daniel Svonava, CEO & Co-founder at Superlinked, Information Retrieval & Relevance: Vector Embeddings for Semantic Search // Abstract In today's information-rich world, the ability to retrieve relevant information effectively is essential. This lecture explores the transformative power of vector embeddi...

Feb 24, 202456 min

Evaluating and Integrating ML Models // Morgan McGuire and Anish Shah // #213

Morgan McGuire has held a variety of roles in the past 13 years. In 2008, he completed a Research Internship at Queen Mary, University of London. Currently, he is the Head of Growth ML and Growth ML Engineer at Weights & Biases. Anish Shah has been working in the tech industry since 2015. In 2015, he was a Technical Support at Fox School of Business at Temple University. In 2021, he has been an MLOps Engineer - Growth and a Tier 2 Support Machine Learning Engineer at Weights & Biases. __...

Feb 21, 202452 min

Data Governance and AI // Alexandra Diem // #212

Alexandra Diem, PhD , has extensive experience in the field of AI, machine learning, and cloud analytics. Alexandra currently holds the position of Head of Cloud Analytics and MLOps at Gjensidige . Large Language Models have taken the world by storm. But what are the real use cases? What are the challenges in productionizing them? In this event, you will hear from practitioners about how they are dealing with things such as cost optimization, latency requirements, trust of output, and debugging....

Feb 16, 20241 hr 6 min

Ads Ranking Evolution at Pinterest // Aayush Mudgal // #211

Aayush Mudgal is a Senior Machine Learning Engineer at Pinterest , currently leading the efforts around Privacy-Aware Conversion Modeling. Large Language Models have taken the world by storm. But what are the real use cases? What are the challenges in productionizing them? In this event, you will hear from practitioners about how they are dealing with things such as cost optimization, latency requirements, trust of output, and debugging. You will also get the opportunity to join workshops that w...

Feb 13, 202453 min

LLM Evaluation with Arize AI's Aparna Dhinakaran // #210

Large Language Models have taken the world by storm. But what are the real use cases? What are the challenges in productionizing them? In this event, you will hear from practitioners about how they are dealing with things such as cost optimization, latency requirements, trust of output, and debugging. You will also get the opportunity to join workshops that will teach you how to set up your use cases and skip over all the headaches. Join the AI in Production Conference on February 15 and 22 here...

Feb 09, 202456 min

Powering MLOps: The Story of Tecton's Rift // Matt Bleifer & Mike Eastham // #209

Matt Bleifer is a Group Product Manager at Tecton, where he focuses on the core product experience such as building, testing, and productionizing feature pipelines as scale. Michael Eastham works as a Chief Architect at Tecton, which is a Business Intelligence (BI) Software company with an estimated 100 employees Large Language Models have taken the world by storm. But what are the real use cases? What are the challenges in productionizing them? In this event, you will hear from practitioners ab...

Feb 06, 20241 hr 4 min

[Exclusive] QuantumBlack Round-table // Gen AI Buy vs Build, Commercial vs Open Source

Join our virtual conference 'AI in Production' Transform faster. Innovate smarter. Anticipate the future. At QuantumBlack, we unlock the power of artificial intelligence (AI) to help organizations reinvent themselves from the ground up—and accelerate sustainable and inclusive growth . MLOps Coffee Sessions Special episode with QuantumBlack, AI by McKinsey, GenAI Buy vs Build, Commercial vs Open Source, fueled by our Premium Brand Partner, QuantumBlack, AI by McKinsey . // Abstract Do you build o...

Feb 02, 202456 min

Micro Graph Transformer Powering Small Language Models // Jon Cooke // #208

Jon Cooke is the owner/founder of Dataception a Data, Analytics, and Data Product company, and the creator of the Data Product Pyramid, an adaptive Data Product operating model. MLOps podcast #208 with Jon Cooke, CTO of Dataception, Micro Graph Transformer - Specialist Small Language Models Using Graphs to Accelerate Data Product Eco-systems. // Abstract Specialist deconstructed Encoder/Decoder Transformers along with data product management and tech to vastly accelerate prototyping, building, a...

Jan 30, 202457 min

How Data Platforms Affect ML & AI // Jake Watson // #207

Jake Watson is the writer of thedataplatform.substack.com ⁠ and Principal Data Engineer at The Oakland Group. MLOps podcast #207 with Jake Watson, Principal Data Engineer at The Oakland Group, How Data Platforms Affect ML & AI. // Abstract I’ve always told my clients and colleagues that traditional rule-based software is difficult, but software containing Artificial Intelligence (AI) and/or Machine Learning (ML)* is even more difficult, sometimes impossible. Why is this the case? Well, softw...

Jan 26, 202439 min

RAG Has Been Oversimplified // Yujian Tang // #206

Yujian is working as a Developer Advocate at Zilliz , where they develop and write tutorials for proof of concepts for large language model applications. They also give talks on vector databases, LLM Apps, semantic search, and tangential spaces. MLOps podcast #206 with Yujian Tang, Developer Advocate at Zilliz, RAG Has Been Oversimplified, brought to us by our Premium Brand Partner, Zilliz // Abstract In the world of development, Retrieval Augmented Generation (RAG) has often been oversimplified...

Jan 23, 202449 min

The Myth of AI Breakthroughs // Jonathan Frankle // #205

Jonathan Frankle works as Chief Scientist (Neural Networks) at MosaicML (recently acquired by Databricks ), a startup dedicated to making it easy and cost-effective for anyone to train large-scale, state-of-the-art neural networks. He leads the research team. MLOps podcast #205 with Jonathan Frankle, Chief Scientist (Neural Networks) at Databricks, The Myth of AI Breakthroughs, co-hosted by Denny Lee, brought to us by our Premium Brand Partner, Databricks. // Abstract Jonathan takes us behind th...

Jan 19, 20241 hr 10 min

MLOps at the Crossroads // Patrick Barker & Farhood Etaati // #204

Patrick Barker is the Founder / CTO of Kentauros AI. Farhood Etaati is a Software Engineer at Yektanet . MLOps podcast #204 with Patrick Barker, CTO of Kentauros AI and Farhood Etaati, MLOps/Platform Team Lead at AIMedic, MLOps at the Crossroads. // Abstract MLOps is at a crossroads. The ever-increasing excitement for LLMs' ability to solve some interesting real-world problems has made many people interested in applying these models in new applications which comes with its own challenges, that h...

Jan 16, 202449 min

Pioneering AI Models for Regional Languages // Aleksa Gordić // #203

Aleksa Gordić is an ex-Google DeepMind / Microsoft ML engineer currently working on non-English LLMs at OrtusAI, open-sourcing Meta's NLLB (no language left behind) project and YugoGPT. MLOps podcast #203 with Aleksa Gordić, Founder of OrtusAI, Pioneering AI Models for Regional Languages. // Abstract Dive deep into Aleksa's work with the YugoGPT, a language model serving Serbian, Croatian, Bosnian, and Montenegrin dialects - emphasizing the need for multilingual AI developments. Explore the uniq...

Jan 12, 20241 hr 4 min

Small Data, Big Impact: The Story Behind DuckDB // Hannes Mühleisen & Jordan Tigani // #202

Prof. Dr. Hannes Mühleisen is a creator of the DuckDB database management system and Co-founder and CEO of DuckDB Labs . Jordan is co-founder and chief duck-herder at MotherDuck , a startup building a serverless analytics platform based on DuckDB. MLOps podcast #202 with Hannes Mühleisen, Co-Founder & CEO of DuckDB Labs and Jordan Tigani, Chief Duck-Herder at MotherDuck, Small Data, Big Impact: The Story Behind DuckDB. // Abstract Navigate the intricacies of data management with Jordan Tagan...

Jan 09, 20241 hr 9 min

Language, Graphs, and AI in Industry // Paco Nathan // #201

Paco Nathan is the Managing Partner at Derwen, Inc., and author of Latent Space , along with other books, plus popular videos and tutorials about machine learning, natural language, graph technologies, and related topics. MLOps podcast #201 with Paco Nathan, Managing Partner at Derwen, Inc., Language, Graphs, and AI in Industry. // Abstract Let's talk about key findings from these conferences, specifically summarizing teams that have ROI on machine learning in production: what are the things in ...

Jan 05, 20241 hr 18 min

Founding, Funding, and the Future of MLOps // Mihail Eric // #200

Mihail Eric is an engineer, researcher, and educator who has helped start teams at innovative organizations such as Amazon Alexa and RideOS. Mihail is a cofounder of Storia AI where they build an AI-powered creative assistant for fast and delightful image and video generation. MLOps podcast #200 with Mihail Eric, Co-founder of Storia AI, Founding, Funding, and the Future of MLOps. // Abstract Demetrios and Mihail journey deep into the significance of human sentiment in an increasingly AI-driven ...

Jan 02, 202458 min

Challenges Operationalizing ML (And Some Solutions) // Nathan Ryan Frank // #199

Nathan Ryan Frank is the Machine Learning Operations and platform Director of Grainger. Former Astrophysicist turned data scientist and machine learning engineer with a proven history of delivering results into production across a wide variety of domains while leading projects with international, cross-functional teams. MLOps podcast #199 with Nathan Ryan Frank, Director, Machine Learning Platform & Operations at WW Grainger, Challenges Operationalizing Machine Learning (And Some Solutions)....

Dec 29, 202352 min

Inferring Creativity // Nick Hasty // #198

Nick Hasty is the Director of Product, Discovery & Machine Learning at Giphy , an animated-gif search engine that allows users to search, share, and discover GIFs. MLOps podcast #198, Inferring Creativity. // Abstract Generative AI models have captured our imaginations with their ability to produce new "creative" works such as visually striking images, poems, stories, etc, and their outputs often rival or excel what most humans can do. I believe that these developments should make us re-thin...

Dec 26, 202355 min

The Role of Infrastructure in ML // Niels Bantilan // #197

MLOps podcast #197 with Niels Bantilan, Chief Machine Learning Engineer at Union, The Role of Infrastructure in ML Leveraging Open Source brought to us by Union. // Abstract When we start out building and deploying models in a new organization, life is simple: all I need to do is grab some data, iterate on a model that fits the data well and performs reasonably well on some held-out test set. Then, if you’re fortunate enough to get to the point where you want to deploy it, it’s fairly straightfo...

Dec 22, 20231 hr 5 min

LLMs in Focus: From One-Size Fits All to Verticalized Solutions // Venky Ganti & Laurel Orr // #196

Laurel Orr is a Principal Engineer at Numbers Station, a startup that applies Foundation Model technology to the enterprise data stack. Venky Orr is SVP of Product & Engineering. MLOps podcast #196 with Numbers Station's Venky Ganti SVP, Product & Engineering and Principal Engineer, Laurel Orr, LLMs in Focus: From One-Size Fits All to Verticalized Solutions. // Abstract Dive into the realm of large language models (LLMs) as we explore the merits and limitations of 'one-size fits all' LLM...

Dec 19, 202355 min

[Exclusive] Weights & Biases Round-table // Model Management in a Regulated Environment

MLOps Coffee Sessions Special episode with Weights & Biases, Model Management in a Regulated Environment, fueled by our Premium Brand Partner, Weights & Biases . // Abstract Step into the fascinating world of Language Model Management (LLMs) in a Regulated Environment! Join us for an enlightening chat where we'll explore the intricacies of managing models within highly regulated settings, focusing on compliance and effective strategies. This is your opportunity to be part of a dynamic co...

Dec 15, 202358 min

Building the Future of AI in Software Development // Varun Mohan // #195

MLOps podcast #195 with Varun Mohan, CEO of Codeium, Building the Future of AI in Software Development brought to us by QuantumBlack . // Abstract This brief overview traces the evolution of Exafunction and Codeium, highlighting the strategic transition. It explores the inception of Codeium's key features, offering insights into the thoughtful design process. This emphasizes the company's forward-looking approach to preparing for a rapidly advancing technological landscape. Additionally, it touc...

Dec 12, 20231 hr 5 min
For the best experience, listen in Metacast app for iOS or Android
Open in Metacast