Join our virtual conference 'AI in Production' Transform faster. Innovate smarter. Anticipate the future. At QuantumBlack, we unlock the power of artificial intelligence (AI) to help organizations reinvent themselves from the ground up—and accelerate sustainable and inclusive growth . MLOps Coffee Sessions Special episode with QuantumBlack, AI by McKinsey, GenAI Buy vs Build, Commercial vs Open Source, fueled by our Premium Brand Partner, QuantumBlack, AI by McKinsey . // Abstract Do you...
Feb 02, 2024•56 min
Jon Cooke is the owner/founder of Dataception a Data, Analytics, and Data Product company, and the creator of the Data Product Pyramid, an adaptive Data Product operating model. MLOps podcast #208 with Jon Cooke, CTO of Dataception, Micro Graph Transformer - Specialist Small Language Models Using Graphs to Accelerate Data Product Eco-systems. // Abstract Specialist deconstructed Encoder/Decoder Transformers along with data product management and tech to vastly accelerate prototyping, building, a...
Jan 30, 2024•57 min
Jake Watson is the writer of thedataplatform.substack.com and Principal Data Engineer at The Oakland Group. MLOps podcast #207 with Jake Watson, Principal Data Engineer at The Oakland Group, How Data Platforms Affect ML & AI. // Abstract I’ve always told my clients and colleagues that traditional rule-based software is difficult, but software containing Artificial Intelligence (AI) and/or Machine Learning (ML)* is even more difficult, sometimes impossible. Why is this the case? Well, softw...
Jan 26, 2024•39 min
Yujian is working as a Developer Advocate at Zilliz , where they develop and write tutorials for proof of concepts for large language model applications. They also give talks on vector databases, LLM Apps, semantic search, and tangential spaces. MLOps podcast #206 with Yujian Tang, Developer Advocate at Zilliz, RAG Has Been Oversimplified, brought to us by our Premium Brand Partner, Zilliz // Abstract In the world of development, Retrieval Augmented Generation (RAG) has often been oversimplified...
Jan 23, 2024•49 min
Jonathan Frankle works as Chief Scientist (Neural Networks) at MosaicML (recently acquired by Databricks ), a startup dedicated to making it easy and cost-effective for anyone to train large-scale, state-of-the-art neural networks. He leads the research team. MLOps podcast #205 with Jonathan Frankle, Chief Scientist (Neural Networks) at Databricks, The Myth of AI Breakthroughs, co-hosted by Denny Lee, brought to us by our Premium Brand Partner, Databricks. // Abstract Jonathan takes us behind th...
Jan 19, 2024•1 hr 10 min
Patrick Barker is the Founder / CTO of Kentauros AI. Farhood Etaati is a Software Engineer at Yektanet . MLOps podcast #204 with Patrick Barker, CTO of Kentauros AI and Farhood Etaati, MLOps/Platform Team Lead at AIMedic, MLOps at the Crossroads. // Abstract MLOps is at a crossroads. The ever-increasing excitement for LLMs' ability to solve some interesting real-world problems has made many people interested in applying these models in new applications which comes with its own challenges, th...
Jan 16, 2024•49 min
Aleksa Gordić is an ex-Google DeepMind / Microsoft ML engineer currently working on non-English LLMs at OrtusAI, open-sourcing Meta's NLLB (no language left behind) project and YugoGPT. MLOps podcast #203 with Aleksa Gordić, Founder of OrtusAI, Pioneering AI Models for Regional Languages. // Abstract Dive deep into Aleksa's work with the YugoGPT, a language model serving Serbian, Croatian, Bosnian, and Montenegrin dialects - emphasizing the need for multilingual AI developments. Explore ...
Jan 12, 2024•1 hr 4 min
Prof. Dr. Hannes Mühleisen is a creator of the DuckDB database management system and Co-founder and CEO of DuckDB Labs . Jordan is co-founder and chief duck-herder at MotherDuck , a startup building a serverless analytics platform based on DuckDB. MLOps podcast #202 with Hannes Mühleisen, Co-Founder & CEO of DuckDB Labs and Jordan Tigani, Chief Duck-Herder at MotherDuck, Small Data, Big Impact: The Story Behind DuckDB. // Abstract Navigate the intricacies of data management with Jordan Tagan...
Jan 09, 2024•1 hr 9 min
Paco Nathan is the Managing Partner at Derwen, Inc., and author of Latent Space , along with other books, plus popular videos and tutorials about machine learning, natural language, graph technologies, and related topics. MLOps podcast #201 with Paco Nathan, Managing Partner at Derwen, Inc., Language, Graphs, and AI in Industry. // Abstract Let's talk about key findings from these conferences, specifically summarizing teams that have ROI on machine learning in production: what are the things...
Jan 05, 2024•1 hr 18 min
Mihail Eric is an engineer, researcher, and educator who has helped start teams at innovative organizations such as Amazon Alexa and RideOS. Mihail is a cofounder of Storia AI where they build an AI-powered creative assistant for fast and delightful image and video generation. MLOps podcast #200 with Mihail Eric, Co-founder of Storia AI, Founding, Funding, and the Future of MLOps. // Abstract Demetrios and Mihail journey deep into the significance of human sentiment in an increasingly AI-driven ...
Jan 02, 2024•58 min
Nathan Ryan Frank is the Machine Learning Operations and platform Director of Grainger. Former Astrophysicist turned data scientist and machine learning engineer with a proven history of delivering results into production across a wide variety of domains while leading projects with international, cross-functional teams. MLOps podcast #199 with Nathan Ryan Frank, Director, Machine Learning Platform & Operations at WW Grainger, Challenges Operationalizing Machine Learning (And Some Solutions)....
Dec 29, 2023•52 min
Nick Hasty is the Director of Product, Discovery & Machine Learning at Giphy , an animated-gif search engine that allows users to search, share, and discover GIFs. MLOps podcast #198, Inferring Creativity. // Abstract Generative AI models have captured our imaginations with their ability to produce new "creative" works such as visually striking images, poems, stories, etc, and their outputs often rival or excel what most humans can do. I believe that these developments should make ...
Dec 26, 2023•55 min
MLOps podcast #197 with Niels Bantilan, Chief Machine Learning Engineer at Union, The Role of Infrastructure in ML Leveraging Open Source brought to us by Union. // Abstract When we start out building and deploying models in a new organization, life is simple: all I need to do is grab some data, iterate on a model that fits the data well and performs reasonably well on some held-out test set. Then, if you’re fortunate enough to get to the point where you want to deploy it, it’s fairly straightfo...
Dec 22, 2023•1 hr 5 min
Laurel Orr is a Principal Engineer at Numbers Station, a startup that applies Foundation Model technology to the enterprise data stack. Venky Orr is SVP of Product & Engineering. MLOps podcast #196 with Numbers Station's Venky Ganti SVP, Product & Engineering and Principal Engineer, Laurel Orr, LLMs in Focus: From One-Size Fits All to Verticalized Solutions. // Abstract Dive into the realm of large language models (LLMs) as we explore the merits and limitations of 'one-size fits ...
Dec 19, 2023•55 min
MLOps Coffee Sessions Special episode with Weights & Biases, Model Management in a Regulated Environment, fueled by our Premium Brand Partner, Weights & Biases . // Abstract Step into the fascinating world of Language Model Management (LLMs) in a Regulated Environment! Join us for an enlightening chat where we'll explore the intricacies of managing models within highly regulated settings, focusing on compliance and effective strategies. This is your opportunity to be part of a dynami...
Dec 15, 2023•58 min
MLOps podcast #195 with Varun Mohan, CEO of Codeium, Building the Future of AI in Software Development brought to us by QuantumBlack . // Abstract This brief overview traces the evolution of Exafunction and Codeium, highlighting the strategic transition. It explores the inception of Codeium's key features, offering insights into the thoughtful design process. This emphasizes the company's forward-looking approach to preparing for a rapidly advancing technological landscape. Additionally,...
Dec 12, 2023•1 hr 5 min
// Abstract Explore the transformative role of AI in EdTech, discussing its potential to enhance learning experiences and personalize education. The panelists share insights on AI use cases, challenges in AI integration, and strategies for building a differentiated business model in the evolving AI landscape. The discussion looks ahead at how the latest wave of GenAI is set to shape the future of education. Join us to understand the exciting prospects and challenges of AI in EdTech. Moderator: P...
Dec 08, 2023•31 min
Join our conference: https://home.mlops.community/public/events/llms-in-production-part-iii-2023-10-03 MLOps Coffee Sessions Special episode with Tecton, Get your ML Application Into Production, sponsored by Tecton . // Abstract Getting an ML application into production is more difficult than most teams expect—but with the right preparation, it can be done efficiently! Join us for this exclusive roundtable, where 4 machine learning experts from Tecton will discuss some of the most common challen...
Dec 07, 2023•56 min
MLOps podcast #194 with Omar Khattab, PhD Candidate at Stanford, DSPy: Compiling Declarative Language Model Calls into Self-Improving Pipelines. // Abstract The ML community is rapidly exploring techniques for prompting language models (LMs) and for stacking them into pipelines that solve complex tasks. Unfortunately, existing LM pipelines are typically implemented using hard-coded "prompt templates", i.e. lengthy strings discovered via trial and error. Toward a more systematic approac...
Dec 05, 2023•1 hr 6 min
// Abstract Martian is focused on building a model router to dynamically route every prompt to the best LLM for the highest performance and lowest cost. Corti, the Al Co-Pilot for health care uses Al to improve patient care, demonstrating the potential of Al in healthcare and medical decision-making. They recently raised $60M, with Prosus being one of the lead investors. Transforms is pioneering in synthetic entertainment, showing how Al can transform the way we create and consume media. Moderat...
Dec 01, 2023•31 min
MLOps podcast #193 with Pierre Salvy, Head of Engineering at Cambrium, LLM in Material Production co-hosted by Stephen Batifol. // Abstract Delve into the world of proteins, genetic engineering, and the intersection of AI and biotech. Pierre explains how his company is using advanced models to design proteins with specific properties, even creating a vegan collagen for cosmetics. By harnessing the potential of AI, they aim to revolutionize sustainability, uncovering a future of lab-grown meats, ...
Nov 28, 2023•55 min
// Abstract A product-minded engineering perspective on UX/design patterns, product evaluation, and building with AI. // Bio Charles Frye Charles teaches people how to build ML applications. After doing research in psychopharmacology and neurobiology, he pivoted to artificial neural networks and completed a PhD at the University of California, Berkeley in 2020. He then worked as an educator at Weights & Biases before joining @Full Stack Deep Learning, an online community and MOOC for buildin...
Nov 24, 2023•32 min
MLOps podcast #192 with Chris Van Pelt, CISO and co-founder of Weights & Biases, Enterprises Using MLOps, the Changing LLM Landscape, MLOps Pipelines sponsored by @WeightsBiases . // Abstract Chris, provides insights into his machine learning (ML) journey, emphasizing the significance of ML evaluation processes and the evolving landscape of MLOps. The conversation covers effective evaluation metrics, demo-driven development nuances, and the complexities of ML Ops pipelines. Chris reflects on...
Nov 21, 2023•48 min
MLOps podcast #191 with Gregory Kamradt, Founder of @DataIndependent , Building Defensible AI Apps sponsored by @MilvusVectorDatabase . // Abstract Demetrios engages in a captivating conversation with Gregory Kamradt, an AI visionary deeply immersed in technology and product development. The discussion spans various challenges businesses encounter in implementing AI, the transformative potential of AI in revolutionizing business processes, and the growth and possibilities associated with OpenAI....
Nov 17, 2023•1 hr 6 min
MLOps podcast #190 with Ads Dawson, Senior Security Engineer at Cohere, Guarding LLM and NLP APIs: A Trailblazing Odyssey for Enhanced Security. // Abstract Ads Dawson, a seasoned security engineer at Cohere, explores the challenges and solutions in securing large language models (LLMs) and natural language programming APIs. Drawing on his extensive experience, Ads discusses approaches to threat modeling LLM applications, preventing data breaches, defending against attacks, and bolstering the se...
Nov 14, 2023•1 hr
MLOps podcast #189 with Rohit Agarwal, CEO of Portkey.ai, Designing for Forward Compatibility in Gen AI. // Abstract For two whole years of working with a large LLM deployment, I always felt uncomfortable. How is my system performing? Are my users liking the outputs? Who needs help? Probabilistic systems can make this really hard to understand. In this talk, we'll discuss practical & implementable items to secure your LLM system and gain confidence while deploying to production. // Bio R...
Nov 10, 2023•1 hr
MLOps podcast #188 with Anand Das, Co-founder and CTO of Bito, Impact of LLMs on the Tech Stack and Product Development. // Abstract Anand and his team have developed a fascinating Chrome extension called "explain code" that has garnered significant attention in the tech community. They have expanded their extension to other platforms like Visual Studio code and Chat Brains, creating a personal assistant for code generation, explanation, and test case writing. // Bio Anand Das is the c...
Nov 07, 2023•55 min
MLOps podcast #187 with Faizaan Charania, Product Manager, AI at LinkedIn, Building Effective Products with GenAI. // Abstract Faizaan outlines his AI product development approach, starting broadly and refining details with tech leads, emphasizing the value of a simplified MVP. He also explores integrating generative AI, highlighting its role in enhancing user experiences through LLMs. In this discussion, Faizaan shares wisdom on feedback integration, user trust, and the collaboration challenges...
Nov 03, 2023•53 min
MLOps podcast #186 with Mike Del Balso, CEO & Co-founder of Tecton and Josh Wills, Angel Investor, The Future of Feature Stores and Platforms. // Abstract Mike and Josh discuss creating templates and working at a detailed level, exploring Tecton's potential for sharing fraud and third-party features. They focus on technical aspects like data handling and optimizing models, emphasizing the significance of quality data for AI systems and the necessity for cohesive feature infrastructure in...
Oct 31, 2023•1 hr 11 min
MLOps podcast #185 with Luigi Patruno, VP of Data Science at 2U, Inc, Lessons on Data Science Leadership. // AbstractPicture this: you've got data products to manage, and you're in charge of a team. It's not all sunshine and rainbows, right? Luigi dives into the nitty-gritty of the challenges - from juggling data projects to wrangling the team dynamics. It's a real adventure, let me tell you! // Bio Luigi Patruno is a results-driven data science leader passionate about identifyin...
Oct 27, 2023•1 hr 14 min
