MLOps Coffee Sessions #62 with Joel Grus, MLOps from Scratch. // Abstract In this talk, Joel Grus of “I don’t like notebooks” fame shares with us his 2021 perspective on notebooks, where he thinks MLOps is now, and what his hot takes in the data space are now. // Bio Joel Grus is a Principal Engineer at Capital Group, where he leads a team that builds search, data, and machine learning products for the investment group. He is the author of the bestselling O'Reilly book *Data Science from Scratch...
Nov 09, 2021•56 min•Season 1Ep. 62
MLOps Coffee Sessions #60 with Svet Penkov, ML Tests. // Abstract How confident do you feel when you deploy a new model? Does improving an ML model feel like a game of "whack-a-mole"? ML is taking over all sorts of industries and yet ML testing tools are virtually non-existent. Drawing parallels from software engineering and electronic circuit board design to the aviation and semiconductor industries, the need for principled quality assurance (QA) step in the MLOps pipeline is long overdue. Let'...
Nov 02, 2021•41 min•Season 1Ep. 61
Coffee Sessions #60 with Alexandre Patry, Path to Productivity in Job Search and Job Recommendation AI at LinkedIn. // Abstract A year ago, LinkedIn job search and recommendation AI teams were at the end of a growth cycle. They were fighting many fires at once: a high number of user complaints, engineers spending a significant amount of their time keeping our machine learning pipelines running, online infrastructure that wasn't supporting their growth, and challenges ramping new models to experi...
Oct 25, 2021•52 min•Season 1Ep. 60
Coffee Sessions #59 with Cody Coleman, Data Quality Over Quantity or Data Selection for Data-Centric AI. // Abstract Big data has been critical to many of the successes in ML, but it brings its own problems. Working with massive datasets is cumbersome and expensive, especially with unstructured data like images, videos, and speech. Careful data selection can mitigate the pains of big data by focusing computational and labeling resources on the most valuable examples. Cody Coleman, a recent Ph.D....
Oct 11, 2021•1 hr 11 min•Season 1Ep. 59
Coffee Sessions #58 with Anne Cocos, 10 Types of Features your Location ML Model is Missing. // Abstract Machine learning on geographic data is relatively under-studied in comparison to ML on other formats like images or graphs. But geographic data is prevalent across a wide variety of domains (although many practitioners may not think of it that way). Clearly, any dataset with `latitude` and `longitude` columns can be viewed as geographic data, but also any dataset with a `zipcode`, `city`, `ad...
Oct 07, 2021•56 min•Season 1Ep. 58
Coffee Sessions #57 with Michael Del Balso and Erik Bernhardsson, The Future of ML and Data Platforms. // Abstract Machine learning, data analytics, and software engineering are converging as data-intensive systems become more ubiquitous. Erik Bernhardsson, ex-CTO at Better and former Spotify machine learning lead, and Mike Del Balso, CEO at Tecton and former Uber machine learning lead and co-creator of Michelangelo sit down to chat with us today. These two jammed with us about building machine ...
Oct 01, 2021•55 min•Season 1Ep. 57
Soumanta wouldn't claim they've reached where they want to and they're still learning, so he's happy sharing successes as well as failures at Yugen.ai. // Abstract Determining Minimum Achievable Goals helps Yugen.ai ensure a significant amount of focus on value-added and impact before diving deep into solutions & building ML Systems. In this episode, Soumanta discusses Balancing ML Development vs Ops and Monitoring efforts while scaling plus their focus on improvements in small sprints. Soum...
Sep 27, 2021•52 min•Season 1Ep. 56
Coffee Sessions #55 with Salwa Muhammad, Learning and Teaching MLOps Applications. //Abstract Salwa shared her perspective on how FourthBrain and all learners can keep their education strategy fresh enough for the current zeitgeist. Furthermore, Salwa, Demetrios, and Vishnu talked about principles of effective learning that are important to keep in mind while embarking on any educational journey. This was a great conversation with a lot of practical tips that we hope you all listen to! // Bio Sa...
Sep 21, 2021•48 min•Season 1Ep. 55
Coffee Sessions #54 with Niall Murphy, Machine Learning SRE. //Abstract SRE is making its way into the machine learning world. Software engineering for machine learning requires reliability, performance, and maintainability. Site reliability engineering is the field that deals with reliability and ensuring constant, real-time performance. Niall Murphy, most recently Global Head of SRE at Microsoft Azure, helps us understand what SRE can do for modern ML products and teams. Building machine learn...
Sep 10, 2021•49 min•Season 1Ep. 54
Coffee Sessions #53 with David Aponte, Demetrios Brinkmann, and Vishnu Rachakonda, MLOps Insights. //Abstract MLOps Insights from MLOps community core organizers Demetrios Brinkmann, Vishnu Rachakonda, and David Aponte. In this conversation the guys do a deep dive on testing with respect to MLOps, talk about what they have learned recently around the ML field, and what new things are happening with the MLOps community. //Bio David Aponte David is one of the organizers of the MLOps Community. He ...
Sep 07, 2021•38 min•Season 1Ep. 53
Coffee Sessions #52 with Dave Bergstein, Vector Similarity Search at Scale. //Abstract Ever wonder how Facebook and Spotify now seem to know you better than your friends? Or why the search feature in some products really “gets” you while in other products it feels stuck in the '90s? The difference is vector search— a method of indexing and searching through large volumes of vector embeddings to find more relevant search results and recommendations. Dave Bergstein, the Director of Product at Pine...
Aug 31, 2021•50 min•Season 1Ep. 52
Coffee Sessions #51 with Sahbi Chaieb, ML security: Why should you care? //Abstract Sahbi, a senior data scientist at SAS, joined us to discuss the various security challenges in MLOps. We went deep into the research he found describing various threats as part of a recent paper he wrote. We also discussed tooling options for this problem that is emerging from companies like Microsoft and Google. // Bio Sahbi Chaieb is a Senior Data Scientist at SAS, he has been working on designing, implementing...
Aug 17, 2021•53 min•Season 1Ep. 51
Coffee Sessions #50 with Alex Chung and Srivathsan Canchi, Creating MLOps Standards. // Abstract With the explosion in tools and opinionated frameworks for machine learning, it's very hard to define standards and best practices for MLOps and ML platforms. Based on their building AWS SageMaker and Intuit's ML Platform respectively, Alex Chung and Srivathsan Canchi talk with Demetrios and Vishnu about their experience navigating "tooling sprawl". They discuss their efforts to solve this problem or...
Aug 12, 2021•48 min•Season 1Ep. 50
Coffee Sessions #49 with Stefan Krawczyk, Aggressively Helpful Platform Teams. //Abstract At Stitch Fix there are 130+ “Full Stack Data Scientists” who in addition to doing data science work, are also expected to engineer and own data pipelines for their production models. One data science team, the Forecasting, Estimation, and Demand team were in a bind. Their data generation process was causing them iteration & operational frustrations in delivering time-series forecasts for the business. ...
Aug 10, 2021•52 min•Season 1Ep. 49
Coffee Sessions #48 with Julien Chaumond, Tour of Upcoming Features on the Hugging Face Model Hub. //Abstract Julien Chaumond’s Tour of Upcoming Features on the Hugging Face Model Hub. Our MLOps community guest in this episode is Julien Chaumond the CTO of Hugging Face - every data scientist’s favorite NLP Swiss army knife. Julien, David, and Demetrios spoke about many topics including: Infra for hosting models/model hubs Inference widgets for companies with CPUs & GPUs (for companies) Auto ...
Jul 27, 2021•52 min•Season 1Ep. 48
Coffee Sessions #47 with Jeremy Howard, fast.ai, AutoML, Software Engineering for ML. //Abstract Advancement in ML Workflows: You've been around the ML world for long enough to have seen how much workflows, tooling, frameworks, etc. have matured and allowed for greater scale and access. We'd love to reflect on your personal journey in this regard and hear about your early experiences putting models into production, as well as how you appreciate/might improve the process now. Data Professional Di...
Jul 15, 2021•58 min•Season 1Ep. 47
Coffee Sessions #46 with Pablo Estevez, What We Learned from 150 Successful ML-enabled Products at Booking.com. //Abstract While most of the Machine Learning literature focuses on the algorithmic or mathematical aspects of the field, not much has been published about how Machine Learning can deliver meaningful impact in an industrial environment where commercial gains are paramount. We conducted an analysis on about 150 successful customer-facing applications of Machine Learning, developed by do...
Jul 13, 2021•57 min•Season 1Ep. 46
MLOps community meetup #70! Last Wednesday, we talked to Monika Venckauskaite, Senior Machine Learning Engineer at Vinted. //Abstract One of the areas, that is the most transformed by ML these years is cybersecurity. Traditionally, SIEM (Security Intelligence and Event Management) is performed by human analysts. However, as the cyber powers and tools of the world are growing, we need more and more of these specialists. The entire area of cybersecurity is experiencing a shortage of talent. This i...
Jul 06, 2021•54 min•Season 1Ep. 70
Coffee Sessions #45 with Diego Oppenheimer of Algorithmia, Enterprise Security and Governance MLOps. //Abstract MLOps in the enterprise is difficult due to security and compliance. In this MLOps Coffee Session, the CEO of Algorithmia, Diego talks to us about how we can better approach MLOps within the enterprise. This is an introduction to essential principles of security in MLOps and why it is crucial to be aware of security best practices as an ML professional. // Bio Diego Oppenheimer is co-f...
Jul 02, 2021•54 min•Season 1Ep. 45
Coffee Sessions #44 with Grant Wright of SEEK Ltd., Autonomy vs. Alignment: Scaling AI Teams to Deliver Value. /Abstract Setting AI teams up for success can be difficult, especially when you’re trying to balance the need to provide teams with autonomy to innovate and solve interesting problems while ensuring they are aligned to the organizations' strategy. Operating models, rituals and processes can really help to set teams up for success; but, there is no right answer, and as you scale and prio...
Jun 30, 2021•51 min•Season 1Ep. 44
In this Machine Learning System Design Review, Shaji Chennan Kunnummel walks us through the system design for Pinterest’s near-real-time architecture for detecting similar images. We discuss their usage of Kafka, Flink, rocksdb, and much more. Starting with the high-level requirements for the system, we discussed Pinterest’s focus on debuggability and an easy transition from their batch processing system to stream processing. We then touch on the different system interfaces and components involv...
Jun 29, 2021•58 min•Season 1Ep. 1
MLOps community meetup #69! Last Wednesday we talked to Emmanuel Raj, Senior Machine Learning Engineer at TietoEvry. //Abstract The talk focuses on simplifying/demystifying MLOps, encourages others to take steps to learn this powerful SE method. We also talked about Emmanuel's journey in ML engineering, the evolution of MLOps, daily life, and SE problems, and what's next in MLOps (fusion of AIOps, EU AI regulations impact on MLOps workflow, etc). //Bio Emmanuel Raj is a Finland-based Senior Mach...
Jun 28, 2021•52 min•Season 1Ep. 69
MLOps community meetup #68! Last Wednesday we talked to Veselina Staneva of TeachableHub, Simarpal Khaira of Intuit, and Korri Jones of Chick-fil-A, Inc. //Abstract Building, Designing, or even just casting the vision for MLOps for your company, whether a large corporation or an agile start-up up, shouldn't be a nigh-impossible task. Complex, but not an impossible mountain to climb. In this meetup, we talked about the steps necessary to unlock the potential of data science for your organization,...
Jun 21, 2021•57 min•Season 1Ep. 68
Coffee Sessions #43 with Kyle Gallatin of Etsy, Maturing Machine Learning in Enterprise. //Abstract The definition of Data Science in production has evolved dramatically in recent years. Despite increasing investments in MLOps, many organizations still struggle to deliver ML quickly and effectively. They often fail to recognize an ML project as a massively cross-functional initiative and confuse deployment with production. Kyle will talk about both the functional and non-functional requirements ...
Jun 15, 2021•47 min•Season 1Ep. 43
MLOps community meetup #66! Last Wednesday we talked to Alfredo Deza, Author and Speaker. //Abstract In this episode, the MLOps community talks about the importance of bringing DevOps principles and discipline into Machine Learning. Alfredo explains insights around creating the MLOps role, automation, constant feedback loops, and the number one objective - to ship Machine Learning models into production. Additionally, we covered some aspects of getting started with Machine Learning that is criti...
Jun 05, 2021•1 hr 2 min•Season 1Ep. 65
MLOps community meetup #65! Last Wednesday we talked to Kseniia Melnikova, Product Owner (Data/AI), SoftwareOne. //Abstract In this MLOps Meetup, we talked about the Machine Learning model lifecycle and development stages and then analyze the main mistakes that everybody does at each stage. Kseniia also provided the audience with solutions to the mistakes and we discussed existing tools for experiment management. //Bio Kseniia is a product owner for Data/AI-based products. Right now, she is work...
Jun 01, 2021•55 min
Coffee Sessions #42 with Amit Paka of Fiddler AI, Model Performance Monitoring. //Abstract Machine Learning accelerates business growth but is prone to performance degradation due to its high reliance on data. Moreover, MLOps is often fragmented in many organizations, causing frictions to debug models in production. With new rules from the EU that focus on trust and transparency, it’s becoming more important to keep track of model performance. But how? We propose a new framework, a centralized M...
Jun 01, 2021•1 hr 7 min•Season 1Ep. 42
Coffee Sessions #41 with Monmayuri Ray of Gitlab, CI/CD in MLOPS. //Abstract We all are familiar with the concept of MVP. In the world of DevOps, one is also familiar with Minimal Viable Feature and further Minimal Viable change. CI/CD is the orchestrator and the underlying base to enable automated experimentation, to start small, and build an idea for production. Now if we use the same fundamentals in MLOps, what does that mean? The podcast will take the audience on a journey in understanding t...
May 27, 2021•51 min•Season 1Ep. 41
MLOps community meetup #64! Last Wednesday we talked to Christopher Bergh, CEO, DataKitchen. //Abstract Working on a shared technically difficult problem there will be some things that are important no matter what industry you are in. Whether it's building cars in a factory, using agile or scrum methodology, or productionizing ML models you need a few basics. Chris gives us some of his best practices in the conversation. //Bio Chris Bergh is the CEO and Head Chef at DataKitchen. Chris has more t...
May 25, 2021•58 min•Season 1Ep. 64
Coffee Sessions #40 with Srivatsan Srinivasan of AIEngineering, Scaling AI in Production. //Abstract //Bio 20+ years of intense passion for building data-driven applications and products for top financial customers. Srivatsan has been a trusted advisor to a senior-level executive from business and technology, helping them with complex transformation in the data and analytics space. Srivatsan also run a YouTube Channel (AIEngineering) where he talks about data, AI and MLOps. //Takeaways Understan...
May 21, 2021•52 min•Season 1Ep. 40
