The Data Stack Show - podcast cover

The Data Stack Show

Rudderstack•datastackshow.com
Technology
Business
Management
Education
How To
Each week we’ll talk to data engineers, analysts, and data scientists about their experience around building and maintaining data infrastructure, delivering data and data products, and driving better outcomes across their businesses with data.
Follow on
Metacast
Apple Podcasts
Spotify
Youtube
RSS

Episodes

146: What Is a Customer Data Platform? Featuring Soumyadeb Mitra of Rudderstack

Highlights from this week’s conversation include: Soumyadeb’s background and journey in data (5:49) Defining customer data (8:10) The complexity of customer data collection (10:04) What is a CDP and how it is properly deployed (17:12) Bridging the gap of data collection and useful analytics for marketing (21:46) How Rudderstack translates data and the new profile feature (25:30) The foundations of data in building a 360 degree customer profile (30:30) Solutions for the intersection between engin...

Jul 12, 2023•52 min

The PRQL: Synthetic Data and Self Driving Cars with Omar Maher of Parallel Domain

The Data Stack Show is a weekly podcast powered by RudderStack, the CDP for developers. Each week we’ll talk to data engineers, analysts, and data scientists about their experience around building and maintaining data infrastructure, delivering data and data products, and driving better outcomes across their businesses with data. RudderStack helps businesses make the most out of their customer data while ensuring data privacy and security. To learn more about RudderStack visit rudderstack.com....

Jul 03, 2023•6 min

144: Explaining Features, Embeddings, and the Difference Between ML and AI with Simba Khadder of Featureform

Highlights from this week’s conversation include: Simba’s background in the data space (3:05) Subscription intelligence (6:41) ML and Distributed Systems (9:09) The Brutal Subscription Industry (12:31) Serendipity in Recommender Systems (16:31) Subscription as a Strategy (20:47) Customizing Content for Subscribers (22:19) Creating User Embeddings (25:53) Building Featureform (28:01) Embedding Projections (32:47) Spaces and similarity (35:53) User embeddings and transformer models (38:22) Vector ...

Jun 28, 2023•1 hr 12 min

Shop Talk: Accountability and Opportunity for AI

The Data Stack Show is a weekly podcast powered by RudderStack, the CDP for developers. Each week we’ll talk to data engineers, analysts, and data scientists about their experience around building and maintaining data infrastructure, delivering data and data products, and driving better outcomes across their businesses with data. RudderStack helps businesses make the most out of their customer data while ensuring data privacy and security. To learn more about RudderStack visit rudderstack.com ....

Jun 23, 2023•20 min

143: Collaborative Data Analytics on the Data Warehouse, featuring Rob Woollen & Stipo Josipovic of Sigma

Highlights from this week’s conversation include: Stipo and Rob’s background in data (2:43) What is Sigma? (7:46) Takeaways from building analytics products in-house (9:16) Sigma’s approach to datastore interface (11:32) Why analytics and BI are still not a solved problem (15:50) Combining SQL and spreadsheets for useful interface (23:17) The evolution of BI to today (29:40) Overcoming the challenges of collaboration in working with data (33:17) Creating operational coding that humans can unders...

Jun 21, 2023•1 hr 15 min

Shop Talk: Why AI Is Not Another Crypto

The Data Stack Show is a weekly podcast powered by RudderStack, the CDP for developers. Each week we’ll talk to data engineers, analysts, and data scientists about their experience around building and maintaining data infrastructure, delivering data and data products, and driving better outcomes across their businesses with data. RudderStack helps businesses make the most out of their customer data while ensuring data privacy and security. To learn more about RudderStack visit rudderstack.com ....

Jun 16, 2023•24 min

142: Martech’s Separation and Return to Data Infrastructure with Scott Brinker of HubSpot

Highlights from this week’s conversation include: Scott’s background in martech (3:10) Where things have gone wrong between IT and marketing (5:46) The explosion of digital marketing data (12:04) Costs of having data siloed (16:14) The convergence of marketing and IT teams around data (19:27) Navigating the massive landscape of martech tools (26:10) Needed tools in the martech stack (31:11) The importance of an accurate attribution model (34:37) Building tooling for marketers and developers to u...

Jun 14, 2023•57 min

141: A Journey From Backend Engineer to Data Engineer with Ioannis Foukarakis of Mattermost

Highlights from this week’s conversation include: Ioannis’ background and journey in data (2:42) Rudderstack’s transformations feature and examples of its application (4:20) Winning the transformations contest at Rudderstack (7:21) How Ioannis’ transformation project works for data governance (9:40) Memories from college for Ioannis and Kostas (12:30) Getting into the world of software development (17:27) The changes in data and engineering over the years (20:29) Bridging java with python (23:15...

Jun 07, 2023•58 min

140: Stream Processing for Machine Learning with Davor Bonaci of DataStax

Highlights from this week’s conversation include: Davor’s journey from Google and what he was building there (3:32) How work in stream processing changed Davor’s journey (5:10) Analytical predictive models and infrastructure (9:39) How Kaskada serves as a recommendation engine with data (14:05) Kaskada’s user experience as an event processing platform (20:06) Enhancing typical feature store architecture to achieve better results (23:34) What is needed to improve stream and batch processes (27:39...

May 31, 2023•1 hr 2 min

139: Decoupling the Execution Engine From Python’s Pandas with Aditya Parameswaran of Ponder

Highlights from this week’s conversation include: Aditya’s background and journey in the data space (2:47) What does Ponder do? (5:18) 101 on Pandas and why people utilize it (6:42) The challenge of translating Pandas to a big data platform (16:11) Data Warehouses and ML workflows (21:27) The differences in the “zoo” of data languages (26:56) Why do ML and data engineering have to be so different in languages? (34:39) Builders should be adapting to the users and not the other way around (39:32) ...

May 24, 2023•58 min

138: Paradigm Shift: Batch to Data Streaming with A.J. Hunyady of InfinyOn

Highlights from this week’s conversation include: A.J.’s background and journey in data (2:23) Challenges with Hadoop ecosystem (8:50) Starting InfinyOn and the need for innovation (10:02) Challenges with Kafka and Microservices (14:01) Real-time data streaming for IoT devices (19:28) Paradigm shift to real-time data processing (22:17) Benefits of Rust (29:45) Web Assembly and Platform Features (36:29) Analytics and Event Correlation (40:16) Real-time data processing (47:03) ETL vs ELP (52:20) F...

May 17, 2023•1 hr 2 min

137: Data Collection Secrets & The Search Data Problem with Josh Wills

Highlights from this week’s conversation include: Josh’s background in data working at Google, Slack, and other companies (1:21) The need and process for high quality data (4:33) Digging into auction code (14:03) Joining Slack and working in the early days of the company (18:00) Not fighting the last war in data (25:42) Building a product, while using the product (30:35) Transitioning to the search team at Slack (36:50) Usage patterns of search (41:21) Josh’s work in helping build DuckDB (46:20)...

May 10, 2023•59 min

136: System Evolution from Hadoop to RocksDB with Dhruba Borthakur of Rockset

Highlights from this week’s conversation include: Dhruba’s journey into the data space (2:02) The impact of Hadoop on the industry (3:37) Dhruba’s work in the early days of the Facebook team (7:54) Building and implementing RocksDB (14:33) Stories with Mark Zuckerberg at Facebook (24:25) The next evolution in storage hardware (26:14) How Rockset is different from other real-time platforms (33:13) Going from a key value store to an index (37:15) Where does Rockset go from here? (44:59) The succes...

May 03, 2023•1 hr

Data Council Week (Ep 7) - What’s Next for Data Council? With Pete Soderling of Data Council

Highlights from this week’s conversation include: The origin story of Data Council (0:39) Developments for the future of Data Council (2:42) The emphasis of AI and ChatGPT at this year’s conference (3:54) The support of the data community (5:31) Biggest changes and innovations in the industry (7:10) What’s next for the Data Council? (10:46) Getting connected with Data Council (13:07) The Data Stack Show is a weekly podcast powered by RudderStack, the CDP for developers. Each week we’ll talk to d...

Apr 28, 2023•15 min

Data Council Week (Ep 6) - All About Debezium and Change Data Capture With Gunnar Morling of Decodable

Highlights from this week’s conversation include: Gunner’s background in data (0:32) Setting the vision in early days of Red Hat and spearheading Debezium (6:20) Replication of data in Debezium (9:47) The patterns and processes of Debezium (16:21) Debezium working with Kafka (19:03) Building a diverse system while incorporating common interfaces (24:09) The importance of documentation in open-sourced projects (27:59) Debezium’s vision moving forward (31:32) Why aren’t there more CDC open-sourced...

Apr 27, 2023•40 min

Data Council Week (Ep 5) - The Difference Between Data Platforms and ML Platforms with Michael Del Balso of Tecton

Highlights from this week’s conversation include: Michael’s journey to co-founding Tecton (0:22) The evolution of MLops and platform teams (3:50) Understanding boundaries between the data platform and the MLops (8:42) Differences in machine learning vs data pipelines (16:58) The systems needed to handle all these types of data (22:22) Developer experience in Tecton (25:15) Automating challenges in ML development (32:30) The most difficult part of the life cycle of prediction (37:24) Exciting new...

Apr 26, 2023•43 min

Data Council Week (Ep 4) - Using Data Anonymization for Identity Protection With Will Thompson of Privacy Dynamics

Highlights from this week’s conversation include: Will’s background in data (0:28) Privacy dynamics and data anonymization (4:18) Addressing data privacy problems in the space (10:33) Developer experience with Privacy Dynamics (13:49) How does Privacy Dynamics work? (21:09) Update of real-time anonymized data (26:29) The problem of dates and other complexities in data (31:24) Being a data engineer in a startup (34:44) Moving at the speed of a startup (41:01) Connecting with Will and Privacy Dyna...

Apr 26, 2023•46 min

Data Council Week (Ep 3) - GTM 101 for Engineers With Chase Roberts of Vertex Ventures

Highlights from this week’s conversation include: Chase’s journey to where he is today (0:51) Lessons in go-to-market roles which helps in the VC world (2:38) Differentiating between go-to-market and distribution (8:13) Taking an idea to the market (11:33) Hardest part of the pitch (17:08) Playbooks for go-to-market founders to follow (20:25) Focus of sales and marketing in go-to-market strategy (28:01) Answering the what and how of the problem you are solving (32:30) The importance of pricing i...

Apr 25, 2023•1 hr 2 min