Highlights from this week’s conversation include: Defining data mesh (6:37) Addressing the scale of organizational complexity and usage (9:04) The shift from monolithic to microservices (12:24) The sociological structure in data mesh (13:59) Data product generation and sharing in data mesh (17:27) Data Mesh: Simplifying Data Work (24:09) Getting Started with Data Mesh (29:14) Building products for Data Mesh (36:42) Building a customizable and extensible platform to shape data practice (39:28) Th...
Dec 13, 2023•57 min•Transcript available on Metacast In this bonus episode, Eric and Kostas preview their upcoming conversation regarding Data Mesh with Paolo Platter, Zhamak Dehghani, and Melissa Logan.
Dec 11, 2023•3 min•Transcript available on Metacast Highlights from this week’s conversation include: Ben’s background in real estate (3:27) Why Fundrise was Started (4:37) Democratizing Investment Opportunities (6:35) Investment Thesis for Venture (11:55) Challenges with Data and Technology (12:34) Importance of Data Model Abstraction (20:03) Data Infrastructure and Investments (23:22) Evolution of Data Engineering (25:12) Closing the Tooling Gap (34:23) The user base segmentation (36:28) The emotional reality of investment decisions (40:50) Dat...
Dec 06, 2023•57 min•Transcript available on Metacast In this bonus episode, Eric and Kostas preview their upcoming conversation with Ben Miller of Fundrise.
Dec 04, 2023•3 min•Transcript available on Metacast Highlights from this week’s conversation include: The concept of composable at a lower level of data infrastructure (1:28) New architectures and components that allow developers to build databases (3:44) Pedro's background and experience in data infrastructure (6:18) The Spectrum of Latency and Analytics (12:59) Different Query Engines for Different Use Cases (16:32) Vectorized vs Code Gen Data Processing (19:33) Vectorization and Code Generation (21:21) Examples of Vectorized Engines (24:33) Re...
Nov 29, 2023•1 hr 12 min•Transcript available on Metacast In this bonus episode, Eric and Kostas preview their upcoming conversation with Pedro Pedreira of Meta.
Nov 27, 2023•6 min•Transcript available on Metacast Highlights from this week’s conversation include: Colin's Background and Starting Omni (1:48) Defining “good” at Google search early in his career (4:42) Looker's Unique Approach to Analytics (9:48) The paradigm shift in analytics (10:52) The architecture of Looker and its influence (12:04) Combatting the challenge of unbundling in the data stack (14:26) The evolution of analytics engineering (21:50) Enhancing user flexibility in Omni (23:44) The evolution of BI tools (32:53) What does the futur...
Nov 22, 2023•54 min•Transcript available on Metacast In this bonus episode, Eric and Kostas preview their upcoming conversation with Colin Zima of Omni.
Nov 20, 2023•2 min•Transcript available on Metacast Highlights from this week’s conversation include: The Unique Perspective of Practitioners (2:10) Account-based Marketing (6:30) Sales Development Representatives (SDR) (8:05) Descriptive, People, and Engagement Data (11:38) Data Overload and Actionable Data (14:20) Working with Data Teams and Internal Data (17:52) The relationship between business and data teams (22:27) The importance of collaboration between marketing and data teams (24:17) Travis and Hillary writing a book (25:33) The taxonomy...
Nov 15, 2023•57 min•Transcript available on Metacast In this bonus episode, Eric and Kostas preview their upcoming conversation with Travis Henry and Hillary Carpio of Snowflake.
Nov 13, 2023•5 min•Transcript available on Metacast Highlights from this week’s conversation include: Johnny and David’s background in working together (1:56) The background story of Estuary (4:15) The challenges of ad tech and the need for low latency (5:44) Use cases for moving data at scale (10:35) Real-time data replication methods (11:54) Challenges with Kafka and the birth of Gazette (13:54) Comparing Kafka and Gazette (20:22) The importance of existing streaming tools (22:28) Challenges of managing Kafka and the need for a different approa...
Nov 08, 2023•1 hr 4 min•Transcript available on Metacast In this bonus episode, Eric and Kostas preview their upcoming conversation with David Yaffe and Johnny Graettinger of Estuary.
Nov 06, 2023•4 min•Transcript available on Metacast Highlights from this week’s conversation include: The potential of AI-driven applications (1:34) The need for hardware infrastructure in AI experimentation (2:40) Oligopoly on the closed side (11:50) Advantages of private side vs. open source (13:18) Leveraging valuable data within enterprises (16:00) The urgency of adopting LLMs in the enterprise (24:02) Expansion of LLMs into new business verticals (25:06) The challenges of operationalizing LLMs (29:32) Seamless experience with OpenAI (37:29) ...
Nov 01, 2023•57 min•Transcript available on Metacast In this bonus episode, Eric and Kostas preview their upcoming conversation with Mark Huang of Gradient.
Oct 30, 2023•4 min•Transcript available on Metacast Highlights from this week’s conversation include: Chang’s background and journey with Pandas (6:26) The persisting challenges in data collection and preparation (10:37) The resistance to change in using Python for data workflows (13:05) AI hype and its impact (14:09) The success and evolution of Pandas as a data framework (20:04) The vision for a next-generation data infrastructure (26:48] LanceDB's file and table format (34:35) Trade-Offs in Lance Format (42:45) Introducing the Vector Database ...
Oct 25, 2023•1 hr 21 min•Transcript available on Metacast In this bonus episode, Eric and Kostas preview their upcoming conversation with Chang She of Eto Labs.
Oct 23, 2023•5 min•Transcript available on Metacast Highlights from this week’s conversation include: Santona’s journey from nuclear physics to data science (4:59) The appeal of startups and wearing multiple hats (8:12) The challenge of pseudoscience in the news (10:24) Approaching data with creativity and rigor (13:22) Challenges and differences in data workflows (14:39) Schema Evolution and Quality Problems (27:01) Real-time Data Monitoring and Anomaly Detection (30:34) The importance of data as a business differentiator (35:48) The SQL job cre...
Oct 18, 2023•1 hr 6 min•Transcript available on Metacast In this bonus episode, Eric and Kostas preview their upcoming conversation with Santona Tuli of Upsolver.
Oct 16, 2023•6 min•Transcript available on Metacast Highlights from this week’s conversation include: How music impacted Bob’s data journey (3:16) Music’s relationship with creativity and innovation (11:38) The genesis of Weaviate and the idea of vector databases (14:09) The joy of creation (19:02) OLAP Databases (22:21) The progression of complexity in databases (24:31) Vector database (29:23) Scaling suboptimal algorithms (34:34) The future of vector space representation (35:51) Databases role in different industries (39:14) The brute force app...
Oct 11, 2023•1 hr 9 min•Transcript available on Metacast In this bonus conversation, Eric and Kostas preview their upcoming conversation with Bob van Luijt of Weaviate.
Oct 09, 2023•5 min•Transcript available on Metacast Highlights from this week’s conversation include: Nick’s background and journey in data (2:28) Founding Dagster Labs (7:50) The evolution of data engineering (12:32) Fragmentation in data infrastructure (15:04) The role of orchestration in data platforms (19:53) The importance of operational tools for data pipelines (25:01) Lessons learned from working with GraphQL (26:19) The role of the orchestrator in data engineering (34:51) The boundaries between data infrastructure and product engineering ...
Oct 04, 2023•1 hr 2 min•Transcript available on Metacast In this bonus episode, Eric and Kostas preview their upcoming conversation with Nick Schrock of Dagster Labs.
Oct 02, 2023•3 min•Transcript available on Metacast Highlights from this week’s conversation include: Amr’s extensive background in data (3:23) The evolution of neural networks (9:21) The role of supervised learning in AI (11:17) Explaining Vectara (13:07) Papers that laid the foundation for AI (15:02) Contextualized translation and personalization (20:07) Ease of use and answer-based search (25:01) AI and potential liabilities (35:54) Minimizing difficulties in large language models (36:43) The process of extracting documents in multidimensional...
Sep 27, 2023•1 hr 4 min•Transcript available on Metacast In this bonus episode, Eric and Kostas preview their upcoming conversation with Amr Awadallah of Vectara.
Sep 25, 2023•5 min•Transcript available on Metacast Highlights from this week’s conversation include: Alex’s background in the data space and the creation of Redpanda (4:23) The cost and complexity of streaming (11:07) The evolution of storage with Kafka (12:04) The distinction between streaming technologies (15:10) Simplicity as a Core Design Principle (27:03) Cost Efficiency in a Cloud Native Era (30:44) Removing complexity with Redpanda (34:21) Migrations and compatibility with Redpanda (40:35) The Future of Redpanda (43:44) The Story Behind R...
Sep 20, 2023•55 min•Transcript available on Metacast In this bonus episode, Eric and Kostas preview their upcoming conversation with Alex Gallego of Redpanda.
Sep 18, 2023•4 min•Transcript available on Metacast Highlights from this week’s conversation include: Emilie’s background and journey in data (3:42) The problem of three-way match (8:56) Operational workflows and how data stacks solve them (13:16) Turbine’s solution as a lightweight ERP (14:05) Workflows and analytics (14:59) Consolidating information into helpful application (27:41) Challenges in operational workflows (32:19) Friction and hurdles in ERP usage (39:28) A solution for purchase order management (40:47) Turbine’s focus and limitation...
Sep 13, 2023•1 hr 1 min•Transcript available on Metacast In this bonus episode, Eric and Kostas preview their upcoming conversation with Emilie Schario of Turbine.
Sep 11, 2023•7 min•Transcript available on Metacast Highlights from this week’s conversation include: Pardis’ background and journey in data (3:24) AI before the hype (8:37) Founding General Folders (12:36) Data collaboration challenges (15:31) Examples of data sharing (17:40) Data transfer in various industries (22:16) Defining the transfer problem (28:30) The demand for scalable solutions (32:06) Data transfer and model exposition (41:02) Data governance and API (43:23) Final thoughts and takeaways (56:48) The Data Stack Show is a weekly podcas...
Sep 06, 2023•1 hr 3 min•Transcript available on Metacast In this bonus episode, Eric and Kostas preview their upcoming conversation with Pardis Noorzad of General Folders.
Sep 04, 2023•6 min•Transcript available on Metacast