Highlights from this week’s conversation include: Starburst Data is Justin’s second startup (2:42) Starburst focuses on doing data warehousing analytics without the need for the data warehouse (4:14) Multi-cloud solutions among merger and acquisition use cases (8:32) Ways the stack is increasing in complexity (12:25) Comparing essential components of a data stack from 2010 to now (15:01) The future of ETL (27:36) The best maturity stage for an organization to implement Starburst (31:27) Starburs...
Oct 27, 2021•58 min•Transcript available on Metacast On this week's Data Debrief, Eric and Kostas dig more into the topic of data tooling.
Oct 22, 2021•8 min•Transcript available on Metacast Highlights from this week’s conversation include: Solving problems with data has been a long-time passion of Scott’s (2:52) Day-to-day use of data at InterSystems (6:25) The technical aspects involved in constructing a data fabric (17:52) Companies at a variety of maturity levels can adopt a data fabric (26:49) A paradigm shift in the marketplace (28:39) Comparing and contrasting data fabric and data mesh (30:49) Sharing data across the business and not having it siloed in different departments ...
Oct 20, 2021•50 min•Transcript available on Metacast On this Data Debrief, Eric and Kostas are joined by Brian from Rudderstack to talk about Data Quality.
Oct 15, 2021•7 min•Transcript available on Metacast Highlights from this week’s conversation include: Egor’s software engineering background and history with Uber (2:19) Experimentation platforms and analytics definitions (7:49) Bigeye’s function and use cases (9:40) Managing the relationship between the data engineer maintaining the pipelines and the downstream teams providing the context (18:49) Pinpointing problems in data compared to problems in software (21:55) Defining data quality at Bigeye (24:13) Machine learning models as a data product...
Oct 13, 2021•56 min•Transcript available on Metacast Highlights from this week’s conversation include: Jeff’s history with stream processing (2:52) Working with Mantis to address the impact of Netflix downtime (4:20) Defining observability as operational insight (6:58) Time series data and the value of data today (18:52) Data integration’s shift from batch to streaming (29:34) The current state of change data capture (32:20) How an engineer thinks of the end-user (56:21) The Data Stack Show is a weekly podcast powered by RudderStack, the CDP for d...
Oct 06, 2021•1 hr 4 min•Transcript available on Metacast Highlights from this week’s conversation include: Pete’s background in data engineering and capital market trading (2:10) Comparison of the tooling from 2012 when Deephaven started with that of today (10:30) Taking a closer look at defining real-time data (19:47) Getting non-technical people, clients, and developers all on the same platform (36:11) Deephaven’s incremental update model (40:25) Kafka, timely data flow, and Deephaven (44:22) Use cases for Deephaven (51:52) Going to GitHub to try ou...
Sep 29, 2021•1 hr 7 min•Transcript available on Metacast Highlights from this week’s conversation include: Neil’s programming hobby turned into a career and how he cold-contacted Mixpanel for a job (2:28) Lessons learned from nine years at Mixpanel (5:05) Defining product analytics (8:06) How Mixpanel has evolved into the product it is today (10:56) The importance of Mixpanel’s real-time analysis (19:52) Looking at Arb, Mixpanel’s own arbitrary segmentation database (23:44) The business impact that the rise of the cloud data warehouse had on Mixpanel ...
Sep 22, 2021•1 hr 9 min•Transcript available on Metacast Highlights from this week’s conversation include: Bart’s journey from southern California, to New York, to Egypt, to London, to Spain (3:31) Exposure to different communities and finding shared language and experience (10:21) Looking back at early online communities and how they furthered your learning journey (27:50) How the level of niche-ness impacts a community (44:06) The cautionary tale of WeWork (57:28) Surefire community killers (1:03:44) Open source communities in tech and the passion t...
Sep 15, 2021•1 hr 20 min•Transcript available on Metacast Highlights from this week’s conversation include: James’ background at Microsoft and current work with EY’s data fabric (2:22) The external and internal facing components of EY’s data fabric (6:39) The importance of the data lineage (11:29) The most important requirements for data quality (15:32) Looking at the data capabilities of Microsoft (21:30) The data warehouse, explained (29:00) Using a data warehouse or a data lake (34:33) Defining the buzzword data mesh (51:13) The problem with data me...
Sep 08, 2021•1 hr 9 min•Transcript available on Metacast Topics in this wide-ranging conversation include: Tristan’s background with Cloudera and the need for continual operational ML and AI (3:15) How the complexity of Continual is hidden behind a simplicity of use (14:48) Focusing on data that lives within a data warehouse (18:43) Understanding features in the ML conversation (22:47) The three layers of Continual (26:11) The importance of SQL to Continual (30:19) Caching layers and the data warehouse centric approach (38:28) Betting on the warehouse...
Sep 01, 2021•55 min•Transcript available on Metacast Highlights from this week’s episode: Ananth’s background (2:51) The evolution of Slack (4:54) Kafka and Presto’s two of the most reliable and flexible tools for Ananth (9:43) How Snowflake gained an advantage over Presto (13:24) Opinions about data lakes (17:23) Core features of data infrastructure (23:22) The tools define the process, and not the other way around (31:30) Defining a data mesh (36:44) Data is inherently social in nature (40:31) Lessons learned from writing Data Engineering Weekly...
Aug 25, 2021•59 min•Transcript available on Metacast Topics in this conversation include: Ben's background and his shift to data engineering (2:19) Trends in the data space: finding the most efficient tools, the Snowflake phenomenon, and keeping up with new functionalities (5:33) Key differences in data practices in small companies and Facebook-sized companies (12:38) Having to build tools specifically designed for Facebook because of SaaS product limitations (16:00) Team structure at Facebook (18:17) Developing more robust systems that are resist...
Aug 18, 2021•55 min•Transcript available on Metacast Highlights from this week’s episode: Dissecting the different team structures from organizations in season two (1:16) The people behind the data are key to the data itself (9:17) Open source licensing and the core components needed for large scale commercial viability (15:13) Game-changing core technologies in the new data economy (22:09) Snowflake vs. Databricks battle. "The UFC of Geeks" (25:54) The Data Stack Show is a weekly podcast powered by RudderStack, the CDP for developers. Each week w...
Aug 11, 2021•33 min•Transcript available on Metacast Highlights from this week’s episode include: Sven's Ph.D. in Singularity Theory (2:59) The Databricks vs. Snowflake conversation (8:17) The difficulty of not just inventing something new, but making it accessible (18:01) Databricks and unstructured data (22:22) Organizational change responding to technological change (29:27) The three-dimensional evolution of a successful open source project (40:31) The Data Stack Show is a weekly podcast powered by RudderStack, the CDP for developers. Each week...
Aug 04, 2021•51 min•Transcript available on Metacast Highlights from this week’s episode include: Introducing Arjun and how he fell in love with databases (2:51) Looking at what Materialize brings to the stack (5:28) Analytics starts with a human in the loop and comes into its own when analysts get themselves out and automate it (15:46) Using Materialize instead of the materialized view from another tool (18:44) Comparing Postgres and Materialize and looking at what's under the hood of Materialize (23:16) Making Materialize simple to use (32:33) W...
Jul 28, 2021•56 min•Transcript available on Metacast Highlights from today's conversation include: Ophir's decision to switch from software engineering to marketing and riding the startup train (2:39) Open sourcing in the world of software (5:55) How open source has changed Ophir's life as a marketeer working at startups (10:28) Chartio's sunsetting drove Ophir to search for a data tooling replacement (27:27) Discussing trends in adoption of tools for small scale and large scale companies (35:01) Data challenges related to attribution--how wrong d...
Jul 21, 2021•56 min•Transcript available on Metacast Highlights from this week's episode: Ruben's background (2:36) Massive shifts in data caused by COVID (4:47) Big Tech is no longer untouchable (9:54) Accelerations in the BI space (15:17) A focus on people and on trust (23:43) Numbers are filtered by the biases of the people viewing them (28:46) AI trends and adoption (38:06) Using qualitative data for insights, particularly at early stages (40:56) Recommendations for taking stock of who is using the data and assessing what their skills are (50:...
Jul 14, 2021•58 min•Transcript available on Metacast Highlights from this week's episode: Sokratis' realization that big corporations were not the best thing for him (2:56) Transitioning for Workable to Clerk.dev (3:40) Convincing developers to outsource components to a service (9:36) Clerk's layered solutions and how it affects the developer and the end-user (12:41) Starting with Clerk from scratch vs. using Clerk to replace an existing component (19:55) Synergies and SaaS starter kit (24:06) Building Clerk to avoid a single point of failure (29:...
Jul 07, 2021•46 min•Transcript available on Metacast Highlights from this week’s episode include: Ryan's full circle path from stocking shelves at Target to using data science for a company owned by Target (2:00) Building great tools and wielding them effectively (5:04) Changes at Shipt since being acquired (9:29) How people’s bias impacts models built by data scientists (12:30) The different data sources Shipt incorporates (22:02) How Ryan's work as a data scientist has changed as Shipt has grown (25:29) How data science helps marketing (31:38) I...
Jun 30, 2021•53 min•Transcript available on Metacast Highlights from this week’s episode: Joshua started his first company at age 15 and then sold two more startups after that (2:15) Embracing the open source movement and not reinventing the wheel if you don't have to (12:15) Pulsar seemed built to address Kafka's weaknesses (17:23) Using Redis as a coordinator for federated learning and taking advantage of its portability (23:05) The pillars of Pandio and some practical use cases (31:24) Feature stores and model versioning (38:23) Seeing Pulsar a...
Jun 23, 2021•50 min•Transcript available on Metacast Highlights from this week’s episode include: Launching Affinio and the engineering backgrounds of the co-founders (2:36) The massive transformation in customer data privacy regulation in the past eight years (6:23) Creating the underpinning technology that can apply to any customer behavioral data set (10:05) Ranking and scoring surfing patterns and sorting nodes and edges (14:13) Placing the importance of attributes into a simple UI experience (19:28) Going from a columnar database to a graph p...
Jun 16, 2021•58 min•Transcript available on Metacast Highlights from this week’s episode include: Meroxa is a real-time data engineering managed platform (4:53) Use cases for CDC (6:20) Meroxa leverages open source tools to provide initial snapshots and start the CDC stream (12:29) Making the platform publicly available (14:14) What the Meroxa user experience looks like (16:10) Raising Series A funding (17:49) Easiest and most difficult data sources for CDC (20:23) The current state of open CDC (23:16) Expected latency when using CDC (29:56 CDC, r...
Jun 11, 2021•50 min•Transcript available on Metacast Highlights from this week's episode include: David’s background in comparative databases (1:50) David’s experience and lessons he learned from writing his book (3:23) How writing a technical book compares to writing technical documentation (4:41) The process of writing a book (6:30) The best and worst part of David’s book writing experience (8:02) An introduction to what Neo4j is (9:08) What you need to graph (11:13) Typical problems a graph database is a good solution for (13:00) The difference...
Jun 02, 2021•51 min•Transcript available on Metacast Highlights from this week's episode include: Dave's "nerdy" interests in sports statistics and data (2:12) Trends in collecting, processing, and using data (4:45) Finding a better term for "reverse ETL" (5:48) The blurring of the distinction between sources and destinations (7:41) The role of BI is changing (13:24) Data governance and the physical execution behind it (19:00) Data governance is defining and managing data in a logical way that is actionable by the business (23:43) Consolidation of...
May 26, 2021•54 min•Transcript available on Metacast On this week's episode of The Data Stack Show, Eric and Kostas talk with Nick Fogle, co-founder of Churnkey and Wavve. Together they discuss how having a legal background can impact engineering decisions, dealing with privacy and compliance concerns, and selling Wavve and starting Churnkey as a result. Highlights from this week's episode include: Nick's background in economics and law and teaching himself to code (2:01) Thinking like a lawyer and trying to minimize risk to the greatest extent po...
May 19, 2021•43 min•Transcript available on Metacast This week on The Data Stack Show, Eric and Kostas talk with Jim Walker, the VP of product marketing at Cockroach Labs, about distributed systems, competing against the speed of light, and making data easy. Highlights from this week's episode include: Jim background of translating deep technical concepts into understandable English and his work at Cockroach Labs (2:23) The origin of Cockroach Labs and distributed SQL (6:10) Living without Atomic Clocks (10:10) Having the speed of light as the ult...
May 12, 2021•54 min•Transcript available on Metacast On this week's episode of The Data Stack Show, Eric and Kostas talk with John Marbach, senior growth manager at Grafana Labs. In this conversation, John discusses marketing ops and the blending of roles of data engineering and marketing. Highlights from this week's episode include: Grafana Labs John Marbach Senior Growth Manager Introduction to John Marbach and working in the blurred lines between marketing and data engineering (2:14) How managing pipeline building and consuming data influences ...
Apr 28, 2021•49 min•Transcript available on Metacast On this week's episode of The Data Stack Show, Eric and Kostas talk with Peter Gao, co-founder, and CEO at Aquarium Learning. A former engineer at Cruise Automation, Peter and Aquarium Learning help ML teams improve their model performances by improving their data. Highlights from this week's episode include: How getting hit by a drunk driver made researching self-driving cars personal for Peter (2:12) Filtering out the hype in self-driving car news to get a clear picture of its state today (6:5...
Apr 14, 2021•57 min•Transcript available on Metacast On this week's episode of The Data Stack Show, Eric and Kostas talk with Chris Bergh, the CEO and head chef at Data Kitchen. DataKitchen’s mission is to provide the software, service, and knowledge that makes it possible for every data and analytics team to realize their full potential with DataOps. Highlights from this week's episode include: Chris' background and how the lessons learned in the Peace Corps and at NASA apply to him today (2:03) Why AI left Chris feeling like a jilted lover (7:49...
Apr 07, 2021•59 min•Transcript available on Metacast 
