Plumbers of Data Science - podcast cover

Plumbers of Data Science

Andreas Kretzlearndataengineering.com
Data Engineering is the plumbing of data science. Almost invisible, but super important and a big mess when done wrong. We talk about interesting Data Engineering trends and topics. I also train Data Engineering in my Data Engineering Academy at LearnDataEngineering.com
Last refreshed:
Follow this podcast in the Metacast mobile app to refresh it and see new episodes.
Download Metacast podcast app
Podcasts are better in Metacast mobile app
Don't just listen to podcasts. Learn from them with transcripts, summaries, and chapters for every episode. Skim, search, and bookmark insights. Learn more

Episodes

#032 How to Design Security Zones and Lambda Architecture

Security is everything! That's why today, I took some time to give you some tips about how to make a good design. The Lambda Architecture with stream and batch processing is one of the cornerstones for Big Data and Data Science. How does that fit into a security zone design? Check out this episode :)

Aug 30, 201818 minSeason 2Ep. 4

#031 IT Networking Infrastructure and Linux

The understanding of how information is transported over the network is super important. OS wise you will mostly encounter Linux so here are some important Linux basics you need to know. Firewalls, Ports, IP-Adresses, Routers and Switches, only a few things I talk about in this podcast. Networking infrastructure also matters for Big Data systems like Hadoop, Kafka and Spark.

Aug 29, 201832 minSeason 2Ep. 3

#030 Why the hardware and the GPU is super important

Knowing the hardware is super important for a data engineer. Even if you are using cloud servers. CPU, RAM, GPU, HDD, SSD... Especially the GPU is a great help to Data Scientists who are doing machine learning.

Aug 28, 201820 minSeason 2Ep. 2

#029 A New Mission

I am bringing the Podcast back! Lets call it season 2. New name, new mission: Helping you become a data engineer. Daily podcast, recorded in my car or my office, getting you up to speed ASAP.

Aug 27, 20185 minSeason 2Ep. 1

4 Vs Of Big Data Are Enough!

8 V's, 10 V's, 12 V's . The best way to explain Big Data is to use the four V's: Volume, Velocity, Variety and Veracity. In this podcast episode I talk about why nobody needs 10 or more V's of big data. And how Big Data is almost a must have, to do data science and especially machine learning. The music in this episode is the song The Quiet Earth by Thomas Barrandon. Check out his awesome music on Bandcamp. He is also on Spotify ;) Have fun!

May 23, 201811 minSeason 1Ep. 29

Why Companies Badly Need Data Scientists And Engineers

In this episode I give you my take on why companies badly need data scientists and engineers. Because in this data driven world, you can accomplish a lot with just a few people. All you need is a vision, some sense for business and a lot of skill.

May 18, 20183 minSeason 1Ep. 28

What You Need To Know About Data Engineering

This podcast is all about what you as a data engineer really do. From building platforms to collaboration with data scientists and customers. Everything you need to know to get insight into a data engineers life.

May 16, 201816 minSeason 1Ep. 27

I'm a Big Data Engineer and it's Super Awesome!

There is this other data science job called data engineer and it's super important. Because data science does not equal data scientist. In today's podcast I talk about how I finally realized that data engineering is my real passion. Definitely check it out, chances are high that data engineering is your thing too.

May 15, 20187 minSeason 1Ep. 26

BI vs Data Science vs Big Data

I have recently been asked: "What is the difference between BI, Data Science and Big Data". So, it thought I make a quick podcast about this for you guys. I think especially beginners will help this a lot.

Apr 04, 20188 minSeason 1Ep. 25

Three Methods of Streaming Data

There are three different methods of streamging: At least once, at most once and exactly once. Listen why it makes a huge difference which one you use. Because not every system or tool supports all three.

Mar 09, 20183 minSeason 1Ep. 20

Dirty Data, Unicorn Scientists

Where to get dirty data to train cleaning it? What are unicorn data scientists and what is THE skill you need if you aren't one.

Feb 26, 20185 minSeason 1Ep. 10

NoSQL Vs SQL How To Choose

NoSQL databases like HBase are awesome! But why and when should you use them? How does a key value store like HBase work? Today I am talking about exactly that

Feb 09, 20189 minSeason 1Ep. 18

Creating A Gaming-AI-Bot

Creating a Gaming-AI with Reinforcement Learning • Creating a Gaming-AI with Reinforcement Learning

Feb 05, 20187 minSeason 1Ep. 17

Loosing $$ With Data Science

Loosing money with data science in the short term does not matter. It's about the long run, not quick sales. This is a story about how this happened in the insurance industry. And how to go at it to turn this loss into a win

Jan 31, 20186 minSeason 1Ep. 16

Gartner's Hype Cycle Explained

It is very important for me to keep track of emerging technologies and trends. You want to know where the industry is headed. You don't want to miss the next big thing. This is where Gartner's Hype Cycles help a lot. Especially the hype cycle for emerging tech.

Jan 15, 20187 minSeason 1Ep. 13

How to Show That ML and AI Works

How to convince people that machine learning actually works? It's simpler than you think. You have the data. Data doesn't lie!

Jan 12, 20184 minSeason 1Ep. 12

Analytics on Edge Devices

Unavailable cellphone coverage really pissed me off. You cannot transmit data and do cloud based analytics during that time. That is why edge devices in the field have to get more and more get analytics capabilities built in. For instance in a container ship.

Jan 11, 20187 minSeason 1Ep. 11

BigData and Catastrophic Success

In this episode I talk about the 4 Vs of big data. And how Big Data can save you from catastrophic success.

Jan 08, 20188 minSeason 1Ep. 9

Machine Learning In Production

Doing machine learning in production is very different then for proof of concepts or in education. One of the hardest parts is keeping models updated.

Jan 06, 20183 minSeason 1Ep. 8

Data Science VS Big Data

Choose between Big Data & Data Science • Choose between Big Data & Data Science • Choose between Big Data & Data Science

Jan 03, 201812 minSeason 1Ep. 7

Agriculture snd DS DailyKayy 004

How Data Science Transforms Agriculture | DailyKayy 004 • How Data Science Transforms Agriculture | DailyKayy 004 • How Data Science Transforms Agriculture | DailyKayy 004

Jan 03, 201812 minSeason 1Ep. 6

DS Preventing Insurance Fraud

Insurance companies use data science to detect fraudulent cases. Saving themselves and the customers money

Dec 15, 20175 minSeason 1Ep. 5

How Data Transforms Healthcare

How Smartwatches and Fitbits Transform Healthcare • How Smartwatches and Fitbits Transform Healthcare

Dec 12, 20179 minSeason 1Ep. 4
For the best experience, listen in Metacast app for iOS or Android