DoK Talks #101- Redpanda: how to build a storage engine for kubernetes // Alexander Gallego

Data on Kubernetes Community

Nov 12, 2021•1 hr 1 min•Season 1Ep. 101

--:--

Listen in podcast apps:

Apple Podcasts

Spotify

Download

Listen to this episode in Metacast mobile app

Don't just listen to podcasts. Learn from them with transcripts, summaries, and chapters for every episode. Skim, search, and bookmark insights. Learn more

Episode description

https://go.dok.community/slack
https://dok.community/

ABSTRACT OF THE TALK

How to build a stateful, transactional streaming storage engine on top of kubernetes.

KEY TAKE-AWAYS FROM THE TALK

1. Building storage engines in kubernetes is hard
2. You need tiered storage (S3 or google cloud bucket, Azure Blob) for total disaster recovery
3. You also need sound replication inside the cluster
4. You need a simple architecture so you can scale the pods easily

BIO

Alex Gallego is the founder and CEO of Vectorized, where he & the team hack on Redpanda, a modern streaming platform for mission critical workloads. Prior to Vectorized, he was a principal engineer at Akamai, as well as co-founder and CTO of Concord.io, a high performance stream processing engine built in C++ and acquired by Akamai in 2016.

For the best experience, listen in Metacast app for iOS or Android