Abstract of the talk… Tecton is building a data platform for machine learning. This talk shares some of the adventures and lessons learned while introducing Kafka into our data pipelines. Bio… Engineering Manager @ Tecton. Previously: Staff SWE @ Google working on Search, Platforms, and Photos.
Abstract of the talk… We are going to be looking at and comparing Airflow (the established) versus Argo Workflows (The new kid on the block) and see how they measure up. What you would use each for, why you would want to use one or the other and who would win in a battle for data workflow management supremacy. Bio… DataOps and Data Engineering enthousiast. I get enthousiastic about data and data technologies and mostly about how we can move all that data around and have people smarter than me do...
Abstract of the talk… Kya hota hai Kubernetes? Shuruwat kahan se kare? Community ka hissa kaise bane? Kya aap ke mann mein bhi ye sawaal aate hain? Join kariye hume iss meetup mein jahan hum baat karengey har cheez Data on K8s ke baare mein (Hindi mein)! May 3rd ko hum charcha karengey ki kaise aap community ka hissa ban sakte hain, CNCF kya hai, ek SRE ka kaam kya hota hai, and bahot kuch! But yehi nahi! Bhaag lijiye meetup ke end ki quiz mein jisse aap jeet sakte hain kuch special SWAGS DoK ki...
Abstract of the talk… In the talk, we shall dive deep into the latest open-source tools like Prometheus and Jaeger and our journey in using them and ultimately building our own open-source observability tool, SigNoz. We shall discuss: - What is Observability? The 3 pillars of Observability - Metrics, Traces, and Logs - How is monitoring different than observability? - The hard things about Prometheus? - Why Distributed Tracing became so important? - Running both Prometheus and Jaeger to get metr...
Abstract of the talk… Within its 7 years of existence, Kubernetes has been the gravitational center of the Cloud Native landscape, elevating a pluggable system that contributed to the diversification of the entire ecosystem. Wider adaptability of the tool prompted the diversification of the end-user base, and a consistent DX for cluster interaction became essential for Kubernetes. The community channeled herculean efforts towards the enhancement of the developer experience by extending the clust...
Abstract of the talk… The talk will cover the various aspects of DataOps, why DataOps is important. It will also talk about some of the client experiences and how DataOps strategy is helping addresses some of the challenges. The talk will also cover the DataOps implementations, tools and technologies. Bio… IBM Distinguished Engineer, Master Inventor with 60+ patents, 23 years in IBM. Architect, Developer, Blogger, Author Key take-aways from the talk… Good understanding of DataOps, Why we need Da...
Abstract of the talk… Are you a Cloud Architect, DevOps Engineer or SRE who is developing cloud-native applications, managing complex app migration projects or needs infrastructure resiliency? Cloud-native applications present extraordinary performance, scale and compliance challenges in hybrid- and multi-cloud environments that legacy tools simply cannot support. In this session and demo, we’ll take you thru a case study for a large aerospace and defense company who is managing and migrating Ku...
Abstract of the talk… Measuring costs in Kubernetes environments is complex. Applications and their resources needs are often dynamic. Teams share resources without transparent prices attached to workloads while organizations are increasingly running resources on a range of machine types and even cloud providers. Kubecost provides an approach built on open source for ensuring consistent and accurate visibility across all your workloads. This discussion will talk about practical examples for impl...
Abstract of the talk… Apache Spark natively runs on top of Kubernetes (instead of Hadoop YARN) since 2018, but it's only since Spark 3.1 (released in March 2021) that the integration is now officially generally available & production-ready. What is the high-level architecture of Spark on Kubernetes, how does it compare to alternatives, what does the migration look like? These are some of the questions we will answer together. We will first introduce the core concepts, then go through the sto...
Talk in Portuguese Bio… Capacitando arquitetos, desenvolvedores e SREs em todo o mundo para fornecer aplicativos escaláveis e arquiteturas de sistemas otimizados para os recursos exclusivos da nuvem; E as organizações devem navegar em sua jornada nativa da nuvem. Apaixonado por Arquitetura de Sistemas e Engenharia de Software, me dedico a aprender e compartilhar conhecimentos com foco em Cloud, Java e outras tecnologias emergentes. Fui reconhecido como um embaixador da Cloud Native Computing Fou...
Abstract of the talk… Almost all applications have some kind of state. Some data processing apps and databases have huge amounts of state. How do we navigate a cloud-based world of containers where stateless and functions-as-a-service is all the rage? As a long-time architect, designer, and developer of very stateful apps (databases and data processing apps), I’d like to take you on a journey through the modern cloud world and Kubernetes, offering helpful design patterns, considerations, tips, a...
Abstract of the talk… Chaos Engineering is revolutionizing testing means and doing it the cloud-native way is the best way in today's rapidly changing world with a huge shift in the paradigm of Kubernetes resiliency. Karthik S, one of the maintainers for LitmusChaos would be introducing how to carry out Chaos Engineering, the cloud-native way. Further, he will touch upon how Chaos Engineering is carried out in Cloud-Native Databases with LitmusChaos. He will also touch upon observability conside...
Abstract of the talk… A fireside chat with Jérôme Petazzoni in which we will get to know him up close and personal, ask him about how his personal music projects influence his professional work, and answer questions from the audience. Bio… Jérôme was part of the team that built, scaled, and operated the dotCloud PAAS, before it became Docker. He worked seven years at the famous container company, wearing various hats. When he's not busy with computers, he collects musical instruments. He can arg...
Abstract of the talk… In this talk we will discuss what are the best patterns to create stateful applications on top of Kubernetes. This will include application layer caching, embeddable database as well as leveraging kubernetes objects to store and sync state across multiple replicas. Bio… Prashant is passionate about democratizing best AppOps practices for Kubernetes and has started Devtron and open source platform for AppOps on top of Kubernetes. Recently open sourced Devtron has been instru...
Abstract of the talk… ENG: Cloud&Heat has always focused on providing energy-efficient data centers. In the last 8 years, we have developed an innovative water cooling technology for servers, converting waste heat into a valuable asset. By doing so, we have already greatly improved the energy efficiency of individual data centers. However, this isn’t enough. To globally maximize the efficiency of distributed data center infrastructures, this talk presents Krake. Krake is an orchestration sof...
Abstract of the talk… Global load balancing, commonly referred to as GSLB (Global Server Load Balancing) solutions, have typically been the domain of proprietary network software and hardware vendors and installed and managed by siloed network teams. k8gb is a completely open source, cloud native, global load balancing solution for Kubernetes. k8gb focuses on load balancing traffic across geographically dispersed Kubernetes clusters using multiple load balancing strategies to meet requirements s...
Our learnings from Kubernetes
Abstract of the talk… Hundreds of data teams have migrated to the ELT pattern in recent years, leveraging SaaS tools like Stitch or FiveTran to reliably load data into their infrastructure. These SaaS offerings are outstanding and can accelerate your time to production significantly. However, many teams prefer to roll their own tools. One solution in these cases is to deploy singer.io taps and targets — Python scripts that can perform data replication between arbitrary sources and destinations. ...
Bio… Junior pursuing Computer Science & Engineering. Co-founder at Code for Cause. CNCF Intern 2020. MLH Coach. Google Summer of Code Mentor. YouTuber. Gold Microsoft Learn Student Ambassador.
Abstract of the talk… DevOps is like a camera. We focus on what's important, we capture the good times, we develop from the negatives, and if things don't work out, we take another shot. Many teams establishing working best practices for their tools improve their time to deliver and ability to scale. However, the real challenges exist outside of tools and technology and many teams today still have questions about DevOps. So, join this session to learn the fundamentals of shaping a DevOps culture...
Abstract of the talk… I will talk about my experiences entering the world of databases and data management after a very different life as a diplomat. I will introduce TerminusDB and it's world history origins. Finally I will situate the project and the roadmap from a k8s perspective. Bio… Prior to joining TerminusDB, Luke worked in the Irish Foreign Ministry for a number of years. He was Ireland’s acting Ambassador to Greece. Luke was also the Head of the Government of Ireland’s Brexit Communica...
https://go.dok.community/slack Abstract of the talk… Developers spend a lot of time making their local machine look like a cluster. But why do we do that? Our local machine is not where our code is supposed to run! We built okteto (github.com/okteto/okteto) so we can make our Kubernetes clusters look like our local machine. In this talk, we'll show you how okteto helps you take advantage of all the goodness of Kubernetes and the cloud without having to sacrifice a really fast development and fee...
Abstract of the talk… Open source observability should not be hard. What companies package as their enterprise offering should be available to anyone who wants to monitor their systems. Opstrace is a complete monitoring platform designed for the end user instead of the expert. It's goal is to be as easy to use and operate as a hosted SaaS provider but within ones own cloud account. This is not only up to 10x more cost-efficient but also allows full control over ones data. Bio… Sebastien Pahl is ...
Abstract of the talk… Observability systems are typically a collection of tools that cover the three pillars of logs, metrics and tracing. These enable skilled engineers to correlate telemetry insights to perform data-driven diagnostics and rectify degraded services. In this talk, I discuss how over the course of three years, I have worked towards removing the built-in gatekeeping that comes with creating monitoring solutions and enabling them to work for an entire organisation. We shine a light...
Abstract of the talk… Buy a ready off-the-shelf product, customize an existing open source project, or build your own distribution? When you can't go to the cloud and leverage its powerful features you have to make a choice. On-prem environments need more attention, but they also often can be more cost-effective and are highly coveted by the development and operations teams. In this talk, I will cover some of the most important topics related to building an on-prem Kubernetes platform and I will...
Abstract of the talk… Going from raw data to machine learning models successfully in companies of all sizes requires more than just an understanding of programming. Teams need to manage their data products lifecycle, their software as well as the data. Data products like machine learning models aren’t created out of thin air. They are built on layers of best practices that ensure the models are using accurate data, they are outputting reliable numbers and they have some method to interact with t...
Abstract of the talk… Uma conversa descontraída sobre o futuro de bases de dados como um serviço. Dados em Kubernetes desde o ponto de vista dum DBA. E várias outros assuntos parecidos. Bio… DBA e Profissional de TI com mais de 15 anos trabalhando com sistemas, integrações e bancos de dados. Arquiteto de soluções certificado pela AWS, um profissional certificado pelo banco de dados MariaDB, um especialista certificado pela Red Hat em Ansible Automation, um arquiteto certificado pela Splunk e um ...
Abstract of the talk… Kubernetes is powerful but can be complex to manage! In this talk, Jim Bugwadia from Nirmata will show how policy managers can help address the complexity via admission controls and dynamic configurations. Jim will introduce Kyverno, a Kubernetes native policy engine and CNCF sandbox project. Jim will then demonstrate how you can use Kyverno to ensure security and best practice compliance for your clusters. Bio… Software engineer with background in distributed systems and s...
https://go.dok.community/slack Abstract of the talk… This talk will walk through how to get started contributing to Kubernetes, combatting imposter syndrome, the many other ways you can get started contributing to K8s other than by writing code, and the benefits to joining a community such as K8s. Bio… Rin is a Technical Community Builder at Camunda. They enjoy discussing all things open source, with a particular focus on diversity in tech, improving hiring pipelines in OSS for those that are ne...
Abstract of the talk… For IT decision-makers, this goes above and beyond just keeping infrastructure running and efficient; it is about understanding how your IT budget affects your business, and how well your resources maximize the use of your budget. This makes it critically important that IT teams can more quickly and easily see the totality of their IT costs across the hybrid cloud. We’re pleased to introduce a new software-as-a-service (SaaS) offering intended to help our customers better u...
