Streaming Audio: Apache Kafka® & Real-Time Data

Resilient Edge Infrastructure for IoT Using Apache Kafka ft. Kai Waehner


Listen Later

What is the internet of things (IoT), and how does it relate to event streaming and Apache Kafka®? The deployment of Kafka outside the datacenter creates many new possibilities for processing data in motion and building new business cases.

In this episode, Kai Waehner, field CTO and global technology advisor at Confluent, discusses the intersection of edge data infrastructure, IoT, and cloud services for Kafka. He also details how businesses get into the sticky situation of not accounting for solutions when data is running dangerously close to the edge. Air-gapped environments and strong security requirements are the norm in many edge deployments.

Defining the edge for your industry depends on what sector you’re in plus the amount of data and interaction involved with your customers. The edge could lie on various points of the spectrum and carry various meanings to various people. Before you can deploy Kafka to the edge, you must first define where that edge is as it relates to your connectivity needs. 

Edge resiliency enables your enterprise to not only control your datacenter with ease but also preserve the data without privacy risks or data leaks. If a business does not have the personnel to handle these big IT jobs on their own or an organization simply does not have an IT department at all, this is where Kafka solutions can come in to fill the gap. 

This podcast explores use cases and architectures at the edge (i.e., outside the datacenter) across industries, including manufacturing, energy, retail, restaurants, and banks. The trade-offs of edge deployments are compared to a hybrid integration with Confluent Cloud. 

EPISODE LINKS

  • Processing IoT Data End to End with MQTT & Kafka
  • End-to-End Integration: IoT Edge to Confluent
  • Infrastructure Checklist for Kafka at the Edge
  • Use Cases & Architectures for Kafka at the Edge
  • Architecture Patterns for Distributed, Hybrid, Edge & Global Kafka Deployments
  • Building a Smart Factory with Kafka & 5G Campus Networks
  • Kafka Is the New Black at the Edge in Industrial IoT, Logistics & Retailing 
  • Kafka, KSQL & Apache PLC4X for IIoT Data Integration & Processing 
  • Streaming Machine Learning at Scale from 100K IoT Devices with HiveMQ, Kafka & TensorFlow 
  • Watch this podcast on YouTube
  • Join the Confluent Community
  • Use 60PDCAST to get an additional $60 of free Confluent Cloud usage (details)
...more
View all episodesView all episodes
Download on the App Store

Streaming Audio: Apache Kafka® & Real-Time DataBy Confluent, founded by the original creators of Apache Kafka®

  • 4.8
  • 4.8
  • 4.8
  • 4.8
  • 4.8

4.8

44 ratings


More shows like Streaming Audio: Apache Kafka® & Real-Time Data

View all
Planet Money by NPR

Planet Money

30,830 Listeners

The Changelog: Software Development, Open Source by Changelog Media

The Changelog: Software Development, Open Source

284 Listeners

Talk Python To Me by Michael Kennedy

Talk Python To Me

590 Listeners

Software Engineering Daily by Software Engineering Daily

Software Engineering Daily

621 Listeners

AWS Podcast by Amazon Web Services

AWS Podcast

202 Listeners

DataFramed by DataCamp

DataFramed

267 Listeners

Tech Lead Journal by Henry Suryawirawan

Tech Lead Journal

12 Listeners

System Design by Wes and Kevin

System Design

93 Listeners

Postgres FM by Nikolay Samokhvalov and Michael Christofides

Postgres FM

20 Listeners

Kubernetes for Humans by Komodor

Kubernetes for Humans

2 Listeners

Learn System Design by Ben Kitchell

Learn System Design

33 Listeners