Camunda Community Podcast

Dynamic Scaling of Zeebe Brokers: “Christmas is coming, so I'm going to get new orders, so I'm going to scale”


Listen Later

On this episode of the Camunda Community Podcast, we discuss the dynamic scaling of Zeebe clusters. Host and Senior Developer Advocate Niall Deehan is joined by Senior Software Engineer Backend, Deepthi Akkoorath to learn more about this new feature and how it came to be, including the technical challenges we overcame and decisions we made, as well as what’s next for scaling Zeebe. 

Zeebe, the cloud-native workflow and decision engine that powers Camunda 8, has many next-generation capabilities, including a language-agnostic approach so you can build clients in any programming language, enterprise-grade resilience, and horizontal scaling via a distributed architecture. We have further improved this last one by providing the ability to dynamically scale Zeebe brokers and are committed to further enhancing this feature in the future. 

Listen to learn more about: 

  • How this “daisy of destiny” came to Niall’s attention
  • The structure of the Zeebe team and Deepthi’s role on the Zeebe Distributed Platform Team
  • What is the dynamic scaling Zeebe brokers? 
  • How users can dynamically add brokers
  • What actually happens under the hood when dynamically scaling Zeebe
  • How to scale down Zeebe
  • Failover with scaling Zeebe
  • What’s next for dynamic scaling 

Learn more about Zeebe: https://bit.ly/3vjvslt

Get started with Camunda 8 today:
https://bit.ly/3vjM8tb

---

Additional Resources:
[docs] Camunda 8 Concepts: Clusters
[docs] Zeebe Technical Concepts: Clustering
[docs] Create your cluster
[docs] Setting up a Zeebe cluster
[docs] Cluster Scaling
[github] Zeebe
[github issue] Dynamic resize of an existing Zeebe cluster
[github issue] [EPIC] Dynamic Scaling of Zeebe Cluster - Phat 1: Number of brokers
[github issue] Dynamically start and stop partitions
[blogpost] Zeebe Performance 2023 Year in Review

---

Visit our website.
Connect with us on LinkedIn, Facebook, Mastodon, Threads, and Bluesky.
Check out our videos on YouTube.
Tweet with us.

---

Camunda enables organizations to orchestrate processes across people, systems, and devices to continuously overcome complexity and increase efficiency. A common visual language enables seamless collaboration between business and IT teams to design, automate, and improve end-to-end processes with the required speed, scale, and resilience to remain competitive. Hundreds of enterprises such as Atlassian, ING, and Vodafone orchestrate business-critical processes with Camunda to accelerate digital transformation.

---

Camunda presents this podcast for informational and entertainment purposes only and does not wish or intend to provide any legal, technical, or any other advice or services to the listeners of this podcast. Please see here for the full disclaimer.

...more
View all episodesView all episodes
Download on the App Store

Camunda Community PodcastBy Camunda Community Podcast


More shows like Camunda Community Podcast

View all
Economist Podcasts by The Economist

Economist Podcasts

4,283 Listeners

TechStuff by iHeartPodcasts

TechStuff

1,750 Listeners

The Changelog: Software Development, Open Source by Changelog Media

The Changelog: Software Development, Open Source

284 Listeners

99% Invisible by Roman Mars

99% Invisible

26,162 Listeners

a16z Podcast by Andreessen Horowitz

a16z Podcast

1,040 Listeners

Data Skeptic by Kyle Polich

Data Skeptic

481 Listeners

Software Engineering Daily by Software Engineering Daily

Software Engineering Daily

621 Listeners

Acquired by Ben Gilbert and David Rosenthal

Acquired

4,014 Listeners

AWS Podcast by Amazon Web Services

AWS Podcast

202 Listeners

Syntax - Tasty Web Development Treats by Wes Bos & Scott Tolinski - Full Stack JavaScript Web Developers

Syntax - Tasty Web Development Treats

987 Listeners

Practical AI by Practical AI LLC

Practical AI

192 Listeners

The Daily Stoic by Daily Stoic | Backyard Ventures

The Daily Stoic

4,786 Listeners

Tech Lead Journal by Henry Suryawirawan

Tech Lead Journal

12 Listeners

Hard Fork by The New York Times

Hard Fork

5,462 Listeners

This Day in AI Podcast by Michael Sharkey, Chris Sharkey

This Day in AI Podcast

201 Listeners