AWS for Software Companies Podcast

Ep173: Simplifying Elasticsearch at Scale: How Elastic Built Their Serverless Platform


Listen Later

Uri Cohen reveals how Elastic transformed from managing 50,000 complex clusters to building a seamless serverless platform that eliminates operational overhead while scaling globally

Topics Include:

  • Johan Broman of AWS hosts Uri Cohen who leads Elastic's platform products team
  • Uri shares his nine-year journey at Elastic from small company to global scale
  • Elasticsearch started 15 years ago, becoming popular for search, logs, and security events
  • Elastic Cloud launched 2015, but users struggled with shards, nodes, and infrastructure complexity
  • Serverless eliminates operational concerns, letting users just ingest and analyze their data
  • Design goal: maintain familiar Elasticsearch experience while removing all infrastructure management burden
  • Chose complete architectural redesign over retrofitting auto-scaling to existing infrastructure
  • New architecture uses S3 persistence with lightweight routing layer serving 50,000+ clusters
  • Cell-based design limits blast radius and improves multi-tenancy across 40+ global regions
  • Learned S3 API costs can explode unexpectedly without careful request pattern optimization
  • AI transforms security workflows: 10,000 alerts become 3 actionable attack summaries automatically
  • Weekly continuous deployment enables faster innovation delivery without waiting for version releases


Participants:

  • Uri Cohen – Vice President of Product Management, Platform, Elastic
  • Johan Broman – EMEA ISV Head of Solutions Architecture, Amazon Web Services


See how Amazon Web Services gives you the freedom to migrate, innovate, and scale your software company at https://aws.amazon.com/isv/

...more
View all episodesView all episodes
Download on the App Store

AWS for Software Companies PodcastBy AWS - Amazon Web Services

  • 5
  • 5
  • 5
  • 5
  • 5

5

10 ratings


More shows like AWS for Software Companies Podcast

View all
Acquired by Ben Gilbert and David Rosenthal

Acquired

4,630 Listeners

Bloomberg Intelligence by Bloomberg

Bloomberg Intelligence

399 Listeners

Software Engineering Radio by se-radio@computer.org

Software Engineering Radio

271 Listeners

a16z Podcast by Andreessen Horowitz

a16z Podcast

1,090 Listeners

Software Engineering Daily by Software Engineering Daily

Software Engineering Daily

624 Listeners

Super Data Science: ML & AI Podcast with Jon Krohn by Jon Krohn

Super Data Science: ML & AI Podcast with Jon Krohn

303 Listeners

Y Combinator Startup Podcast by Y Combinator

Y Combinator Startup Podcast

226 Listeners

AWS Podcast by Amazon Web Services

AWS Podcast

203 Listeners

Morning Brew Daily by Morning Brew

Morning Brew Daily

3,012 Listeners

All-In with Chamath, Jason, Sacks & Friedberg by All-In Podcast, LLC

All-In with Chamath, Jason, Sacks & Friedberg

9,888 Listeners

Barron's Streetwise by Barron's

Barron's Streetwise

1,572 Listeners

People I (Mostly) Admire by Freakonomics Radio + Stitcher

People I (Mostly) Admire

2,079 Listeners

Hard Fork by The New York Times

Hard Fork

5,519 Listeners

The Ezra Klein Show by New York Times Opinion

The Ezra Klein Show

16,062 Listeners

The Pragmatic Engineer by Gergely Orosz

The Pragmatic Engineer

64 Listeners