AWS for Software Companies Podcast

Ep173: Simplifying Elasticsearch at Scale: How Elastic Built Their Serverless Platform


Listen Later

Uri Cohen reveals how Elastic transformed from managing 50,000 complex clusters to building a seamless serverless platform that eliminates operational overhead while scaling globally

Topics Include:

  • Johan Broman of AWS hosts Uri Cohen who leads Elastic's platform products team
  • Uri shares his nine-year journey at Elastic from small company to global scale
  • Elasticsearch started 15 years ago, becoming popular for search, logs, and security events
  • Elastic Cloud launched 2015, but users struggled with shards, nodes, and infrastructure complexity
  • Serverless eliminates operational concerns, letting users just ingest and analyze their data
  • Design goal: maintain familiar Elasticsearch experience while removing all infrastructure management burden
  • Chose complete architectural redesign over retrofitting auto-scaling to existing infrastructure
  • New architecture uses S3 persistence with lightweight routing layer serving 50,000+ clusters
  • Cell-based design limits blast radius and improves multi-tenancy across 40+ global regions
  • Learned S3 API costs can explode unexpectedly without careful request pattern optimization
  • AI transforms security workflows: 10,000 alerts become 3 actionable attack summaries automatically
  • Weekly continuous deployment enables faster innovation delivery without waiting for version releases


Participants:

  • Uri Cohen – Vice President of Product Management, Platform, Elastic
  • Johan Broman – EMEA ISV Head of Solutions Architecture, Amazon Web Services


See how Amazon Web Services gives you the freedom to migrate, innovate, and scale your software company at https://aws.amazon.com/isv/

...more
View all episodesView all episodes
Download on the App Store

AWS for Software Companies PodcastBy AWS - Amazon Web Services

  • 5
  • 5
  • 5
  • 5
  • 5

5

9 ratings


More shows like AWS for Software Companies Podcast

View all
Planet Money by NPR

Planet Money

30,734 Listeners

Hidden Brain by Hidden Brain, Shankar Vedantam

Hidden Brain

43,618 Listeners

Economist Podcasts by The Economist

Economist Podcasts

4,149 Listeners

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch by Harry Stebbings

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

531 Listeners

Security Now (Audio) by TWiT

Security Now (Audio)

2,008 Listeners

The a16z Show by Andreessen Horowitz

The a16z Show

1,092 Listeners

CyberWire Daily by N2K Networks

CyberWire Daily

1,021 Listeners

Super Data Science: ML & AI Podcast with Jon Krohn by Jon Krohn

Super Data Science: ML & AI Podcast with Jon Krohn

302 Listeners

Cybersecurity Today by Jim Love

Cybersecurity Today

179 Listeners

Practical AI by Practical AI LLC

Practical AI

204 Listeners

AWS Podcast by Amazon Web Services

AWS Podcast

205 Listeners

Dwarkesh Podcast by Dwarkesh Patel

Dwarkesh Podcast

523 Listeners

Cyber Security Headlines by CISO Series

Cyber Security Headlines

139 Listeners

Hard Fork by The New York Times

Hard Fork

5,510 Listeners

AI + a16z by a16z

AI + a16z

36 Listeners