The New Stack Podcast

CircleCI's Technical Architecture is Built for Scalability


Listen Later

Like a lot of startups, CircleCI started with a monolith, running on Amazon Web Services (AWS). But there was only so much that could be done to keep the monolith performing when by 2015 the company started to scale. CircleCI had built its own job scheduler in 2011 because there was nothing on the market that matched what they needed. On today's episode of The New Stack Makers, TNS Founder Alex Williams caught up with CircleCI's CTO Rob Zuber in a live-streamed discussion to dig deeper into the architecture workings behind the organization. 
By 2015, the company had made a conscious decision to use third=party tools instead of building their own, including Kubernetes, Docker containers, AWS, and Nomad. In managing Kuberenetes on AWS, Zuber noted that CircleCI has faced some issues as Kubernetes is not officially supported by AWS, but that the overall experience has been positive.
“In terms of managing our own infrastructure, what mattered to us was the ecosystem. Kubernetes is a scheduler, but with it are all of these tools people have built to help us do our job. It was becoming pretty clear Kubernetes was a leader in terms of the amount of support it was getting.”
Watch on YouTube: https://www.youtube.com/watch?v=eNoB6gohAY8
...more
View all episodesView all episodes
Download on the App Store

The New Stack PodcastBy The New Stack

  • 4.3
  • 4.3
  • 4.3
  • 4.3
  • 4.3

4.3

31 ratings


More shows like The New Stack Podcast

View all
Software Engineering Radio - the podcast for professional software developers by se-radio@computer.org

Software Engineering Radio - the podcast for professional software developers

273 Listeners

The Changelog: Software Development, Open Source by Changelog Media

The Changelog: Software Development, Open Source

284 Listeners

The Cloudcast by Massive Studios

The Cloudcast

154 Listeners

Thoughtworks Technology Podcast by Thoughtworks

Thoughtworks Technology Podcast

42 Listeners

The New Stack Analysts by The New Stack

The New Stack Analysts

9 Listeners

Software Engineering Daily by Software Engineering Daily

Software Engineering Daily

629 Listeners

The New Stack @ Scale by The New Stack

The New Stack @ Scale

3 Listeners

The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence) by Sam Charrington

The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)

441 Listeners

The New Stack Context by The New Stack

The New Stack Context

4 Listeners

AWS Podcast by Amazon Web Services

AWS Podcast

201 Listeners

Syntax - Tasty Web Development Treats by Wes Bos & Scott Tolinski - Full Stack JavaScript Web Developers

Syntax - Tasty Web Development Treats

984 Listeners

CoRecursive: Coding Stories by Adam Gordon Bell - Software Developer

CoRecursive: Coding Stories

185 Listeners

Kubernetes Podcast from Google by Abdel Sghiouar, Kaslin Fields

Kubernetes Podcast from Google

180 Listeners

Practical AI by Practical AI LLC

Practical AI

188 Listeners

The Stack Overflow Podcast by The Stack Overflow Podcast

The Stack Overflow Podcast

64 Listeners

Oxide and Friends by Oxide Computer Company

Oxide and Friends

47 Listeners

Latent Space: The AI Engineer Podcast by swyx + Alessio

Latent Space: The AI Engineer Podcast

73 Listeners

The Pragmatic Engineer by Gergely Orosz

The Pragmatic Engineer

53 Listeners