Companies that take existing software and manage it in the cloud have the opportunity to rethink their architecture and use cloud services appropriately. The resulting system is often cheaper, simpler, more elastic, and more manageable.   

Neha Pawar, a founding engineer at StarTree Data and a PMC member of Apache Pinot, recently published a blog post about her experiments with tiered storage for Pinot. We had an in-depth conversation about how they approached the architecture change and the challenges of achieving reasonable latencies with cloud object storage like S3.  

And the big question: Why did otherwise reasonable engineers decide to tackle this project's prototype over a weekend?  

Interested in more SaaS? Join our Slack:  https://saas-community.github.io/ 

The blog post: https://www.startree.ai/blogs/introducing-tiered-storage

Twitter thread: https://twitter.com/KishoreBytes/status/1503075370240659462