Chris Hickman and Jon Christensen of Kelsus and Rich Staats from Secret Stache offer a history lesson on the unique challenges of data at “Internet scale” that gave birth to NoSQL and DynamoDB. How did AWS get to where it is with DynamoDB? And, what is AWS doing now? 

Some of the highlights of the show include:

• Werner’s Worst day at Amazon: Database system crashes during Super Saver Shipping
• Amazon strives to prevent problems that it knows will happen again by realizing relational database management systems aren’t built/designed for the Internet/Cloud
• Internet: Scale up vs. scale out via databases or servers; statefulness of databases prevents easy scalability
• Need sharding and partitioning of data to have clusters that can be scaled up individually
• Amazon’s Aha Moment: Realization that 90% of data accessed was simplistic, rather than relational; same thing happened at Microsoft - recall the Internet Tidal Wave memo?
• Challenge of building applications using CGI bin when Internet was brand new
• Solution: Build your own Internet database; optimize for scalability 

Links

AWS

re:Invent

DynamoDB

NoSQL

AWS re:Invent 2018 - Keynote with Andy Jassy

AWS re:Invent 2018 - Keynote with Werner Vogels

Oracle Database

Bill Gates’ Internet Tidal Wave

CGI Bin

Kelsus

Secret Stache Media

End Song

Whisper in a Dream by Uskmatu

More Info

We'd love to hear from you! You can reach us at:

• Web: https://mobycast.fm
• Voicemail: 844-818-0993
• Email: [email protected]
• Twitter: https://twitter.com/hashtag/mobycast
• Reddit: https://reddit.com/r/mobycast