AWS re:Invent 2016

DAT315: Streaming ETL for RDS and DynamoDB


Listen Later

During this session Greg Brandt and Liyin Tang, Data Infrastructure engineers from Airbnb, will discuss the design and architecture of Airbnb's streaming ETL infrastructure, which exports data from RDS for MySQL and DynamoDB into Airbnb's data warehouse, using a system called SpinalTap. We will also discuss how we leverage Spark Streaming to compute derived data from tracking topics and/or database tables, and HBase to provide immediate data access and generate cleanly time-partitioned Hive tables.
...more
View all episodesView all episodes
Download on the App Store

AWS re:Invent 2016By AWS

  • 4.5
  • 4.5
  • 4.5
  • 4.5
  • 4.5

4.5

4 ratings