While adoption of Spark continues to grow, this year’s Spark Summit highlighted some of the ways in which the big data processing engine is still a work in progress. In particular, it’s stream analytics processing engine continues to struggle with a few hiccups that can limit its utility. That said, presenters still by and large believe Spark is the best option for streaming analytics, as other tools are even further  behind in maturity.

The Summit also featured comments from Doug Cutting, the originator of Hadoop, on where the open source data processing industry is headed and what might be next. Take a listen to this edition of Talking Data to hear more about these topics and  more from the 2016 Spark Summit.

The post Spark Summit 2016 shows off new features appeared first on Talking Data Podcast » Episodes.

The post Spark Summit 2016 shows off new features appeared first on Talking Data Podcast » Episodes.