Apache Spark is a fast and general engine for big data processing. Matei Zaharia created Spark, and is the co-founder of Databricks, a company using Spark to power data science. Questions: What was the motivation behind creating Spark? How much faster is a Spark job than a Hadoop job? What is the relationship between streaming and batch processing? Is Spark’s core advantage over Storm and Samza its usability? How usefulContinue reading...

Cloudera allows enterprises to leverage their data through its Hadoop platform. Eli Collins is the Chief Technologist at Cloudera. Topics include: changes to Hadoop since Cloudera’s founding Cloudera’s usage of Spark, Docker, and other open-source technologies how enterprises use batch and streaming together Cloudera’s open-source policy Should Frito Lay open source its chip-making abilities? how collaboration occurs between big, competing companies the growth of increasingly vertical managed big data platforms likeContinue reading...

MongoDB is a cross-platform document-oriented database. Bryan Reinero is a developer advocate at MongoDB. Questions include: How are isomorphic JavaScript applications using NoSQL? What is the joke behind the “MongoDB is web scale meme”? Is Mongo used primarily for scalability, modular schema, or simply the first-class JSON objects? What is MongoDB’s impact on the movement towards single-page web applications? How can a developer choose between different NoSQL databases? Links: MongoDBContinue reading...