Maxim Lukiyanov and Scott Hanselman discuss intricate ways in which Apache Spark jobs can fail in production and how new diagnostics tools, now available in Azure HDInsight, visualize these problems in a new intuitive way and help discover and understand them from the first glance.Jump To: [04:13] Demo Start For more information:Spark Debugging and Diagnostics Toolset for Azure HDInsight (blog post)Apache Spark for Azure HDInsight overviewCreate a free account (Azure)Follow @SHanselman Follow @AzureFriday Follow @Azure