The New Stack Context

This week on The New Stack Context podcast, recorded live from KubeCon + CloudNativeCon 2019, we’re talking all about monitoring and observability. Our guests are Kresten Krab Thorup, chief technology officer for Humio and Colin Fernandes, director of product marketing at Sumo Logic,

Sumo Logic is a machine data analytics company that has just announced an additional $110 million round of funding, making it worth over $1 billion. Humio is demonstrating the intake of 100 terabytes of data per day on only 25 nodes while delivering real-time observability of data. Both are on the cutting edge of understanding what intelligence we can gather from the operating conditions of our machines.

We spoke with them about the trends they’re seeing around data management and logging, both practices are seeing tremendous change, as end-users collect more and more data, while wanting to see analysis in real-time. We also talk about changes in cloud native monitoring and logging, including the recent consolidation of OpenTracing and OpenCensus into a single project, called Open Telemetry.

In the second half of the show, we offer our top podcast and stories picks, including the move to free some proprietary Kubernetes extensions with a new project called KubeMove. We also discuss our recent @Scale podcast, which confronts the challenges that the newly-launched CD Foundation has in normalizing the vast set of cloud native tools for continuous delivery.

The New Stack editorial and marketing director Libby Clark hosted this episode, with the help of TNS founder and publisher Alex Williams and TNS managing editor Joab Jackson.

On this week's episode of The New Stack Context podcast, we speak with Mark Brewer, CEO of Lightbend, as well as with Lawrence Hecht, research director and columnist at The New Stack, about the current state and future of data streaming technology.

The New Stack recently partnered with our sponsor Lightbend to produce a survey on data streaming. Lightbend released the results of that survey last week and the report is titled “Streaming Data And The Future Tech Stack,” and it is all about how developers and software architects are using data streaming in their applications today.

For the podcast, Brewer shares his top takeaways from the survey, and Hecht discusses how he analyzed the numbers and what his conclusions were. We also talked a bit about Lightbend's Akka message-driven runtime.

We also discussed the top news of the week, including VMware's purchase of Bitnami, Intel's new special-purpose Linux hypervisor for cloud native workloads, and New Relic's platform for the future, New Relic One.

Libby Clark, editorial and marketing director at The New Stack, hosted this episode, with the usual support from Alex Williams, founder and publisher of The New Stack, and Joab Jackson, TNS managing editor.

This week on The New Stack Context podcast, we speak with Nicole Huesman, open source community and developer advocate and Georg Link, an open source community strategist and PhD student, about their work on the Linux Foundation's CHAOSS project.

Yes, that’s CHAOSS with two s’s and it stands for Community Health Analytics for Open Source Software. It is an effort to project focused on creating analytics and metrics to help define community health. The pair contributed an article on The New Stack last week about how the group went about creating a set of standard metrics for diversity and inclusion in open source projects. And here, they share what they learned and set out the next steps the group plans to take to help open source communities begin to measure and document their progress around diversity and inclusion.

Then in the second half of the show, we’ll review the top podcast and stories for the week as well as discuss two conferences that were held this week, Red Hat Summit 2019 and Microsoft Build 2019.

In this episode, we do a recap of DockerCon 2019, Docker's flagship user conference, which was held in San Francisco this week. The big news for the week was the release of Docker Enterprise 3.0, the only end-to-end platform for building, sharing and running container-based applications. This fully integrated package includes a developer’s desktop interface and all the tools for managing the entire application lifecycle at every stage, either in the cloud or behind the firewall. Docker delivers the fastest time to production for any application — from legacy apps to brownfield to greenfield — with the ability to securely run them anywhere — from hybrid cloud to the edge.

Then, later in the show, we celebrate the fifth anniversary of The New Stack, as Williams takes a walk down memory lane to retell the origin story of this very site, an origin story that involves Docker as well!

Pulumi and Puppet, both mentioned in the podcast, are sponsors of The New Stack.

Today we’re talking with Joe Duffy, co-founder and CEO of Pulumi, who spoke with us about what’s fueling his company’s growth and why they’ll be at DockerCon next week. Also joining us today are Alex Williams, founder and publisher of The New Stack, and Joab Jackson, TNS managing editor. I’m Libby Clark, editorial director at The New Stack.

Pulumi is a sponsor of The New Stack, based in Seattle — not too far from TNS headquarters in Portland! — and we’re happy to have Joe on the show today in advance of DockerCon in San Francisco next week. Building on the idea of infrastructure as code, Pulumi is focused on enabling developers and DevOps teams to use popular programming languages and tools to deploy to any public or private infrastructure — and across infrastructures. Co-founders Duffy and Eric Rudder come from Microsoft and Chief Technology Officer Luke Hoban from Amazon.

Then in the second half, we’ll discuss the top podcast and stories for the week and discuss what we're looking to cover at DockerCon next week. We'll be on site, recording interviews for a new episode of our newly relaunched @Scale podcast and talking to companies on the show floor about the latest in container management tooling and application architecture.

Today on The New Stack Context we talk with Garima Kapoor, COO and co-founder of MinIO, about using Spark at scale for Artificial Intelligence and Machine Learning (AI/ML) workloads on Kubernetes. The Apache and Hadoop ecosystem hasn’t had much overlap with Kubernetes in the past, but as we learned at KubeCon in Seattle last November, that is quickly changing. As Iguazio’s Yaron Haviv wrote in a contributed article on TNS titled “Will Kubernetes Sink the Hadoop Ship?”

“Early adopters are realizing that they can run their big data stack (Spark, Presto, Kafka, etc.) on Kubernetes in a much simpler manner. Furthermore, they can run all of the cool post-Hadoop AI and data science tools like Jupyter, TensorFlow, PyTorch or custom Docker containers on the same cluster.”

Fast forward to now and we are approaching the Spark + AI Summit which Databricks is putting on in San Francisco next week and we are curious…How is Spark being used in cloud native architectures these days, with the likes of MinIO -- the open source, container native object store -- to, say, create machine learning data pipelines on Kubernetes? What is driving this trend to high-performance object stores? Kapoor breaks down the trends in the first half of the show.

This week, we spoke with Oakland The New Stack correspondent TC Currie who attended LaunchDarkly’s Trajectory conference in Oakland this week. Then later in the show our own Alex Williams, founder and publisher of The New Stack, and Joab Jackson, TNS managing editor, discussed the news coming out from Google Cloud Next in san Francisco this week. Libby Clark, editorial director at The New Stack, hosted the show.

LaunchDarkly is a feature management platform that provides feature flagging for CI/CD pipelines. Back in February, Currie interviewed LaunchDarkly’s CEO and co-founder Edith Harbaugh on our Makers podcast as one of this year’s winners of the Cloud-Now's "Top Women in Cloud" award.

Then in the second half of the show, we talk about the Google Next conference. The show has been generating a lot of energy and coverage from our cloud services correspondent Mary Branscombe. We spoke about Google’s Anthos hybrid cloud platform which came out of beta this week, and its new partnership with seven leading open source projects it will begin offering as fully managed services.

This week, we’re talking with Toby Fee, community developer at serverless software provider Stackery, about how to apply the principles of the 12-factor application model to serverless apps.

In the second half of the show, we spoke with Roman Swoszowski, vice president of cloud research and development at Grape Up, about this week's Cloud Foundry Summit, in Philadelphia. Fee has been writing a series of posts for us over the past few weeks that explores each of the principles in the 12-factor application through a serverless lens. She writes: No two serverless apps are identical, and the design decisions you make greatly affect how hard or easy you make your developers’ lives. Serverless should be a choice that makes the dev experience easier not more difficult, following these guides can help.In the second half of the podcast, we discuss the Cloud Foundry Summit.

Today we’re talking with Bob Quillin, vice president of Oracle Cloud developer relations, about how to move IT operations to the cloud when personnel is resistant to make the change.

Last year, a survey from the Cloud Native Computing Foundation found that the number one issue for companies in adopting cloud native technologies was “cultural changes with the development team.”

And that’s not surprising, Qullin writes on The New Stack this week:

The DevOps culture necessary to effectively use open source, cloud native technologies has fundamentally changed software and team processes. The culture of DevOps is expanding how we work and think. For some, this presents an exciting opportunity. Others approach it with more trepidation.

This week, we spoke with Sharone Revah Zitzman, developer relations at AppsFlyer and author of the contributed piece we ran last week titled “What the Fork, Amazon?”

In the last episode, we talked about Amazon Web Services’ new distribution of the open source Elasticsearch which has stirred up much debate and angst in the open source community.

The move was necessary, AWS’ Adrian Cockcroft argued in a blog post, in that elastic has intermingled proprietary code with the open source code that makes up the core of Elastic. He writes that with Elastic:

Neither release notes nor documentation make it clear what is open source and what is proprietary. Enterprise developers may inadvertently apply a fix or enhancement to the proprietary source code. This is hard to track and govern, could lead to breach of license, and could lead to immediate termination of rights (for both proprietary free and paid). Individual code commits also increasingly contain both open source and proprietary code, making it very difficult for developers who want to only work on open source to contribute and participate.

In particular, AWS releases open source components of Elastic providing functionalities that were previously only handled by Elastic’s proprietary code, namely security, event monitoring and alerting.