PromCon, the flagship yearly event of the Prometheus community, took place in Berlin 28-29 September 2023, and we’re here to bring you the highlights from the Prometheus ecosystem, including the pivotal decision on Prometheus 3.0! Brace yourselves for some exciting announcements!

The episode was live-streamed on 4 October 2023 and the video is available at https://www.youtube.com/watch?v=MzQZagfgIKk

OpenObservability Talks episodes are released monthly, on the last Thursday of each month and are available for listening on your favorite podcast app and on YouTube.

We live-stream the episodes on Twitch and YouTube Live - tune in to see us live, and chime in with your comments and questions on the live chat.

https://www.youtube.com/@openobservabilitytalks  

https://www.twitch.tv/openobservability

Show Notes:

00:00 - show, episode and guest intro

05:46 - OpenTelemetry support in Prometheus

11:02 - Green IT use case with Prometheus

14:12 - scrape sharding support in Prometheus operator 

19:33 - scaling out Alerts and alert sharding

24:45 - Windows Exporter is released

27:50 - revamping the Prometheus UI with React  

30:48 - Prometheus 3.0 and DevDay updates

41:04 - Perses project origins at Amadeus 

47:10 - Perses joining open source foundation

49:58 - embedding Perses in Red Hat OpenShift and in Chronosphere 

54:05 - Perses current release 

59:32 - Perses roadmap

1:03:11 - Perses joining the Linux Foundation and the CNCF

1:07:47 - how to get involved in Perses

1:10:03 - episode outro

Resources:

Perses on GitHub: https://github.com/perses/perses

Socials:

Twitter:⁠ https://twitter.com/OpenObserv⁠

YouTube: ⁠https://www.youtube.com/@openobservabilitytalks⁠

Dotan Horovits

============

Twitter: @horovits

LinkedIn: in/horovits

Mastodon: @horovits@fosstodon

Augustin Husson

DevOps is not just about operating the software in production, but also about releasing that software to production. Well-functioning CI/CD pipelines are critical for the business, and this calls for quality observability, to handle broken and flaky pipeline runs effectively.

The episode was live-streamed on 10 July 2023 and the video is available at https://www.youtube.com/watch?v=FEbyddZFNeo

OpenObservability Talks episodes are released monthly, on the last Thursday of each month and are available for listening on your favorite podcast app and on YouTube.

We live-stream the episodes on Twitch and YouTube Live - tune in to see us live, and chime in with your comments and questions on the live chat.

https://www.twitch.tv/openobservability

https://www.youtube.com/@openobservabilitytalks  

Show Notes:

00:00 - show intro

01:00 - episode and guest intro

10:08 - what’s new in Jenkins

15:46 - is Jenkins cloud-native?

16:52 - understanding the CI/CD landscape

21:54 - updates from the Continuous Delivery Foundation

27:00 - CI/CD observability support in OpenTelemetry

40:31 - observability with Backstage IDP open source 

47:47 - how to contact Oleg

48:51 - State of Continuous Delivery report

52:32 - OTLP 1.0 release and other open standards updates

54:32 - KubeCon will hold a dev-centric event for the first time

55:55 - Jaeger 1.47 is out

57:30 - DevOps Pulse survey insights

58:55 - outro

Resources:

Observability Has a Complexity Problem (APM Digest)

OTLP 1.0 is out

Open Standards in observability: updates from KubeCon

CI/CD observability support in OpenTelemetry proposal

State of Continuous Delivery 2023 report

Socials:

Dotan Horovits

============

Twitter: @horovits

LinkedIn: in/horovits

Mastodon: @horovits@fosstodon

Oleg Nenashev

===============

Twitter: @oleg_nenashev

LinkedIn: https://www.linkedin.com/in/onenashev/

Mastodon: @asciidwarf@fosstodon

Terraform is no longer open source. This is the news we got last month (August 2023), when HashiCorp announced its decision to relicense its open source tools, including Terraform, Vault, Packer, Consul, Vagrant and others, into Business Source License 1.1.

The episode was live-streamed on 18 September 2023 and the video is available at https://www.youtube.com/watch?v=5QdUs9VKq5g

OpenObservability Talks episodes are released monthly, on the last Thursday of each month and are available for listening on your favorite podcast app and on YouTube.

We live-stream the episodes on Twitch and YouTube Live - tune in to see us live, and chime in with your comments and questions on the live chat.

⁠https://www.youtube.com/@openobservabilitytalks⁠  

https://www.twitch.tv/openobservability

Show Notes:

00:00 - show intro

Resources:

HashiCorp relicensing announcement: https://www.hashicorp.com/blog/hashicorp-adopts-business-source-licenseOpenTofu project: https://opentofu.org/ The Linux Foundation announces OpenTofu: https://www.linuxfoundation.org/press/announcing-opentofu Red Hat changed the CentOS release process: https://www.redhat.com/en/blog/furthering-evolution-centos-streamCNCF’s guidelines for using source-available dependencies in its OSS projects: https://github.com/cncf/foundation/blob/main/source-available-recommendations.md#recommendations checklist for safely using and choosing open source tools: https://medium.com/@horovits/when-your-open-source-turns-to-the-dark-side-331d83f182c

Socials:

Twitter:⁠ https://twitter.com/OpenObserv⁠

YouTube: ⁠https://www.youtube.com/@openobservabilitytalks⁠

Dotan Horovits

============

Twitter: @horovits

LinkedIn: in/horovits

Mastodon: @horovits@fosstodon

Fluentd and Fluent Bit are two highly popular open source projects for data collection and log forwarding in the realm of observability. Fluentd's flexibility and scalability have led to seamless integration with diverse applications and data sources, while Fluent Bit's lightweight and efficient log forwarding have made it a preferred choice for modern observability pipelines. But Fluent Bit can process more than just logs. The recent release of Fluent Bit v2 added major new integrations with OpenTelemetry, Prometheus and more, as well as extensibility with WebAssembly plugins.

On this episode I hosted Eduardo Silva Pereira, one of Fluentd project maintainers and creator of Fluent Bit. He also is the founder of Calyptia, the Fluent company. Eduardo shared with us the latest updates of Fluentd and Fluent Bit, as well as valuable insights into the future roadmap of these projects.

OpenObservability Talks episodes are released monthly, on the last Thursday of each month and are available for listening on your favorite podcast app and on YouTube.

We live-stream the episodes on Twitch and YouTube Live - tune in to see us live, and chime in with your comments and questions on the live chat.

https://www.youtube.com/@openobservabilitytalks  

⁠https://www.twitch.tv/openobservability⁠

Show Notes:

02:11 - Fluentd and Fluent Bit background

09:51 - Should I choose FluentD or Fluent Bit?

13:26 - developing an active engaged OSS community

17:18 - enterprise needs and building commercial offering with Calyptia

19:54 - Fluent Bit v2 updates

29:22 - plugins, filters and processors in Fluent Bit

38:23 - A sneak peak into the planned announcements for KubeCon Chicago

44:16 - where to follow the community and Eduardo

47:43 - Prometheus now supports OTLP

48:57 - PromCon will take place in Berlin, 28-29 Sept.

50:11 - OpenTelemetry Semantic Conventions is separated from the Specification

53:38 - New in Kubernetes 1.27: Query node logs using the kubelet API

54:43 - Kelemetry: global tracing for Kubernetes control plane

Resources:

Resources

=========

Fluent Bit: https://fluentbit.io/

FluentD: https://www.fluentd.org/

Prometheus supports OTLP: https://horovits.medium.com/83f85878e46a

PromCon '23: https://promcon.io/2023-berlin/

Query node logs using the kubelet API: https://logz.io/blog/a-practical-guide-to-kubernetes-logging/#Kubernetes_1_27

Kelemetry project: https://www.cncf.io/blog/2023/07/27/kelemetry-global-tracing-for-kubernetes-control-plane/

Socials:

Twitter:⁠ https://twitter.com/OpenObserv⁠

YouTube: ⁠https://www.youtube.com/@openobservabilitytalks⁠

eBay is a high scale end user of open source observability. Collecting telemetry from millions of endpoints, and running thousands of queries per second, presents serious scaling challenges. eBay has chosen to use an open source stack to meet those challenges.

The episode was live-streamed on 8 June 2023 and the video is available at https://www.youtube.com/watch?v=-UsU3nRglhA

OpenObservability Talks episodes are released monthly, on the last Thursday of each month and are available for listening on your favorite podcast app and on YouTube.

We live-stream the episodes on Twitch and YouTube Live - tune in to see us live, and chime in with your comments and questions on the live chat.

https://www.twitch.tv/openobservability

https://www.youtube.com/@openobservabilitytalks  

Show Notes:

3rd anniversary

eBay monitoring solution 

planet scale at eBay in numbers

distributed tracing at eBay

migrating from Elastic Beats to OpenTelemetry

why eBay chose open source 

open-sourcing eBay’s metrics store platform?

scaling Prometheus

ramping up tracing, from backend to frontend and mobile

running OpenTelemetry Collector at scale

Query Language Standardization for Observability under the CNCF

Resources:

New CNCF working group for Observability Query Language Standardization: https://github.com/cncf/tag-observability/blob/main/working-groups/query-standardization.md

Socials:

Dotan Horovits

============

Twitter: @horovits

LinkedIn: in/horovits

Mastodon: @horovits@fosstodon

Vijay Samuel

==========

Twitter: @vjsamuel_

LinkedIn: vjsamuel

With over 1,000 companies using it and 21.5K+ stars on GitHub, the Backstage open source project is quickly becoming a go-to tool for managing developer infrastructure. In this episode, I’ll sit down with Lee Mills, a Senior Engineering Manager from Spotify's Backstage project, to learn more about how the open source platform is revolutionizing the developer experience and how it aligns with the growing Internal Developer Platform (IDP) space. We’ll discuss the need that drove Spotify to build this internal tool, about the decision and journey to open source it and donate it to the CNCF (Cloud Native Computing Foundation). We’ll also discuss the new commercial plugins, what’s coming up on the roadmap, and much more. 

Lee has worked as an engineering manager for the past 12 years, from Amazon to Spotify and everything in between. Prior to that Lee had a mixed background working in academia as a lecturer, worked as a Boom Op for television in the UK and lived in more places than he can count.

The episode was live-streamed on 17 May 2023 and the video is available at https://youtu.be/W3c4YJ71BOQ

OpenObservability Talks episodes are released monthly, on the last Thursday of each month and are available for listening on your favorite podcast app and on YouTube.

We live-stream the episodes on Twitch and YouTube Live - tune in to see us live, and chime in with your comments and questions on the live chat.https://www.twitch.tv/openobservabilityhttps://www.youtube.com/@openobservabilitytalks  

Show Notes:

01:44 Spotify Engineering internal need for Backstage

07:09 Backstage and Platform Engineering

10:33 Backstage components: Templates, Catalogue and Plugins

15:31 Why Spotify open-sourced Backstage

21:45 from Spotify’s internal Hack Week to a viral growth

25:19 a perfect community contributed feature in 24 hours

28:48 new Backstages use cases for Banking and healthcare

30:54 Spotify released commercial plugins for Backstage

36:51 How to follow Backstage discussion and Lee Mills

39:08 KubeCon Europe updates

40:51 Prometheus remote-write is standardized

41:32 Sunsetting OpenCensus

42:31 ECS to merge with OpenTelemetry specification

43:22 progress to stabilize Logs in OpenTelemetry

45:02 MicroProfile v6.0 support OpenTelemetry Traces

45:40 Grafana 9.5 release

Resources:

Backstage website: https://backstage.io 

Kubecon Europe 2023 talk: The State of Backstage in 2023: https://youtu.be/vskefrlvocE 

Kubecon Europe 2023 talk: Lunar building an internal compliance platform using Backstage: https://youtu.be/6T3Mf6pdg7E

Backstage accepted as CNCF incubation project: https://www.cncf.io/blog/2022/03/15/backstage-project-joins-the-cncf-incubator/

Socials:

Dotan Horovits

============

Twitter: @horovits

LinkedIn: in/horovits

Mastodon: @horovits@fosstodon

Lee Mills

This is a special episode, live from the KubeCon show floor in Amsterdam. Join us to hear the hot updates from KubeCon + CloudNativeCon Europe 2023 as well as insider insights from the CNCF’s head of ecosystem, Taylor Dolezal.

OpenObservability Talks episodes are released monthly, on the last Thursday of each month and are available for listening on your favorite podcast app and on YouTube.

We live-stream the episodes on Twitch and YouTube Live - tune in to see us live, and chime in with your comments and questions on the live chat.

https://www.twitch.tv/openobservability

https://www.youtube.com/@openobservabilitytalks  

Have you got an interesting topic you'd like to share in an episode? Reach out to us and submit your proposal at https://openobservability.io/

Show Notes:

Resources:

Socials:

Dotan Horovits

============

Twitter: @horovits

LinkedIn: https://www.linkedin.com/in/horovits/ 

Mastodon: @horovits@fosstodon

Taylor Dolezal

The Cloud Native Computing Foundation (CNCF) is the home of the most prominent open source projects used today, such as Kubernetes, Prometheus, ArgoCD, Linkerd and more. These projects fuel today’s cloud native architectures and software release pipelines. With its immense growth, it has become difficult to keep tabs on the hundreds of new and evolving projects and specifications, the different working groups and technical advisory groups, the different community forums and events, and to see where it’s all heading.

I invited Chris Aniszczyk, CTO of the CNCF, to join me on this episode, to help us understand the CNCF landscape and evolution. We will also discuss the trends in observability and in the open source realm in general. Chris also has some interesting predictions to share. 

Chris Aniszczyk is an open source executive and engineer with a passion for building a better world through open collaboration. He's currently a CTO at the Linux Foundation focused on developer relations and running the Open Container Initiative (OCI) / Cloud Native Computing Foundation (CNCF). Furthermore, he's a partner at Capital Factory where he focuses on mentoring, advising and investing in open source and infrastructure focused startups.

At Twitter, he created their open source program and led their open source efforts. For many years he served on the Eclipse Foundation's Board of Directors representing the committer community and the Java Community Process (JCP) Executive Committee. In a previous life, he bootstrapped a consulting company, made many mistakes, lead and hacked on many eclipse.org and Linux related projects.

The episode was live-streamed on 15 March 2023 and the video is available at https://www.youtube.com/live/lMUFGmNploc

OpenObservability Talks episodes are released monthly, on the last Thursday of each month and are available for listening on your favorite podcast app and on YouTube.

We live-stream the episodes on Twitch and YouTube Live - tune in to see us live, and chime in with your comments and questions on the live chat.

https://www.twitch.tv/openobservability

https://www.youtube.com/@openobservabilitytalks  

Have you got an interesting topic you'd like to share in an episode? Reach out to us and submit your proposal at https://openobservability.io/

Show Notes:

Resources:

Socials:

Dotan Horovits

============

Twitter: https://twitter.com/horovits 

LinkedIn: https://www.linkedin.com/in/horovits/ 

Mastodon: @horovits@fosstodon

Chris Aniszczyk

===============

Twitter: @cra

LinkedIn: https://www.linkedin.com/in/caniszczyk/

Mastodon: @[email protected]

Many organizations struggle in understanding and monitoring the costs of their Kubernetes workloads, cloud infrastructure and cloud native applications. Moreover, different cloud providers use different conventions, which makes it difficult to compare across vendors and to monitor cost in multi-cloud environments. The lack of cost observability and vendor-agnostic FinOps standardization can become a critical business challenge.  

OpenCost is a vendor-neutral open source project for measuring and allocating infrastructure and container costs. It’s built for Kubernetes cost monitoring to power real-time cost monitoring, showback, and chargeback, across on-premises Kubernetes as well as cloud managed offering.  

I discussed this topic with Matt Ray, Senior Community Manager for the OpenCost project. Matt  has been active in Open Source and DevOps communities for over two decades and has spoken at and helped organize many conferences and meetups. He is currently the Senior Community Manager at Kubecost for the CNCF Sandbox Project OpenCost. Matt also co-hosts the Software Defined Talk podcast.

The episode was live-streamed on 14 February 2023 and the video is available at https://www.youtube.com/watch?v=mhqXQV2jsxo

OpenObservability Talks episodes are released monthly, on the last Thursday of each month and are available for listening on your favorite podcast app and on YouTube.

We live-stream the episodes on Twitch and YouTube Live - tune in to see us live, and chime in with your comments and questions on the live chat.
https://www.twitch.tv/openobservability
https://www.youtube.com/@openobservabilitytalks

Have you got an interesting topic you'd like to share in an episode? Reach out to us and submit your proposal at https://openobservability.io/

Show Notes:

Resources:

Socials:

Dotan Horovits

============

Twitter: horovits

LinkedIn: https://www.linkedin.com/in/horovits/

Mastodon: @horovits@fosstodon

Matt Ray

===============

Twitter: mattray

LinkedIn: https://www.linkedin.com/in/mhray/

Mastodon: @[email protected]

A 3-node Kubernetes cluster with Prometheus will ship around 40k active series by default! Do we really need all that data? The current state of Kubernetes open source monitoring is in need of improvement. High churn rate of pod metrics, proliferation of metrics with low usage, and configuration complexity are some of the issues that need to be addressed.

I discussed this topic with Aliaksandr Valialkin, CTO at VictoriaMetrics and creator of the open source project. We discussed the common problems, as well as directions and best practices to overcome some of these complexities as individuals and as a community. We also discussed VictoriaMetrics open source project and how it addresses some of these challenges.

Aliaksandr a Golang engineer, who likes writing simple and performant code and creating easy-to-use programs. Sometimes these hard-to-match requirements work together, like in the VictoriaMetrics case.

The episode was live-streamed on 24 January 2023 and the video is available at https://www.youtube.com/live/Z-58C8HFGb8

OpenObservability Talks episodes are released monthly, on the last Thursday of each month and are available for listening on your favorite podcast app and on YouTube.

We live-stream the episodes on Twitch and YouTube Live - tune in to see us live, and chime in with your comments and questions on the live chat.
https://www.twitch.tv/openobservability
https://www.youtube.com/@openobservabilitytalks

Have you got an interesting topic you'd like to share in an episode? Reach out to us and submit your proposal at https://openobservability.io/

Show Notes:

Resources:

Socials:

Dotan Horovits 

Twitter: https://twitter.com/horovits  
LinkedIn: https://www.linkedin.com/in/horovits/  

Aliaksandr Valialkin

Twitter: https://twitter.com/valyala