PurePerformance

Its only been a year since ChatGPT was introduced. Since then we see LLMs (Large Language Models) and Generative AIs being integrated into every days life software applications. Developers have the hard choice to pick the right model for their use case to produce the quality of output their end users demand.
Tune in to this session where we have Nir Gazit, CEO and Co-founder of Traceloop, educating us about how to observe and quantify the quality of LLMs. Besides performance and costs engineers need to look into quality attributes such as accuracy, readability or grammatical correctness.
Nir introduces us to OpenLLMetry - a set of Open Source extensions built on top of OpenTelemetry providing automated observability into the usage of LLMs for developers to better understand how to optimize the usage of LLMs. His advice to every developer is to start measuring the quality of your LLMs on Day 1 and continuously evaluate as you change your model, the prompt and the way you interact with your LLM stack!

If you have more questions about LLM Observability check out the following links:
OpenLLMetry GitHub Page: https://github.com/traceloop/openllmetry
Traceloop Website: https://www.traceloop.com/
OpenLLMetry Documentation: https://traceloop.com/docs/openllmetry

After analyzing Distributed Traces over more than 15 years Brian and I thought that everyone in software engineering and operations must be satisfied with all that observability data we have available. But. Maybe Brian and I were wrong because we didn’t fully understand all the use cases - especially those for developers that must fix code in production or need to quickly understand what code from somebody else is really doing without having the luxury to add another log line and redeploy on the fly. To learn more about the observability requirements of developers we invited Liran Haimovitch, CTO at Rookout and now part of Dynatrace, who has spent the last 7 years solving the challenging problems that developers face day and night. Tune in and learn about what non-breaking breakpoints are, how it is possible to "debug in production" without impacting running code and how we can make developers lives easier even though we push so many things "to the left"

I was invited to speak at BankTechShow in Budapest, Hungary where the nations IT leaders in the banking sector presented and discussed the future of banking - both in the cloud as well as what it means for the physical bank branches.
I got a chance to sit down with Adam Gajdi, IT Solutions CoE Lead at K&H, who walked me through the process of their recent new mobile banking app launch. Adam highlighted the importance of observability for both business owners as well as developers. Furthermore, Adam enlightened me with the fact that Hungarian banks are mandated to conduct chaos tests to proof that their systems are resilient in case of data center outages. I was obviously also curious about how AI, LLMs and other technologies are adopted in their sector. Tune in to learn more

Besides attending KubeCon 2023 NA Andreas (Andi) Grabner, co-host of PurePerformance but guest today, has also travelled parts of the US to chat with the broader observablity community on topics such as Platform Engineering, Observability, DevOps, Automation & Security.
Tune in and get a quick recap of all the topics Andi has picked up on his recent trip

Zero-Trust Architectures. Data-Flow Inventory. User Experience First! Those are key initiatives in the public sector to ensure that digital services delivered to citizens around the globe are not only working with a flawless user experience but are also safe from any bad actors trying to disrupt agencies on local, stage and federal sectors.

In this episode we invited Willie Hicks, Federal CTO at Dynatrace, to learn more about the state of observability and security with government agencies Willie has been working with over the past decade. In our conversation we explore the differences between commercial and government as it comes to ROI or how they see competition as a driving motivator.

To learn more about the public sector tune into the Tech Transformers podcast that Willie is co-hosting with his colleague Carolyn Ford.

4% of worldwide CO2 emissions come from IT and like in all other industries we have big potential to not only reduce the carbon footprint but also lower costs.
Tune in to our episode where we have Mario-Leander Reimer, CTO at QAware GmbH, talk about his top 3 suggestions for Sustainable IT: Making the right architectural choices, Right-sizing your environments and shutting down environments not needed!
Mario is also heavily involved in the CNCF and gives us an overview of projects to look into such as Kepler, kube-green, Karpenter or Carbon Aware Multi-Cluster Schedulers.

Here are the links we discussed:
Blue turns Green presentation: https://speakerdeck.com/lreimer/blue-turns-green-approaches-and-technologies-for-sustainable-k8s-clusters-number-kcdmunich?slide=5
Kepler Project: https://kepler.gl/
kube-green: https://kube-green.dev/
CNCF TAG Environmental Sustainability: https://github.com/cncf/tag-env-sustainability
Sustainability Week: https://tag-env-sustainability.cncf.io/cloud-native-sustainability-week/

Martin Spier was one of six engineers to take care of all of Netflix Operations about 10 years ago. Back then performance and observability tools weren't as sophisticated and didn't scale to the needs of Netflix as some do today. FlameScope was one of the Open Source projects that evolved out of that period, visualizing Flame Graphs on a time-scaled heatmap to identify specific performance patterns that caused issues in their complex systems back then.
Tune in to this episode and hear more performance and observability stories from Martin, about his early days in Brazil, his time at Expedia and Netflix and about his current role as VP of Engineering at PicPay - one of the hottest fin techs in Brazil.

More links we discussed:
Performance Summit talk about FlameCommander: https://www.youtube.com/watch?v=L58GrWcrD00
CMG Impact talk on Real User Monitoring at Netflix: https://www.cmg.org/2019/04/impact-2019-real-user-performance-monitoring-at-netflix-scale/
Learn more about Vector: https://netflixtechblog.com/extending-vector-with-ebpf-to-inspect-host-and-container-performance-5da3af4c584b
Martin's GitHub: https://github.com/spiermar
Connect with him on LinkedIn: https://www.linkedin.com/in/martinspier/

Africa is not only the second largest continent in the world - its also top when it comes to adoption of cloud native technologies. I was fortunate to spend a week in South Africa and had the chance to spend a lot of time with Kelvin Klein, Dynatrace Product Manager at Mediro ICT. After two observability events in Johannesburg and Cape Town and several meetings with local tech leaders I got to sit down with Kelvin and learn more about the status of Observablity, Cloud Native and Security in South Africa.

I was fortunate to travel to South Africa and meet many tech leaders in Johannesburg and Cape Town to talk about Observability, Security, Automation, Platform Engineering, DevOps and FinOps. One of those leaders is Amit Chiba, Multi Product Specialist at Nedbank. I sat down with Amit to discuss his personal journey and his projects at Nedbank, one of the leading financial institutions in South Africa. Tune in and hear from Amit how self-service platform engineering helps them to scale observability, how they tackle cloud costs and why he thinks that the future of IT Ops is more Sleep!

Do you measure build times? On your shared CI as well as local builds on the developers workstations? Do you measure how much time devs spend in debugging code or trying to understand why tests or builds are all of a sudden failing? Are you treating your pre-production with the same respect as your production environments?
Tune in and hear from Trisha Gee, Developer Champion at Gradle, who has helped development teams to reduce wait times, become more productive with their tools (gotta love that IDE of yours) and also understand the impact of their choices to other teams (when log lines wake up people at night). Trisha explains in detail what there is to know about DPE (Developer Productivity Engineering), how it fits into Platform Engineering, why adding more hardware is not always the best solution and why Flaky Tests are a passionate topic for Trisha.


Here the links to Trishas social media, her books and everything else we discussed during the podcast

• LinkedIn: https://www.linkedin.com/in/trishagee/
• Trishas Website: https://trishagee.com/
• Trisha's Talk on DPE: https://trishagee.com/presentations/developer-productivity-engineering-whats-in-it-for-me/
• Trisha's Books: https://trishagee.com/2023/07/31/summer-reading-2023/
• Dave Farley on Continuous Delivery: https://www.youtube.com/channel/UCCfqyGl3nq_V0bo64CjZh8g