Click here to view the episode transcript.

Mentions and Links

• Follow Chris on LinkedIn
• Watch the recording of this conversation 
• Watch part 2 of this conversation on the market landscape
• Learn about PlatformX, DX’s product mentioned in the conversation

Time Stamps:

• (3:09) Why there’s an increased interest in developer portals
• (5:33) Chris’ background with dev portals
• (6:37) Homegrown solutions for developer portals
• (9:22) How developer portal initiatives begin
• (11:24) Internal developer portal vs service catalogs and IDPs
• (16:18) Mistakes companies make with developer portals
• (21:05) Approaches to solving this problem
• (24:28) How can developer portals drive value
• (32:07) Common traps to avoid

Click here to listen to the episode transcript.

Discussion points:

• (1:42) Forming the developer productivity team
• (3:25) Naming the team engineering effectiveness
• (4:30) Getting leadership buy-in for focusing on this work
• (7:54) Managing code ownership in Yelp’s monolith
• (12:23) Supporting the design system
• (16:00) The business case for forming a dedicated team 
• (19:45) How to standardize 
• (23:50) How their approach to standardization might be different in another company
• (27:08) Demonstrating the value of their work 
• (32:21) Building an insights platform
• (38:47) How Yelp is using LLM’s

Mentions and Links

• Connect with Kent Wills on LinkedIn
• Watch Kent’s 2023 talk at Elevate
• Listen to the interview with Peter Seibel (“Let 1,000 flowers bloom”)
• Download the recently published benchmarks on developer productivity team headcount

This week we’re joined by Gail Carmichael, Principal Instructional Engineer at Splunk. At Splunk, Gail’s team is responsible for improving developer onboarding, which they do through a multi-day learning program. Here, Gail shares how this program works and how they measure developer onboarding. The conversation also covers what instructional engineers are generally, and how Gail demonstrates the impact of her team’s work. 

Discussion points:

• (1:16) The Engineering Enablement & Engagement Team at Splunk
• (8:01) What an Instructional Engineer is
• (14:36) The developer onboarding program at Splunk
• (16:05) Components of a good onboarding program
• (21:11) Why having an onboarding program matters
• (28:17) Measuring onboarding at Shopify (Gail’s previous company)
• (31:39) Measuring developer onboarding at Splunk

Mentions and Links

• Connect with Gail on LinkedIn
• Download the report on Developer productivity metrics at top tech companies

In this episode we’re joined by Adam Rogal, who leads Developer Productivity and Platform at DoorDash. Adam describes DoorDash’s journey with their internal developer portal, and gives advice for  other teams looking to follow a similar path. Adam also describes how his team delivered value quickly and drove adoption for their developer platform.

Discussion points:

• (1:47) Why DoorDash explored implementing a developer portal
• (6:59) The initial vision for the developer portal 
• 12:19 Funding ongoing development 
• 16:01 Deciding what to include in the portal 
• 19:15 Coming up with a name for the portal 
• 20:01 Advice for interested beginners
• 23:55 Putting together a business case
• 32:32 Getting adoption for the portal 
• 37:27 Driving initial awareness 
• 41:29 Getting feedback from developers
• 48:33 What Adam would have done differently

Mentions and links:

• Adam Rogal on LinkedIn
• Get started (API)
• New testing and monitoring tools

In this episode, Abi has a fascinating conversation with Rebecca Parsons, ThoughtWorks's CTO, Camilla Crispim, and Erik Dörnenburg on the ThoughtWorks Tech Radar. The trio begins with an overview of Tech Radar and its history before delving into the intricate process of creating each report involving multiple teams and stakeholders. The conversation concludes with a focus on the evolution of Tech Radar's design and process and potential future changes. This episode offers Tech Radar fans an exclusive behind-the-scenes look at its history and production.

Discussion points:

• 1:20-An introduction to the Tech Radar
• 6:06-Common terms used in this episode
• 6:27-The origin of the Tech Radar
• 8:50-Problems that the Tech Radar was aiming to solve
• 12:23-The impact on internal decision making-a tool for driving change
• 14:30-The teams philosophy behind Tech Radar
• 18:33-What sets the Tech Radar apart
• 21:11-Why maintaining independence is crucial for their audience
• 25:08-How Tech Radar publishes their reports
• 29:36-A look into Thoughtworks live meeting sessions
• 34:51-Tech Radars Git repository
• 42:20-Recent changes and upcoming shifts

Mentions and links:

• ThoughtWorks TechRadar
• Rebecca Parsons on LinkedIn
• Camilla Crispim on LinkedIn
• Erik Dörnenburg on LinkedIn
• Thoughtworks Git repository

This week's guest is Eirini Kalliamvakou, a staff researcher at GitHub focused on AI and developer experience. Eirini sits at the forefront of research into GitHub Copilot. Abi and Eirini discuss recent research on how AI coding assistance impacts developer productivity. They talk about how leaders should build business cases for AI tools. They also preview what's to come with AI tools and implications for how developer productivity is measured.

Discussion points:

• (1:49) Overview of GitHub’s research on AI
• (2:59) The research study on Copilot
• (4:48) Defining and measuring productivity for this study
• (7:44) Exact measures and factors studied
• (8:16) Key findings from the study
• (9:45) How the study was conducted 
• (11:17) Most surprising findings for the researchers
• (14:01) The motivation for conducting a follow-up study
• (15:34) How the follow-up study was conducted
• (18:42) Findings from the follow-up study
• (21:13) Is AI just hype? 
• (26:34) How to begin advocating for AI tools
• (34:44) How to translate data into dollars
• (37:06) How to roll out AI tools to an organization
• (38:47) The impact of AI on developer experience
• (43:24) Implications of AI on how we measure productivity

Mentions and links:

• Eirini Kalliamvakou on LinkedIn
• Research on the impact of Copilot 
• Crossing the Chasm by Geoffrey Moore

Christopher Sanson is a product manager at Airbnb who is dedicated to enhancing developer productivity and tooling. Today, we learn more about Airbnb's developer productivity team and how various teams use metrics, both within and outside the organization. From there, we dive even deeper into their measurement journey, highlighting their implementation of DORA metrics and the challenges they overcame throughout the process.

Discussion points:

• (2:43) Who is the developer productivity customer
• (4:49) The evolution of developer productivity at Airbnb
• (9:26) Approach before DORA metrics
• (14:29) Getting buy-in for DORA metrics
• (17:49) Planning how to deliver new metrics to the organization
• (21:12) How Airbnb calculates deployment frequency
• (23:29) Implementing a proof of concept
• (27:20) Statistical measurement strategies and tactics
• (31:11) Operationalizing developer productivity metrics
• (34:26) How Airbnb reviews data
• (35:41) How Airbnb uses DORA metrics

Mentions and links:

• Christopher Sanson on LinkedIn
• Christopher’s talk at DPE Summit
• How Top Companies Measure Developer Productivity

In this episode, Abi speaks with Ana Petkovska, who is currently leading the developer experience team at Nexthink. Ana takes us through her journey of leading a DevOps team that underwent multiple transformations. She explains how her team went from being a DevOps team to EngProd and eventually DevEx. Ana elaborates on her team's challenges and the reasons behind the shift in focus. She also shares how she discovered EngProd and used data from companies like Google to convince her company to invest in EngProd. Finally, Ana explains how DevEx came into the picture and changed how her team approaches and measures their work.

Discussion points:

• (00:28) Creating and leading a DevOps team
• (05:04) Shifting from DevOps to EngProd
• (07:28) Inspiration from Google
• (10:05) Building the case for EngProd
• (13:42) Ratio of engineers to DevEx engineers
• (15:10) Team mission and charter
• (16:53) Learning about DevEx
• (20:05) The difference between EngProd and DevEx
• (22:32) Nexthink's focus today

Mentions and links:

• Ana Petkovska on LinkedIn
• Engineering Productivity @Google (Michael Bachman)

In this episode, Abi chats with Grant Jenks, Senior Staff SWE, Engineering Insights @ LinkedIn. They dive into LinkedIn's developer insights platform, iHub, and its backstory. The conversation covers qualitative versus quantitative metrics, sharing concerns about these terms and exploring their correlation. The episode wraps up with technical topics like winsorized means, thoughts on composite scores, and ways AI can benefit developer productivity teams.

(1:10) Insights in the productivity space
(7:13) LinkedIn's metrics platform, iHub
(12:52) Making metrics actionable
(15:35) Choosing the right and wrong metrics
(19:39) The difficulty of answering simple questions
(26:23) Top-down vs. bottom-up approach to metrics
(32:12) Winsorized mean and selecting measurements
(39:25) Using composite metrics
(46:57) Using AI in developer productivity

This week's episode is with Jim Beyers, VP of Engineering Enablement at CVS Health. Jim joined CVS a year ago to lead an effort to build an internal developer platform. Abi and Jim discuss how Jim joined CVS to build an internal developer platform, what brought him to the job, and how the developer experience fits into the broader transformation goals of CVS. Additionally, this episode covers building the team, defining a strategy, and how he's thinking about winning the hearts and minds across his organization.

Discussion points:

• (1:15) How Jim was brought into CVS
• (2:39) How DevEx aligns with CVS’s transformation initiatives
• (6:06) Jim’s vision for developer experience
• (8:26) Building a DevEx team and working with product managers
• (15:06) Defining and communicating a DevEx strategy
• (19:37) Assessing Backstage and developing a platform
• (24:40) Working with developers and leaders
• (27:55) Working alongside colleagues tackling similar problems
• (29:26) Reporting on progress

Mentions and links:

• Jim Beyers on LinkedIn
• Jim’s talk on the Target Application Platform