Vivek Yadav, an engineering manager from Stripe, shares his experience in building a testing system based on multi-year worth of data. He shares insights into why Apache Spark was the choice for creating such a system and how it fits in the "traditional" engineering practices.

Read a transcript of this interview: https://bit.ly/4o08NjD

Subscribe to the Software Architects’ Newsletter for your monthly guide to the essential news and experience from industry peers on emerging patterns and technologies:

https://www.infoq.com/software-architects-newsletter

Upcoming Events:

QCon AI New York 2025 (December 16-17, 2025)

https://ai.qconferences.com/

QCon London 2026 (March 16-19, 2026)

QCon London equips senior engineers, architects, and technical leaders with trusted, practical insights to lead the change in software development. Get real-world solutions and leadership strategies from senior software practitioners defining current trends and solving today's toughest software challenges.

https://qconlondon.com/

QCon AI Boston 2026 (June 1-2, 2026)

Learn how real teams are accelerating the entire software lifecycle with AI.

https://boston.qcon.ai

The InfoQ Podcasts:

Weekly inspiration to drive innovation and build great teams from senior software leaders. Listen to all our podcasts and read interview transcripts:

- The InfoQ Podcast https://www.infoq.com/podcasts/

- Engineering Culture Podcast by InfoQ https://www.infoq.com/podcasts/#engineering_culture

- Generally AI: https://www.infoq.com/generally-ai-podcast/

Follow InfoQ:

- Mastodon: https://techhub.social/@infoq

- X: https://x.com/InfoQ?from=@

- LinkedIn: https://www.linkedin.com/company/infoq/

- Facebook: https://www.facebook.com/InfoQdotcom#

- Instagram: https://www.instagram.com/infoqdotcom/?hl=en

- Youtube: https://www.youtube.com/infoq

- Bluesky: https://bsky.app/profile/infoq.com

Write for InfoQ: Learn and share the changes and innovations in professional software development.

- Join a community of experts.

- Increase your visibility.

- Grow your career.

https://www.infoq.com/write-for-infoq

Marina Moore, a security researcher and the co-chair of the security and compliance TAG of CNCF, shares her concerns about the security vulnerabilities of containers. She explains where the issues originate, providing solutions and discussing alternative routes to using micro-VMs rather than containers. Additionally, she highlights the risks associated with AI inference.

Read a transcript of this interview: https://bit.ly/4qUCcyi

Subscribe to the Software Architects’ Newsletter for your monthly guide to the essential news and experience from industry peers on emerging patterns and technologies:

https://www.infoq.com/software-architects-newsletter

Upcoming Events:

QCon San Francisco 2025 (November 17-21, 2025)

Get practical inspiration and best practices on emerging software trends directly from senior software developers at early adopter companies.

https://qconsf.com/

QCon AI New York 2025 (December 16-17, 2025)

https://ai.qconferences.com/

QCon London 2026 (March 16-19, 2026)

https://qconlondon.com/

The InfoQ Podcasts:

Weekly inspiration to drive innovation and build great teams from senior software leaders. Listen to all our podcasts and read interview transcripts:

- The InfoQ Podcast https://www.infoq.com/podcasts/

- Engineering Culture Podcast by InfoQ https://www.infoq.com/podcasts/#engineering_culture

- Generally AI: https://www.infoq.com/generally-ai-podcast/

Follow InfoQ:

- Mastodon: https://techhub.social/@infoq

- X: https://x.com/InfoQ?from=@

- LinkedIn: https://www.linkedin.com/company/infoq/

- Facebook: https://www.facebook.com/InfoQdotcom#

- Instagram: https://www.instagram.com/infoqdotcom/?hl=en

- Youtube: https://www.youtube.com/infoq

- Bluesky: https://bsky.app/profile/infoq.com

Write for InfoQ: Learn and share the changes and innovations in professional software development.

- Join a community of experts.

- Increase your visibility.

- Grow your career.

https://www.infoq.com/write-for-infoq

In this podcast, Michael Stiefel spoke with Randy Shoup about how to evolve your software after a software failure, and how to improve the resilience of your software by modeling transient states using events and workflows.

Software failure is inevitable, but learning from failure, including making the necessary changes to organizational culture can make your software more resilient. One of the most important ways to do this is to search for the truth, rather than trying to seek out the guilty. The real world is asynchronous, which means that transient events are important for resilient systems because that is where failures often occur, or compensation has to take place. Workflows and events are the best way to model these systems.

Read a transcript of this interview: https://bit.ly/3Lmvd0I

Subscribe to the Software Architects’ Newsletter for your monthly guide to the essential news and experience from industry peers on emerging patterns and technologies:

https://www.infoq.com/software-architects-newsletter

Upcoming Events:

QCon San Francisco 2025 (November 17-21, 2025)

Get practical inspiration and best practices on emerging software trends directly from senior software developers at early adopter companies.

https://qconsf.com/

QCon AI New York 2025 (December 16-17, 2025)

https://ai.qconferences.com/

QCon London 2026 (March 16-19, 2026)

https://qconlondon.com/

The InfoQ Podcasts:

Weekly inspiration to drive innovation and build great teams from senior software leaders. Listen to all our podcasts and read interview transcripts:

- The InfoQ Podcast https://www.infoq.com/podcasts/

- Engineering Culture Podcast by InfoQ https://www.infoq.com/podcasts/#engineering_culture

- Generally AI: https://www.infoq.com/generally-ai-podcast/

Follow InfoQ:

- Mastodon: https://techhub.social/@infoq

- X: https://x.com/InfoQ?from=@

- LinkedIn: https://www.linkedin.com/company/infoq/

- Facebook: https://www.facebook.com/InfoQdotcom#

- Instagram: https://www.instagram.com/infoqdotcom/?hl=en

- Youtube: https://www.youtube.com/infoq

- Bluesky: https://bsky.app/profile/infoq.com

Write for InfoQ: Learn and share the changes and innovations in professional software development.

- Join a community of experts.

- Increase your visibility.

- Grow your career.

https://www.infoq.com/write-for-infoq

Magdalena Picariello reframes how we think about AI, moving the conversation from algorithms and metrics to business impact and outcomes. She champions evaluation systems that don't just measure accuracy but also demonstrate real-world business value, and advocates for iterative development with continuous feedback to build optimal applications.

Read a transcript of this interview: http://bit.ly/4oqUIMv

Subscribe to the Software Architects’ Newsletter for your monthly guide to the essential news and experience from industry peers on emerging patterns and technologies:

https://www.infoq.com/software-architects-newsletter

Upcoming Events:

QCon San Francisco 2025 (November 17-21, 2025)

Get practical inspiration and best practices on emerging software trends directly from senior software developers at early adopter companies.

https://qconsf.com/

QCon AI New York 2025 (December 16-17, 2025)

https://ai.qconferences.com/

QCon London 2026 (March 16-19, 2026)

https://qconlondon.com/

The InfoQ Podcasts:

Weekly inspiration to drive innovation and build great teams from senior software leaders. Listen to all our podcasts and read interview transcripts:

- The InfoQ Podcast https://www.infoq.com/podcasts/

- Engineering Culture Podcast by InfoQ https://www.infoq.com/podcasts/#engineering_culture

- Generally AI: https://www.infoq.com/generally-ai-podcast/

Follow InfoQ:

- Mastodon: https://techhub.social/@infoq

- X: https://x.com/InfoQ?from=@

- LinkedIn: https://www.linkedin.com/company/infoq/

- Facebook: https://www.facebook.com/InfoQdotcom#

- Instagram: https://www.instagram.com/infoqdotcom/?hl=en

- Youtube: https://www.youtube.com/infoq

- Bluesky: https://bsky.app/profile/infoq.com

Write for InfoQ: Learn and share the changes and innovations in professional software development.

- Join a community of experts.

- Increase your visibility.

- Grow your career.

https://www.infoq.com/write-for-infoq

Jenish Shah, a back-end engineer focused on distributed systems at Netflix, provides more insights on how to handle failures in a distributed systems setup. He shares details on how he built a library that handles exceptions uniformly, regardless of the underlying communication protocol.

Read a transcript of this interview: http://bit.ly/3JpmIBn

Subscribe to the Software Architects’ Newsletter for your monthly guide to the essential news and experience from industry peers on emerging patterns and technologies:

https://www.infoq.com/software-architects-newsletter

Upcoming Events:

QCon San Francisco 2025 (November 17-21, 2025)

Get practical inspiration and best practices on emerging software trends directly from senior software developers at early adopter companies.

https://qconsf.com/

QCon AI New York 2025 (December 16-17, 2025)

https://ai.qconferences.com/

QCon London 2026 (March 16-19, 2026)

https://qconlondon.com/

The InfoQ Podcasts:

Weekly inspiration to drive innovation and build great teams from senior software leaders. Listen to all our podcasts and read interview transcripts:

- The InfoQ Podcast https://www.infoq.com/podcasts/

- Engineering Culture Podcast by InfoQ https://www.infoq.com/podcasts/#engineering_culture

- Generally AI: https://www.infoq.com/generally-ai-podcast/

Follow InfoQ:

- Mastodon: https://techhub.social/@infoq

- X: https://x.com/InfoQ?from=@

- LinkedIn: https://www.linkedin.com/company/infoq/

- Facebook: https://www.facebook.com/InfoQdotcom#

- Instagram: https://www.instagram.com/infoqdotcom/?hl=en

- Youtube: https://www.youtube.com/infoq

- Bluesky: https://bsky.app/profile/infoq.com

Write for InfoQ: Learn and share the changes and innovations in professional software development.

- Join a community of experts.

- Increase your visibility.

- Grow your career.

https://www.infoq.com/write-for-infoq

In this episode of the podcast, members of the InfoQ editorial staff and friends of InfoQ will discuss current trends in the cloud and DevOps domains as part of our annual trends report creation process. These reports provide InfoQ readers with a high-level overview of key topics to watch and also help the editorial team focus on innovative technologies. In addition to the report and the trends graph available on InfoQ.com, this podcast offers a chance to hear our raw conversation and the stories shared by our expert practitioners.

Read a transcript of this interview: http://bit.ly/3KBz5us

Subscribe to the Software Architects’ Newsletter for your monthly guide to the essential news and experience from industry peers on emerging patterns and technologies:

https://www.infoq.com/software-architects-newsletter

Upcoming Events:

InfoQ Dev Summit Munich (October 15-16, 2025)

Essential insights on critical software development priorities.

https://devsummit.infoq.com/conference/munich2025

QCon San Francisco 2025 (November 17-21, 2025)

Get practical inspiration and best practices on emerging software trends directly from senior software developers at early adopter companies.

https://qconsf.com/

QCon AI New York 2025 (December 16-17, 2025)

https://ai.qconferences.com/

QCon London 2026 (March 16-19, 2026)

https://qconlondon.com/

The InfoQ Podcasts:

Weekly inspiration to drive innovation and build great teams from senior software leaders. Listen to all our podcasts and read interview transcripts:

- The InfoQ Podcast https://www.infoq.com/podcasts/

- Engineering Culture Podcast by InfoQ https://www.infoq.com/podcasts/#engineering_culture

- Generally AI: https://www.infoq.com/generally-ai-podcast/

Follow InfoQ:

- Mastodon: https://techhub.social/@infoq

- X: https://x.com/InfoQ?from=@

- LinkedIn: https://www.linkedin.com/company/infoq/

- Facebook: https://www.facebook.com/InfoQdotcom#

- Instagram: https://www.instagram.com/infoqdotcom/?hl=en

- Youtube: https://www.youtube.com/infoq

- Bluesky: https://bsky.app/profile/infoq.com

Write for InfoQ: Learn and share the changes and innovations in professional software development.

- Join a community of experts.

- Increase your visibility.

- Grow your career.

https://www.infoq.com/write-for-infoq

In this podcast, Michael Stiefel spoke with Nimisha Asthagiri about the importance of system thinking, multi-agent systems, the consequences of society applying a technology into an area for which it was not designed, and whether we can ever have a healthy relationship with artificial intelligence.

System thinking emphasizes the importance of mental models, and how they relate to business requirements, and the architect's role in reconciling the different mental models of the participants in system design. In the area of multi-agent systems the discussion focused on how to scale such a system and control its autonomy in its relationship with humans. The discussion concludes with an exchange of views on our relationship with artificial intelligence, and the consequences of technology being used in areas for which it was never designed.

Read a transcript of this interview: http://bit.ly/487NPel

Subscribe to the Software Architects’ Newsletter for your monthly guide to the essential news and experience from industry peers on emerging patterns and technologies:

https://www.infoq.com/software-architects-newsletter

Upcoming Events:

InfoQ Dev Summit Munich (October 15-16, 2025)

Essential insights on critical software development priorities.

https://devsummit.infoq.com/conference/munich2025

QCon San Francisco 2025 (November 17-21, 2025)

Get practical inspiration and best practices on emerging software trends directly from senior software developers at early adopter companies.

https://qconsf.com/

QCon AI New York 2025 (December 16-17, 2025)

https://ai.qconferences.com/

QCon London 2026 (March 16-19, 2026)

https://qconlondon.com/

The InfoQ Podcasts:

Weekly inspiration to drive innovation and build great teams from senior software leaders. Listen to all our podcasts and read interview transcripts:

- The InfoQ Podcast https://www.infoq.com/podcasts/

- Engineering Culture Podcast by InfoQ https://www.infoq.com/podcasts/#engineering_culture

- Generally AI: https://www.infoq.com/generally-ai-podcast/

Follow InfoQ:

- Mastodon: https://techhub.social/@infoq

- X: https://x.com/InfoQ?from=@

- LinkedIn: https://www.linkedin.com/company/infoq/

- Facebook: https://www.facebook.com/InfoQdotcom#

- Instagram: https://www.instagram.com/infoqdotcom/?hl=en

- Youtube: https://www.youtube.com/infoq

- Bluesky: https://bsky.app/profile/infoq.com

Write for InfoQ: Learn and share the changes and innovations in professional software development.

- Join a community of experts.

- Increase your visibility.

- Grow your career.

https://www.infoq.com/write-for-infoq

In this podcast, InfoQ spoke with Elena Samuylova from Evidently AI, on best practices in evaluating Large Language Model (LLM) based applications. She also discussed the tools for evaluating, testing and monitoring applications powered by AI technologies.

Read a transcript of this interview: https://bit.ly/4mHAKvN

Subscribe to the Software Architects’ Newsletter for your monthly guide to the essential news and experience from industry peers on emerging patterns and technologies:

www.infoq.com/software-architects-newsletter

Upcoming Events:

InfoQ Dev Summit Munich (October 15-16, 2025)

Essential insights on critical software development priorities.

devsummit.infoq.com/conference/munich2025

QCon San Francisco 2025 (November 17-21, 2025)

Get practical inspiration and best practices on emerging software trends directly from senior software developers at early adopter companies.

qconsf.com/

QCon AI New York 2025 (December 16-17, 2025)

ai.qconferences.com/

QCon London 2026 (March 16-19, 2026)

qconlondon.com/

The InfoQ Podcasts:

Weekly inspiration to drive innovation and build great teams from senior software leaders. Listen to all our podcasts and read interview transcripts:

- The InfoQ Podcast www.infoq.com/podcasts/

- Engineering Culture Podcast by InfoQ www.infoq.com/podcasts/#engineering_culture

- Generally AI: www.infoq.com/generally-ai-podcast/

Follow InfoQ:

- Mastodon: techhub.social/@infoq

- X: x.com/InfoQ?from=@

- LinkedIn: www.linkedin.com/company/infoq/

- Facebook: www.facebook.com/InfoQdotcom#

- Instagram: www.instagram.com/infoqdotcom/?hl=en

- Youtube: www.youtube.com/infoq

- Bluesky: bsky.app/profile/infoq.com

Write for InfoQ: Learn and share the changes and innovations in professional software development.

- Join a community of experts.

- Increase your visibility.

- Grow your career.

www.infoq.com/write-for-infoq

Software supply chain veteran Brian Fox unpacks the security implications of the new EU Cyber Resilience Act and its profound impact on open-source projects. He reveals the hidden infrastructure risks threatening open-source projects and shares insights for senior software leaders navigating this regulatory landscape.

Read a transcript of this interview: http://bit.ly/46nxjUM

Subscribe to the Software Architects’ Newsletter for your monthly guide to the essential news and experience from industry peers on emerging patterns and technologies:

https://www.infoq.com/software-architects-newsletter

Upcoming Events:

InfoQ Dev Summit Munich (October 15-16, 2025)

Essential insights on critical software development priorities.

https://devsummit.infoq.com/conference/munich2025

QCon San Francisco 2025 (November 17-21, 2025)

Get practical inspiration and best practices on emerging software trends directly from senior software developers at early adopter companies.

https://qconsf.com/

QCon AI New York 2025 (December 16-17, 2025)

https://ai.qconferences.com/

QCon London 2026 (March 16-19, 2026)

https://qconlondon.com/

The InfoQ Podcasts:

Weekly inspiration to drive innovation and build great teams from senior software leaders. Listen to all our podcasts and read interview transcripts:

- The InfoQ Podcast https://www.infoq.com/podcasts/

- Engineering Culture Podcast by InfoQ https://www.infoq.com/podcasts/#engineering_culture

- Generally AI: https://www.infoq.com/generally-ai-podcast/

Follow InfoQ:

- Mastodon: https://techhub.social/@infoq

- X: https://x.com/InfoQ?from=@

- LinkedIn: https://www.linkedin.com/company/infoq/

- Facebook: https://www.facebook.com/InfoQdotcom#

- Instagram: https://www.instagram.com/infoqdotcom/?hl=en

- Youtube: https://www.youtube.com/infoq

- Bluesky: https://bsky.app/profile/infoq.com

Write for InfoQ: Learn and share the changes and innovations in professional software development.

- Join a community of experts.

- Increase your visibility.

- Grow your career.

https://www.infoq.com/write-for-infoq

In this episode of the podcast, members of the InfoQ editorial staff and friends of InfoQ discuss the current trends in the domain of AI, ML and Data Engineering.

One of the regular features of InfoQ are the trends reports, which each focus on a different aspect of software development. These reports provide the InfoQ readers and listeners with a high-level overview of the topics to pay attention to this year.

InfoQ AI, ML and Data Engineering editorial team met with external guests to discuss the trends in AI and ML areas, and what to watch out for the next 12 months. In addition to the written report and trends graph, this podcast provides a recording of a discussion where expert panelists discuss how innovative AI technologies are disrupting the industry.

Read a transcript of this interview: http://bit.ly/4nRpvlF

Subscribe to the Software Architects’ Newsletter for your monthly guide to the essential news and experience from industry peers on emerging patterns and technologies:

https://www.infoq.com/software-architects-newsletter

Upcoming Events:

InfoQ Dev Summit Munich (October 15-16, 2025)

Essential insights on critical software development priorities.

https://devsummit.infoq.com/conference/munich2025

QCon San Francisco 2025 (November 17-21, 2025)

Get practical inspiration and best practices on emerging software trends directly from senior software developers at early adopter companies.

https://qconsf.com/

QCon AI New York 2025 (December 16-17, 2025)

https://ai.qconferences.com/

QCon London 2026 (March 16-19, 2026)

https://qconlondon.com/

The InfoQ Podcasts:

Weekly inspiration to drive innovation and build great teams from senior software leaders. Listen to all our podcasts and read interview transcripts:

- The InfoQ Podcast https://www.infoq.com/podcasts/

- Engineering Culture Podcast by InfoQ https://www.infoq.com/podcasts/#engineering_culture

- Generally AI: https://www.infoq.com/generally-ai-podcast/

Follow InfoQ:

- Mastodon: https://techhub.social/@infoq

- X: https://x.com/InfoQ?from=@

- LinkedIn: https://www.linkedin.com/company/infoq/

- Facebook: https://www.facebook.com/InfoQdotcom#

- Instagram: https://www.instagram.com/infoqdotcom/?hl=en

- Youtube: https://www.youtube.com/infoq

- Bluesky: https://bsky.app/profile/infoq.com

Write for InfoQ: Learn and share the changes and innovations in professional software development.

- Join a community of experts.

- Increase your visibility.

- Grow your career.

https://www.infoq.com/write-for-infoq