Test Case Scenario

Send a text

Can your software handle the pressure when bugs slip through the cracks?

In this episode of Test Case Scenario, Jason Baum and Evelyn Coleman chat with Mac Clark, Senior Solutions Engineer at Sauce Labs, about the dynamic world of shift-left and shift-right testing. Mac shares how gaming and software industries leverage AI-driven testing, real-time error monitoring, and feature flags to catch issues before they snowball into costly problems in production.

You’ll also learn the hidden risks of neglecting continuous testing and how to protect your brand’s reputation by balancing proactive and reactive testing strategies.

Join us as we discuss: 

(00:00) Introduction

(01:12) Shift-right testing v. shift-left testing

(03:32) The role of error reporting in continuous quality

(06:50) Balancing shift-left and shift-right without cutting corners

(10:06) Using AI-driven testing to reduce developer crunch

(13:46) How Backtrace and real-time error monitoring can save production

(17:48) Crash and error reporting in gaming

(20:41) Avoiding alert fatigue and prioritizing critical errors

(24:01) Scaling error monitoring for large-scale software releases

(27:56) Lightning round

We’d love to hear from you! Share your thoughts in the comments below or at [email protected].

SUBSCRIBE and visit us at https://saucelabs.com/community to dig into the power of testing in software development.

Sign up for a free account and start running tests today at https://saucelabs.com/. 

▶ Sauce YouTube channel:  / saucelabs  

💡 LinkedIn:  / sauce-labs  

🐦 X: / saucelabs

Send a text

What’s the secret to optimizing your test suite without sacrificing quality?

In this episode of Test Case Scenario, Jason Baum and Evelyn Coleman are joined by Titus Fortner, Senior Developer Experience Engineer at Sauce Labs, to discuss strategies for improving CI pipelines, tackling test flakiness, and using analytics to streamline the testing process. 

Get insights on how Sauce Labs prioritizes speed, coverage, and reliability in large-scale testing across multiple environments. You’ll also learn real-world solutions to help teams stay agile while ensuring software quality.

Join us as we discuss: 

(00:00) Introduction

(02:33) Scenario 1: Dealing with a slow CI pipeline caused by too many tests

(05:27) Scenario 2: Sorting always-failing vs. intermittently-failing tests using analytics

(07:10) Scenario 3: Managing a critical bug in production and prioritizing tests

(12:19) Scenario 4: Prioritizing test cases for feature rollouts across regions

(17:49) Scenario 5: Using analytics to track real-time performance issues across regions

(22:45) Scenario 6: Using data analytics in day-to-day testing and uncovering hidden pitfalls

(26:25) Titus’ advice for QA managers and the evolving role of testing

We’d love to hear from you! Share your thoughts in the comments below or at [email protected].

SUBSCRIBE and visit us at https://saucelabs.com/community to dig into the power of testing in software development.

Sign up for a free account and start running tests today at https://saucelabs.com/. 

▶ Sauce YouTube channel:  / saucelabs  

💡 LinkedIn:  / sauce-labs  

🐦 X: / saucelabs

Send a text

Continuous testing isn't just about automation—it's about strategy, feedback, and getting your team unstuck.

In today’s episode, Jason Baum and Marcus Merrell are joined by former co-host, Evelyn Coleman, to welcome Marc Hornbeek on the show. If you’re not familiar with Marc, he’s a legend in the world of DevOps. The author of “Continuous Testing, Quality Security and Feedback,” and CEO and Principal Consultant of Engineering DevOps Consulting, he knows what it takes to succeed in the industry.

Marc draws from decades of hands-on experience to highlight the crucial role of continuous testing and feedback in accelerating an organization's journey to DevOps maturity. He also shares the inspiration behind his latest book and offers actionable strategies for overcoming common roadblocks and advancing testing and DevOps practices.

Join us as we discuss:

(00:00) Introduction

(03:30) The feedback aspects of DevOps

(06:55) Challenges organizations face when scaling DevOps

(10:45) The evolution of testing in DevOps

(14:44) Understanding the role of QA in complex products

(19:20) Practical strategies for continuous testing and feedback

(22:51) The uses and misuses of Gen AI in testing

(28:18) The AI blueprint for continuous testing

(31:13) Emerging trends in continuous testing and automation

(36:05) Preview of Marc’s next book on AI-assisted security


We’d love to hear from you! Share your thoughts in the comments below or at [email protected].

SUBSCRIBE and visit us at https://saucelabs.com/community to dig into the power of testing in software development.

Sign up for a free account and start running tests today at https://saucelabs.com/. 

▶ Sauce YouTube channel:  / saucelabs  

💡 LinkedIn:  / sauce-labs  

🐦 X: / saucelabs

Send a text

AI is here, but does that mean the end of QA as we know it? 

In this episode of Test Case Scenario, Jason Baum and Marcus Merrell are joined by Jenna Charlton, a QA Testing Expert and Product Manager. With AI and automation transforming the industry, Jenna shares how these technologies are reshaping QA roles and what testers can do to stay ahead in a rapidly changing job market.

Jenna also shares her thoughts on why manual testers still matter, the value of specialization in QA, and how leaders can ensure their teams are equipped for the future. You’ll also hear insights on balancing human expertise with automation and why QA needs to take a bigger seat at the decision-making table.

Join us as we discuss:

(00:00) Intro

(02:10) The state of the QA job market and layoffs

(07:45) Crowstrike incident and taking quality for granted

(11:00) How QA has evolved and the shift in skills over the last decade

(19:37) Strategies for building agile and adaptable QA teams

(21:58) Impact of remote work and global collaboration on QA hiring

(23:13) Importance of security in QA processes

(31:20) Predictions for the future of QA and industry trends

(34:11) The importance of junior testers and their role in QA teams

We’d love to hear from you! Share your thoughts in the comments below or at [email protected].

SUBSCRIBE and visit us at https://saucelabs.com/community to dig into the power of testing in software development.

Sign up for a free account and start running tests today at https://saucelabs.com/. 

▶ Sauce YouTube channel:  / saucelabs  

💡 LinkedIn:  / sauce-labs  

🐦 X: / saucelabs

Send a text

How do you ensure your software system is reliable from design to deployment?

In this episode of Test Case Scenario, Jason Baum and Evelyn Coleman sit down with Saurabh Shanbhag, Software Engineer at DoorDash, to discuss the best approaches for preventing bugs and building reliable systems. Saurabh draws on his experience from Amazon, Uber, and DoorDash to explain how teams can focus on strong initial design, thorough testing, and smart monitoring to keep systems running smoothly.

Discover how DoorDash tackles system design, automated testing, and performance monitoring to identify potential issues early on. Saurabh also shares how they balance speed and quality as they scale and how to respond quickly when problems arise.

Join us as we discuss: 

(00:00) Intro

(02:24) Catching bugs before they reach production

(04:11) How teamwork can stop bugs early in the process

(07:31) Why both automation and manual testing are needed 

(11:25) Avoiding over-engineering while planning for future issues

(16:50) Balancing speed and reliability in software development

(23:22) How DoorDash monitors and tests in the development process

(29:16) Top 5 ways to ensure a reliable software system

We’d love to hear from you! Share your thoughts in the comments below or at [email protected].

SUBSCRIBE and visit us at https://saucelabs.com/community to dig into the power of testing in software development.

Sign up for a free account and start running tests today at https://saucelabs.com/. 

▶ Sauce YouTube channel:  / saucelabs  

💡 LinkedIn:  / sauce-labs  

🐦 X: / saucelabs

Send a text

In an industry where speed is everything, manual testing alone may not cut it.

In this episode, Jason Baum and Marcus Merrell are joined by Allen Loew, Principal Quality Engineer at Progressive Leasing, to discuss the changing roles of testers and why automation is no longer optional. 

Allen shares his experiences with the transition from manual to automated testing, offering insights on the best balance between the two approaches. You'll also hear about the value of exploratory testing, the impact of automation on scalability, and how QA teams can thrive by embracing new tools and practices.

Join us as we discuss: 

(00:00) The shift away from manual testing
(02:40) The evolution of automation and testing tools
(07:10) Challenges with early automation tools
(09:10) Scaling testing efforts through automation
(13:33) The decline of manual testing in today’s industry
(15:44) Balancing manual and automated testing
(18:50) Improving collaboration between testers and developers
(22:18) Real-world Black Friday testing and lessons learned

We’d love to hear from you! Share your thoughts in the comments below or at [email protected].

SUBSCRIBE and visit us at https://saucelabs.com/community to dig into the power of testing in software development.

Sign up for a free account and start running tests today at https://saucelabs.com/. 

▶ Sauce YouTube channel:  / saucelabs  

💡 LinkedIn:  / sauce-labs  

🐦 X: / saucelabs

Send a text

What does accessibility mean for your business, and how can you prepare for the upcoming changes?

In this episode, Jason Baum and Marcus Merrell are joined by AmyJune Hineline from the Linux Foundation to discuss the upcoming European Accessibility Act and how it will shape the future of digital products. With the deadline approaching in 2025, they cover what steps companies should take to ensure their platforms are accessible to everyone.

You’ll hear AmyJune’s experiences advocating for the deaf and hard-of-hearing community and learn about the impact of accessibility on user experience and business outcomes. She also shares the benefits of inclusive design, real user testing, and the potential consequences for businesses that don’t comply with the new regulations. 

Join us as we discuss: 

(00:00) The role of accessibility in tech

(03:30) The European Accessibility Act 

(06:20) Accessibility for all users

(10:30) Defining disabilities in the digital world 

(12:30) Standards and compliance challenges 

(15:50) How accessibility opens new markets and boosts customer loyalty

(17:50) The importance of real-world user testing for accessibility

(20:00) Shifting company culture towards accessibility integration

(25:20) Enforcement of accessibility laws and the future of compliance

We’d love to hear from you! Share your thoughts in the comments below or at [email protected].

SUBSCRIBE and visit us at https://saucelabs.com/community to dig into the power of testing in software development.

Sign up for a free account and start running tests today at https://saucelabs.com/. 

▶ Sauce YouTube channel:  / saucelabs  

💡 LinkedIn:  / sauce-labs  

🐦 X: / saucelabs

Send a text

When software fails, what does it actually cost?

In this episode, Jason Baum and Marcus Merrell are joined by Veronika Takmazyan, Senior Manager of Quality Engineering at Salesforce, and Chris Wallander, Principal SDET and Test Automation Architect at Taxwell, to tackle the complex issue of ensuring quality across the Software Development Life Cycle (SDLC). 

Throughout the conversation, they touch on the importance of integrating testing at every stage of development and why quality must be a shared responsibility. You’ll also learn the practical challenges teams face when quality is not prioritized from the start, and how continuous testing can mitigate costly software failures. 

Join us as we discuss: 

(00:00) Intro

(04:09) What are the costs of software failures?

(10:45) Why is it so challenging to produce quality software?

(15:27) Whose responsibility is quality?

(19:08) Is there a need for a Chief Quality Officer?

(22:42) Why integrate test across the SDLC?

(28:00) Balancing developer workloads and quality assurance

(05:05) How to navigate the complexities of automation

(10:28) Balancing the drive for quality with the need for simplicity in CI/CD

(16:01) The role of AI in software development

(18:48) The impact of speed vs. quality 

(22:26) The breaking point for when speed overtakes quality

(26:41) Handling high traffic at Indeed and addressing technical debt

We’d love to hear from you! Share your thoughts in the comments below or at [email protected].

SUBSCRIBE and visit us at https://saucelabs.com/community to dig into the power of testing in software development.

Sign up for a free account and start running tests today at https://saucelabs.com/. 

▶ Sauce YouTube channel:  / saucelabs  

💡 LinkedIn:  / sauce-labs  

🐦 X: / saucelabs

Send a text

What does it really mean to shift left, and are we overburdening our developers in the process?

In this episode, Jason Baum, Marcus Merrell, and Evelyn Coleman sit down with David Morgenthaler, a Software Engineering Manager at Indeed, to explore the real-world implications of shift-left testing. Together, they dissect the challenges of integrating continuous quality into CI/CD workflows and the potential pitfalls of placing more responsibility on developers' shoulders.

You’ll learn how tools like static analysis and AI are reshaping the software testing landscape, and whether they truly simplify or complicate the developer's day-to-day. With practical examples, they examine the fine balance between speed and quality in software delivery. Listen to discover how Indeed is navigating these challenges and what it means for the future of software testing.

Join us as we discuss: 

(00:00) Continuous quality from theory to practice

(03:21) How shift left is changing development

(05:05) How to navigate the complexities of automation

(10:28) Balancing the drive for quality with the need for simplicity in CI/CD

(16:01) The role of AI in software development

(18:48) The impact of speed vs. quality 

(22:26) The breaking point for when speed overtakes quality

(26:41) Handling high traffic at Indeed and addressing technical debt

We’d love to hear from you! Share your thoughts in the comments below or at [email protected].

SUBSCRIBE and visit us at https://saucelabs.com/community to dig into the power of testing in software development.

Sign up for a free account and start running tests today at https://saucelabs.com/. 

▶ Sauce YouTube channel:  / saucelabs  

💡 LinkedIn:  / sauce-labs  

🐦 X: / saucelabs

Send a text

Struggling to keep up with the relentless stream of notifications? You're not alone.
 
In this episode of Test Case Scenario, Jason Baum and Marcus Merrell explore the impact of alert fatigue and signal overload on productivity and quality.

You’ll hear them draw from their own experiences and share real-world stories to highlight how constant alerts can disrupt workflow. They offer practical strategies to cut through the noise and focus on what’s important. Throughout the conversation, they also examine the delicate balance between meeting tight deadlines and maintaining high standards and how software quality directly affects customer satisfaction.

Join us for an insightful and lively conversation filled with tips to help you manage the chaos of software development and testing, ensuring you stay efficient and keep your standards high.

Want more content on signal fatigue? Check out this article from Jason: https://thenewstack.io/overcoming-software-testing-alert-fatigue/ 

Join us as we discuss: 
(00:00) Intro
(02:08) Alert fatigue and its impact on productivity
(04:07) How constant alerts disrupt workflow
(07:15) Strategies for managing and reducing unnecessary notifications
(10:20) Balancing tight deadlines with maintaining quality
(12:55) Affects of poor software quality on customer satisfaction
(15:35) Effective alert management practices 
(19:50) Actionable tips for developers and testers

We’d love to hear from you! Share your thoughts in the comments below or at [email protected].

SUBSCRIBE and visit us at https://saucelabs.com/community to dig into the power of testing in software development.

Sign up for a free account and start running tests today at https://saucelabs.com/. 

▶ Sauce YouTube channel:  / saucelabs  

💡 LinkedIn:  / sauce-labs  

🐦 X: / saucelabs