TestGuild Automation Podcast

In today's episode, we're thrilled to have Tobias Müller, a software development veteran and an expert in autonomous software testing. With over a decade of experience in the field, Tobias brings a wealth of knowledge, especially from his work with TestResults IO, where he delves into the AI-driven aspects of testing.

Join us as Tobias debunks common myths surrounding autonomous software testing. He clarifies the often misunderstood differences between automated and autonomous testing and expresses a healthy skepticism about the current capabilities of fully autonomous tools. Despite the challenges, Tobias sees a promising future where autonomous testing could significantly ease the testing process by harnessing vast data pools and sophisticated learning models.

We delve into the dynamic nature of the testing landscape. We advocate for a synergy between human proficiency and AI to enhance testing efficiency without completely replacing the human element. We delve into the potential and limitations of AI in testing, underlining the crucial role of human oversight in decision-making processes.

Be one of the first to discover how to automate non-automatable applications: https://links.testguild.com/Z6PFe

Today, Dan Belcher, co-founder of Mabl and a former product manager for monitoring and logging at Google, joins us as we explore the cutting-edge intersection of AI and mobile test automation.

We'll delve into the growing trend of AI testing in business and discuss the critical switch from deterministic to non-deterministic testing protocols when dealing with AI language models.

Get ready for an exciting announcement as Dan unveils the launch of Mabl for mobile. This groundbreaking tool will empower practitioners to validate their iOS and Android apps with unprecedented efficacy, revolutionizing how we approach mobile testing.

Plus, we'll tackle the pressing questions about the shift from custom frameworks to vendor-based solutions, the increasing need for testing from the user's perspective, and the potential roles AI could play in optimizing the end-user experience.

So, charge up your headphones and prepare for a deep dive into how AI's ability to understand context reshapes test automation.

To see AI with Mobile in action, make sure to check out now: https://links.testguild.com/ul45X

Welcome to the TestGuild Automation Podcast! I'm your host, Joe Colantonio, and Jon Robinson, chief storyteller at Nekst IT, ready to delve deep into the automation testing world. In today's episode, "The Four Phases of Automation Testing Mastery," we'll debunk the myth that automation is a cure-all solution and explore the intricacies and careful planning needed to succeed in test automation.

Join us as we discuss practical strategic approaches including the 4-phase model—Discovery, Design, Develop, Deliver—and the importance of a maturity model to ensure your automation aligns with CI/CD integration. We'll highlight how automation serves as the backbone for regression testing, providing substantial long-term benefits and how pushing it later in the development process can minimize rework and costs.

We'll tackle the challenges of test management in an agile world, and Jon will share his insights on the importance of storytelling in QA and how it can revolutionize how we test and communicate the value of our work. Expect actionable tips on avoiding common pitfalls and why focusing on real-world impacts and user perspectives can significantly improve your automation efforts.

Prepare to elevate your testing strategy and learn why quality should be the focus rather than just hitting metrics. Tune in as we explore practical insights and real-life experiences that will empower you to enhance the success of your automation testing projects!

In today's episode, we are excited to feature the incredible insights of Bas Dijkstra, an independent test automation consultant and trainer with a wealth of experience spanning 17 years in the field.

Bas joins us to share his journey in developing restassured.net, a much-needed library for HTTP API testing in C#, inspired by his fondness for RestAssured and its absence in the C# arena.

We'll explore not just Bas's innovations but his comprehensive take on the evolution of API testing, spotlighting the persistent issue of superficial testing due to various industry pressures and the triumphs of more accessible tooling. We'll explore why Bas favors code-based solutions like RestAssured.Net for scaling and integration over tools like Postman regarding API testing.

Furthermore, Bas will shed light on the rising interest in Playwright – a modern automation tool he believes overcomes many of the limitations of Selenium through features like auto-waiting and synchronization. We'll delve into the importance of context when selecting testing tools and why Bas advocates for workshop-based learning as a practical and empowering approach to introduce teams to Playwright.

So, whether you're a seasoned professional or new to the field, join us to delve into the ever-evolving landscape of testing automation. Discover practical skills and mindsets to elevate your testing strategies. This is the TestGuild Automation Podcast, and today's episode is a must-listen for all testing professionals!

Today, we're diving into the future of user story optimization and the art of turning those stories into actionable tests.

Today, we have the privilege of being joined by Scott Aziz, the visionary founder of AgileAI Labs and a renowned BDD expert. We are also accompanied by John Smart, the creator of the Serenity framework, whose expertise in BDD is unparalleled. Together, we will delve into the powerful capabilities of the new AI tool Spec2test.

Imagine a tool so refined that it not only assesses your user stories for ambiguities using an intricate 7-point framework but also offers AI-generated suggestions to enhance them.

That's not all; Scott Aziz and BDD expert John Smart join us to discuss how Spec2test fosters essential iterative collaboration, paving the way for crisp, clear requirements and generating corresponding test cases right from the get-go.

This is not just about meeting the standards of behavior-driven development; it's about exceeding them. With the tool's dual-edged sword of user story analysis and sophisticated testing capabilities—spanning functional test cases to security testing advice—you're getting a comprehensive suite that breathes life into automation.

Surprised by AI's prowess in reshaping agile teams' productivity, our guests reveal how Spec2test is a co-pilot in requirements discovery. For enthusiasts who want a taste of its power, a visual demonstration or free trial could be your gateway to appreciating its full potential.

So, gear up for an illuminating session on bringing precision and collaboration to the forefront of your testing strategies -- listen up!

I'm thrilled to have two titans in software testing, Matt Heusser and Michael Larsen, with us today. These veterans, with their wealth of experience and knowledge, are here to discuss their latest contribution to the testing community, their new book, "Software Testing Strategies."

In today's episode, we will unpack the inspiration behind "Software Testing Strategies," exploring the trio of testing essentials: skills, strategy, and the nuances of day-to-day operations, including the politics that intertwine with the testing process. The authors will discuss their approach to addressing the complexities of software testing, finding the most effective tests among endless possibilities, and how their book aims to guide you through these challenges.

Matt and Michael will also share critical insights into organizational dynamics, the value of adaptability in the testing realm, and the ethical considerations professionals face in their careers. Plus, we'll touch on the difficult journey of updating outdated systems, navigating the minefield of communication, and why terms like "QA" may need a rethink.

Listeners, you're in for a treat, with real-world stories, practical advice, and invaluable expertise that's just a discount code away – so stay tuned as we dive into the world of "Software Testing Strategies" on the TestGuild Automation Podcast.

Today's special episode, "Robocon Recapp," is about the insights and highlights from Robocon 2024. We are privileged to have Tatu Aalto, a renowned maintainer of the browser library; Frank Van der Kuur, a distinguished Robot Framework trainer from BQA; and Mark Moberts, a well-known figure in the Robot Framework community, with us.

In this episode, our guests will explore the enriching experiences of the conference—from the unveiling of the Market Square to the engaging sessions that sparked valuable discussions. We will explore the myriad contributions beyond programming, including documentation, testing, and being an active voice in the community through forums like the RobotFramework Slack channel.

Throughout the Robocon, the spirit of collaboration and knowledge exchange was not just evident. Still, it was the driving force - whether it was addressing pitfalls in the framework, swapping tips on finding the right testing library, or even discussing Frank's and Tatu's interactive sessions that went beyond expectations with engaging questions and the impact they left on the audience.

Get ready to be immersed in a conversation that not only recaps the energy and learning from Robocon but also showcases how the Robot Framework community is driving the future of test automation. So plug in as we dive into everything Robot Framework with insights from the experts at the forefront of the automation world. Listen up!

Today, we're diving deep into the world of automation testing, with a special focus on Netflix's innovative tool, SafeTest. Joining us is Moshe Kolodny, the senior full-stack engineer at Netflix who is behind this exciting new tool, which is bridging the gap between end-to-end and unit testing.

SafeTest, a tool that's been making significant strides in the industry, has garnered widespread community support and impressive traction in a remarkably short time. As we delve into its capabilities, we'll discover how SafeTest seamlessly integrates with popular libraries like Playwright and Jest, offering robust testing capabilities without imposing intrusive dependencies.

Moshe will delve into the philosophy behind SafeTest, underlining the importance of practical, iterative test writing and the pitfalls of over-engineering. We'll explore SafeTest's adaptability, which ensures test consistency across environments with Docker mode, and the bidirectional communication it enables between browser and Node.js, enhancing the overall testing experience.

Our conversation will shed light on the exciting future of SafeTest, from potential additions to the test runner to the introduction of custom reporting features. Moshe will also underscore the tool's commitment to developer experience, exemplified by SafeTest's debugging aids like videos and trace viewers.

It's no secret that SafeTest reflects Netflix's robust approach to quality assurance. It aligns closely with the day-to-day experiences of UI engineers and addresses the intricate challenges of complex user interactions and service integrations.

Stay tuned as we unpack the story of SafeTest's inception, core features, practical applications, and why Moshe believes it's a versatile choice for most testing scenarios.

In this episode, we're diving deep into the world of performance engineering with our esteemed guest, Dylan van Iersel, an experienced IT consultant and co-founder of Perfana. We'll explore the intricate relationship between software performance and business outcomes and how tools like Perfana can democratize and simplify the process of performance testing.

Performance is more than just a technical concern; it has direct implications for customer satisfaction and the bottom line. Dylan illuminates the importance of integrating performance testing within the CI/CD pipeline, using Perfana to serve as a quality gate and provide actionable insights through automated analysis and dashboard visualizations.

We'll also discuss the evolution of performance engineering in a cloud-native, containerized landscape, the challenges of scaling performance testing across agile teams, and why the "shift left" approach in identifying issues early is crucial for today's development processes.

For teams looking to embrace performance testing, Dylan introduces Perfana's starter package and emphasizes the ease of getting up and running, even on a local laptop, as a foundation for more extensive integration into test environments and CI/CD pipelines.

For our listeners interested in cutting-edge developments, we dive into how Perfana innovates with data science and machine learning to enhance anomaly detection and root cause analysis. Plus, we'll get into the nitty-gritty of why observability, while important, shouldn't be your sole resource for performance testing.

Listen to discover actionable advice and insights on improving your team's performance engineering efforts if you want to learn more about Perfana to try their free trial now!

In this episode, Dave Piacente, a senior community manager in developer relations and community expert at Applitools, joins us to talk about redefining test automation.

There are a common set of techniques seasoned test automation practitioners know to be the pillars of any successful automated testing practice that can fit into most (if not all) team contexts.

But some things have either been left out or are described in ways that are disadvantageous for the industry simply because we need to talk about it from the perspective of the fundamentals used to craft them.

By reasoning from first principles, we can unearth a more impactful definition of test automation that can act as a compass and help supercharge everyone's test automation practice - while also understanding how to navigate the uncharted waters of new technologies that challenge existing paradigms.