Prayson Daniel, a principle data scientist, discusses testing machine learning pipelines with pytest.

Prayson is using pytest for some pretty cool stuff, including:

• unit tests, of course
• testing pipeline stages
• counterfactual testing
• performance testing

All with pytest. So cool.

Special Guest: Prayson Daniel.

Links:

• Python Bytes 250, with Prayson Daniel — Listen to this for more of an introduction to Prayson

Sponsored by: 

• The Complete pytest course is now a bundle, with each part available separately.
  • pytest Primary Power teaches the super powers of pytest that you need to learn to use pytest effectively.
  • Using pytest with Projects has lots of "when you need it" sections like debugging failed tests, mocking, testing strategy, and CI
  • Then pytest Booster Rockets can help with advanced parametrization and building plugins.
• Whether you need to get started with pytest today, or want to power up your pytest skills, PythonTest has a course for you.

Performance monitoring and error detection is just as important with services and microservices as with any system, but with added complexity. Omri Sass joins the show to explain telemetry and monitoring of services and of systems with services. 

Special Guest: Omri Sass.

Sponsored by: 

• The Complete pytest course is now a bundle, with each part available separately.
  • pytest Primary Power teaches the super powers of pytest that you need to learn to use pytest effectively.
  • Using pytest with Projects has lots of "when you need it" sections like debugging failed tests, mocking, testing strategy, and CI
  • Then pytest Booster Rockets can help with advanced parametrization and building plugins.
• Whether you need to get started with pytest today, or want to power up your pytest skills, PythonTest has a course for you.

To understand complex code, it can be helpful to remove abstractions, even if it results in larger functions. This episode walks through a process I use to refactor code that I need to debug and fix, but don't completely understand.

Sponsored by: 

• The Complete pytest course is now a bundle, with each part available separately.
  • pytest Primary Power teaches the super powers of pytest that you need to learn to use pytest effectively.
  • Using pytest with Projects has lots of "when you need it" sections like debugging failed tests, mocking, testing strategy, and CI
  • Then pytest Booster Rockets can help with advanced parametrization and building plugins.
• Whether you need to get started with pytest today, or want to power up your pytest skills, PythonTest has a course for you.

Paul has a tutorial on testing and TDD with React and TypeScript. 
 We discuss workflow and the differences, similarities between testing with React/TypeScript and Python.
 We also discuss what lessons that we can bring from front end testing to Python testing.

Special Guest: Paul Everitt.

Links:

• React, TypeScript, and TDD — Paul Everitt's tutorial
• React Testing Library

Sponsored by: 

• The Complete pytest course is now a bundle, with each part available separately.
  • pytest Primary Power teaches the super powers of pytest that you need to learn to use pytest effectively.
  • Using pytest with Projects has lots of "when you need it" sections like debugging failed tests, mocking, testing strategy, and CI
  • Then pytest Booster Rockets can help with advanced parametrization and building plugins.
• Whether you need to get started with pytest today, or want to power up your pytest skills, PythonTest has a course for you.

xfail isn't just for pytest tests. Python's unittest has @unittest.expectedFailure.

In this episode, we cover:

• using @unittest.expectedFailure
• the results of passing and failing tests with expectedFailure
• using pytest as a test runner for unittest
• using pytest markers on unittest tests

Docs for expectedFailure:
 https://docs.python.org/3/library/unittest.html#skipping-tests-and-expected-failures

Some sample code. 
 unittest only:

unittest with pytest markers:

Sponsored by: 

• The Complete pytest course is now a bundle, with each part available separately.
  • pytest Primary Power teaches the super powers of pytest that you need to learn to use pytest effectively.
  • Using pytest with Projects has lots of "when you need it" sections like debugging failed tests, mocking, testing strategy, and CI
  • Then pytest Booster Rockets can help with advanced parametrization and building plugins.
• Whether you need to get started with pytest today, or want to power up your pytest skills, PythonTest has a course for you.

A discussion of how to use the xfail feature of pytest to help with communication on software projects.

The episode covers:

• What is xfail
• Why I use it
• Using reason effectively by including issue tracking numbers
• Using xfail_strict
• Adding --runxfail when transitioning from development to feature freeze
• What to do about test failures
• How all of this might help with team communication

Sponsored by: 

• The Complete pytest course is now a bundle, with each part available separately.
  • pytest Primary Power teaches the super powers of pytest that you need to learn to use pytest effectively.
  • Using pytest with Projects has lots of "when you need it" sections like debugging failed tests, mocking, testing strategy, and CI
  • Then pytest Booster Rockets can help with advanced parametrization and building plugins.
• Whether you need to get started with pytest today, or want to power up your pytest skills, PythonTest has a course for you.

An overview of the pytest flags that help with debugging.
 From Chapter 13, Debugging Test Failures, of Python Testing with pytest, 2nd edition.

pytest includes quite a few command-line flags that are useful for debugging. 

We talk about thes flags in this episode.

Flags for selecting which tests to run, in which order, and when to stop:

• -lf / --last-failed: Runs just the tests that failed last.
• -ff / --failed-failed: Runs all the tests, starting with the last failed.
• -x / --exitfirst: Stops the tests session afterEd: after?Author: yep the first failure.
• --maxfail=num: Stops the tests after num failures.
• -nf / --new-first: Runs all the tests, ordered by file modification time.
• --sw / --stepwise: Stops the tests at the first failure. Starts the tests at the last failure next time.
• --sw-skip / --stepwise-skip: Same as --sw, but skips the first failure.

Flags to control pytest output:

• -v / --verbose Displays all the test names, passing or failing.
• --tb=[auto/long/short/line/native/no] Controls the traceback style.
• -l / --showlocals Displays local variables alongside the stacktrace.

Flags to start a command-line debugger:

• --pdb Starts an interactive debugging session at the point of failure.
• --trace Starts the pdb source-code debugger immediately when running each test.
• --pdbcls Uses alternatives to pdb, such as IPython’s debugger with –-pdbcls=IPython.terminal.debugger:TerminalPdb.

This list is also found in Chapter 13 of Python Testing with pytest, 2nd edition.
The chapter is "Debugging Test Failures" and covers way more than just debug flags, while walking through debugging 2 test failures.

Links:

• Python Testing with pytest — The fastest way to get up to speed on pytest.
• all pytest flags in pytest 6.2.x

Sponsored by: 

• The Complete pytest course is now a bundle, with each part available separately.
  • pytest Primary Power teaches the super powers of pytest that you need to learn to use pytest effectively.
  • Using pytest with Projects has lots of "when you need it" sections like debugging failed tests, mocking, testing strategy, and CI
  • Then pytest Booster Rockets can help with advanced parametrization and building plugins.
• Whether you need to get started with pytest today, or want to power up your pytest skills, PythonTest has a course for you.

pip : "pip installs packages" or maybe "Package Installer for Python"
 pip is an invaluable tool when developing with Python.
 A lot of people know pip as a way to install third party packages from pypi.org
 You can also use pip to install from other indexes (or is it indices?)

You can also use pip to install a package in a local directory.
 That's the part I want to jump in and explore with Stéphane Bidoul.
 The way pip installs from a local directory is about to change, and the story is fascinating.

Special Guest: Stéphane Bidoul.

Links:

• The Odoo Community Association
• PEP 610 -- Recording the Direct URL Origin of installed distributions | Python.org
• PEP 660 -- Editable installs for pyproject.toml based builds (wheel based) | Python.org — Bidoul
• pip install --no-index --find-links 
• Solving issues related to out-of-tree builds · Issue #7555 · pypa/pip
• pip list json format

Sponsored by: 

• The Complete pytest course is now a bundle, with each part available separately.
  • pytest Primary Power teaches the super powers of pytest that you need to learn to use pytest effectively.
  • Using pytest with Projects has lots of "when you need it" sections like debugging failed tests, mocking, testing strategy, and CI
  • Then pytest Booster Rockets can help with advanced parametrization and building plugins.
• Whether you need to get started with pytest today, or want to power up your pytest skills, PythonTest has a course for you.

What flavor of TDD do you practice?

In this episode we talk about:

This is definitely an episode I'd like feedback on. Reach out to me @brianokken or via the contact form for further questions or if I missed some crucial variant of TDD that you know and love.

Full Transcript

Sponsored By:

• PyCharm Professional: Try PyCharm Pro for 4 months and learn how PyCharm will save you time. Promo Code: TESTANDCODE22

Links:

• Mocks Aren't Stubs - Martin Fowler
• Mockists Are Dead. Long Live Classicists.
• Double Loop TDD
• BDD: Behavior-driven development
• FDD: Feature-driven development
• My reaction to “Is TDD Dead?” - pythontest.com
• Test First Programming / Test First Development
• Humorous list of TDD variants — BDD = Buzzword Driven Development, CDD = Calendar Driven Development, etc

Software development processes create value, and have waste, in the Lean sense of the word waste.

I'm going to use the term waste and value in future episodes. I'm using waste in a Lean sense, so we can look at software processes critically, see the value chain, and try to reduce waste.

Lean manufacturing and lean software development caused people to talk about and examine waste and value, even in fields where we didn't really think about waste that much to begin with.

Software is just ones and zeros. Is there waste?

The mistake I'm making here is confusing the common English definition of waste when what we're talking about is the Lean definition of waste.

This episode tries to clear up the confusion.

Full Transcript

Links:

• Big Design Up Front
• Lightweight Methodologies
• Manifesto for Agile Software Development
• Extreme programming
• The New Methodology
• Test First Programming / Test First Development
• Test Driven Development
• The Pragmatic Programmer
• Six Sigma
• DMAIC
• Lean software development
• Lean manufacturing
• The Toyota Way
• Lean Six Sigma
• Definition of Waste by Merriam-Webster