128: pytest-randomly - Adam Johnson

Software tests should be order independent. That means you should be able to run them in any order or run them in isolation and get the same result.

However, system state often gets in the way and order dependence can creep into a test suite.
One way to fight against order dependence is to randomize test order, and with pytest, we recommend the plugin pytest-randomly to do that for you.

The developer that started pytest-randomly and continues to support it is Adam Johnson, who joins us today to discuss pytest-randomly and another plugin he also wrote, called pytest-reverse.

Special Guest: Adam Johnson.

Sponsored By:

• HoneyBadger: When bad things happen, it's nice to know that Honeybadger has your back. 30% off for first 6 months when you mention Test & Code Podcast when signing up.
• PyCharm Professional: Try PyCharm Pro for 4 months and learn how PyCharm will save you time. Promo Code: TESTANDCODE22
• Talk Python Training: Online video courses for Python developers

Links:

• pytest-randomly: pytest plugin to randomly order tests and control random.seed
• pytest-reverse: pytest plugin to reverse test order.
• Empirically revisiting the test independence assumption
• pytest-xdist
• factory_boy
• Faker
• NumPy
• Hyrum's Law