Reordering unit tests in Python

Question

How can I do this so that unit tests in Python (using unittest ) run in the order they are listed in the file?

Answer 1

You can change the default sort behavior by setting a custom comparison function. In unittest.py you can find the class variable unittest.TestLoader.sortTestMethodsUsing , which is set to the built-in cmp function by default.

For example, you can return the order of execution of your tests by doing the following:

 import unittest unittest.TestLoader.sortTestMethodsUsing = lambda _, x, y: cmp(y, x) 

Answer 2

Clever naming.

 class Test01_Run_Me_First( unittest.TestCase ): def test010_do_this( self ): assertTrue( True ) def test020_do_that( self ): etc. 

One way to enforce a specific order.

Answer 3

As stated above, usually tests in test cases should be tested in any (i.e. random) order.

However, if you want to order tests in a test case, this is apparently not trivial. Tests (method names) are extracted from test cases using dir(MyTest) , which returns a sorted list of participants. You can use smart (?) Hacks to sort methods by their line numbers. This will work for one test case:

 if __name__ == "__main__": loader = unittest.TestLoader() ln = lambda f: getattr(MyTestCase, f).im_func.func_code.co_firstlineno lncmp = lambda a, b: cmp(ln(a), ln(b)) loader.sortTestMethodsUsing = lncmp unittest.main(testLoader=loader, verbosity=2) 

Answer 4

There are also test videos that do it themselves - I think py.test does it.

Answer 5

Use the proboscis library, as I mentioned (see brief description there).

Answer 6

I found a solution for it using the PyTest order plugin provided here .

Try py.test YourModuleName.py -vv in the CLI and the test will work in the order in which they appeared in your module.

I did the same and worked great for me.

Note. You need to install the PyTest package and import it.