Ticket #5774 defect new
trial randomize doesn't seem to work on test module names
|Reported by:||cyli||Owned by:|
Related to #5520 - in an attempt to get it my two test cases to run in an order I want, I attempt to run two test modules with various random seeds. The result of which is that the two modules always ran in the same order, and not the order that I wanted.
trial -z 0 first_test_module.py second_test_module.py
The TestCases inside the modules were run in a randomized order, as well as the individual tests, but the modules themselves were never randomized.
I ran this command on the two attached files over and over for 5 minutes, and the order the modules were run never changed. While it is remotely possible for this to happen, the probability is exceedingly low.