Opened 5 years ago

Last modified 5 years ago

#5774 defect new

trial randomize doesn't seem to work on test module names

Reported by: Ying Li Owned by:
Priority: normal Milestone:
Component: trial Keywords:
Cc: Jonathan Lange Branch:
Author:

Description

Related to #5520 - in an attempt to get it my two test cases to run in an order I want, I attempt to run two test modules with various random seeds. The result of which is that the two modules always ran in the same order, and not the order that I wanted.

trial -z 0 first_test_module.py second_test_module.py

The TestCases inside the modules were run in a randomized order, as well as the individual tests, but the modules themselves were never randomized.

I ran this command on the two attached files over and over for 5 minutes, and the order the modules were run never changed. While it is remotely possible for this to happen, the probability is exceedingly low.

Attachments (2)

first_test_module.py (291 bytes) - added by Ying Li 5 years ago.
second_test_module.py (291 bytes) - added by Ying Li 5 years ago.

Download all attachments as: .zip

Change History (3)

comment:1 Changed 5 years ago by DefaultCC Plugin

Cc: Jonathan Lange added

Changed 5 years ago by Ying Li

Attachment: first_test_module.py added

Changed 5 years ago by Ying Li

Attachment: second_test_module.py added
Note: See TracTickets for help on using tickets.