Opened 2 years ago

Last modified 2 years ago

#5774 defect new

trial randomize doesn't seem to work on test module names

Reported by: cyli Owned by:
Priority: normal Milestone:
Component: trial Keywords:
Cc: jml Branch:
Author: Launchpad Bug:

Description

Related to #5520 - in an attempt to get it my two test cases to run in an order I want, I attempt to run two test modules with various random seeds. The result of which is that the two modules always ran in the same order, and not the order that I wanted.

trial -z 0 first_test_module.py second_test_module.py

The TestCases inside the modules were run in a randomized order, as well as the individual tests, but the modules themselves were never randomized.

I ran this command on the two attached files over and over for 5 minutes, and the order the modules were run never changed. While it is remotely possible for this to happen, the probability is exceedingly low.

Attachments (2)

first_test_module.py (291 bytes) - added by cyli 2 years ago.
second_test_module.py (291 bytes) - added by cyli 2 years ago.

Download all attachments as: .zip

Change History (3)

comment:1 Changed 2 years ago by DefaultCC Plugin

  • Cc jml added

Changed 2 years ago by cyli

Changed 2 years ago by cyli

Note: See TracTickets for help on using tickets.