trial doesn't show `DeprecationWarnings` by default on 2.7

[Tom Prince]

Since python 2.7 switch to ignoring DeprecationWarnings by default. We should make trial enable them (see here for an example of where somebody assumed it did, already).

[Glyph]

OK, so, all Twisted developers should export PYTHONWARNINGS=all right now.

I think the reason I was confused is that ​some, but ​apparently not all of our buildbots pass -Wall to trial.

[Glyph]

I'd say this is high priority because I think there has been some confusion around this - I think for multiple reasons, but if for no other reason then because I've been spreading confusion about this because I thought it was already implemented.

[Julian Berman]

So, I started working on this after thinking trial should do this and then finding this ticket, but after a bit of thought and some work on it I'm not so sure anymore. Trial is already being quite intrusive (which was why I reopened #3070). So, I have what I've done already, but can someone clarify why we should do this when there is already an acceptable way to have this happen for every Python program in existence?

The problem with PYTHONWARNINGS is really nothing other than lack of knowledge (even though it is specifically mentioned in the warnings docs to test your code with warnings turned on.). I'm sure I also have made fun of Python before for having the default be to hide them, but things are as they are and there's an acceptable way to deal with that. So I'm currently of the opinion that this should be wontfixed and #3070 worked on. Do you have reason to disagree?

[Glyph]

Replying to Julian:

So, I started working on this after thinking trial should do this and then finding this ticket, but after a bit of thought and some work on it I'm not so sure anymore. Trial is already being quite intrusive (which was why I reopened #3070). So, I have what I've done already, but can someone clarify why we should do this when there is already an acceptable way to have this happen for every Python program in existence?

Yes. Python implemented warning-hiding for a specific reason: warnings were showing up when users ran applications. Specifically, warnings would show up on terminals when users ran perfectly-functional command-line Python applications, leading users to complain and think that something serious was wrong, when in fact everything was perfectly fine from their perspective.

trial is not an arbitrary application; it's a testing tool, and different default behavior makes sense.

The problem with PYTHONWARNINGS is really nothing other than lack of knowledge (even though it is specifically mentioned in the warnings docs to test your code with warnings turned on.). I'm sure I also have made fun of Python before for having the default be to hide them, but things are as they are and there's an acceptable way to deal with that. So I'm currently of the opinion that this should be wontfixed and #3070 worked on. Do you have reason to disagree?

Trial is a testing tool, and an implicit part of our compatibility policy.

The gist of Twisted's compatibility is this: if you can run your program's (100% coverage!) test suite with no warnings under trial, then you ought to be able to safely upgrade a single version of Twisted. If trial does not output warnings by default unless you set a special environment variable, then the default behavior is wrong. Python may make you jump through hoops to make things work correctly, but not Twisted :).

I've already given my reasons for not fixing #3070 on that ticket. However, that does not mean that Trial's reporting of warnings should not be improved. For example, warnings ought to show up, like failures and errors, in the summary output. Also, see this ticket about improving trial's other output behaviors to present better-formatted output, which should include warnings.

[Jean-Paul Calderone]

Heya Julian, I wonder if you figured out why trial's existing warning integration code isn't managing to grab these warnings? If so, it might help the next person who picks up this ticket. If not, no big deal - just wanted to make sure we capture whatever information we have. Thanks!

[Tom Prince]

I put some code in the branch that should always show all unflushed warnings.

It does mean that trial will completely ignore any warning setting of the user (such as -Werror for example).

[Julian Berman]

Well, the next person finding this ticket happens to be me again, since trial is being broken again. Time to go back down the rabbit hole and remember why it's breaking the warnings module again... Maybe this time leave enough info for the next time I find the ticket :/