[Twisted-Python] client, deferred and/or reactor hung on these 2 URL's

Eric Mangold teratorn at twistedmatrix.com
Sat Jan 13 15:38:04 MST 2007

On Sat, 13 Jan 2007 08:00:11 -0600, Rick Graves <gravesricharde at yahoo.com>  

> Hello,
> I am new to twisted.
> I was using client.downloadPage and reactor.
> Twisted was hung on the following two for a whole hour:
> http://75i.net/
> http://www.theproxy.be/
> I had to break out with Ctrl-C.  When I did that, they finally fired the  
> Errorback.

I just wrote a test program that uses downloadPage() and it downloaded  
both those URLs fine.

Are you still able to reproduce the problem? Does there seem to be any  
difference in downloading those URLs as part of a full run as opposed to  
individually? Do you have any proxies between you and those hosts? (Many  
ISPs have transparent proxies these days, *grrr*). If you can still  
reproduce then a traffic capture could be of use.

In any case, the deferred returned from downloadPage probably shouldn't  
take > 1 hour to errback. It's certainly possible that downloadPage could  
need more than 1 hour to download a large file over a slow pipe, but  
that's not the case here. There should probably be reasonable timeouts  
that trigger when no data has been received for a while. I'm not sure how  
downloadPage works as I haven't looked at the code yet.

Please file a bug at http://twistedmatrix.com/trac (You will need to  
register first). Include all the information you have, and a minimal  
example program that demonstrates the problem if at all possible.

Eric Mangold
Twisted/Win32 Co-Maintainer

More information about the Twisted-Python mailing list