[Twisted-Python] Thread Consumption Problem in Daemon?

[Chris Withers]

On 22/11/2018 02:30, Glyph wrote:
> 
>> On Nov 19, 2018, at 6:16 AM, Darren Govoni <darrenuspto at gmail.com 
>> <mailto:darrenuspto at gmail.com>> wrote:
>>
>> I tried to find out if there is a way to limit the thread pool size 
>> from command line for twisted web and found nothing. Does it exist?
> 
> The thread pool is limited to 10. While this is configurable via the 
> API, no command line option is exposed to tune it.  (This would be a 
> great contribution if you were so inclined!)
> 
> It seems likely to me that Flask is spawning background threads for some 
> reason; given the way Twisted's threadpool works, leaks like this are 
> not common.  However, anything is possible: you probably want to gather 
> some information about what all those threads are doing.

Some ideas on this front:

- pstree/ps and strace will tell you at a low level

- http://pyrasite.com/ and then use Python's thread introspection stuff.

cheers,

Chris