[Twisted-Python] running 1,000,000 tasks, 40 at-a-time
terry at jon.es
Wed Oct 26 10:22:32 EDT 2011
> - Is there a Twisted pattern for managing tasks efficiently that I be
> - missing?
Sounds like you should be using a Python generator and that you're not.
First off, have you read http://jcalderone.livejournal.com/24285.html ?
If not, do. Take note of the line
work = (callable(elem, *args, **named) for elem in iterable)
work is a generator. Make sure you understand every line of that code :-)
You might also find https://launchpad.net/txrdq of interest, though it's
probably overkill for what you're trying to do.
More information about the Twisted-Python