[Twisted-Python] How Twisted is This?

Tommi Virtanen tv at twistedmatrix.com
Thu Jul 17 03:55:29 MDT 2003


On Wed, Jul 16, 2003 at 06:39:09PM -0400, Bob Ippolito wrote:
> watch out for when writing a web spider, for example.  It just doesn't 
> make sense to intentionally design something that behaves like: 
> ______/\___________/\_____ when you really have an extremely 
> parallelizable task at hand.  Checking site A is in no way dependent on 
> checking site B, so there's no reason to intentionally make them happen 
> at the same time if you know better.  We're not talking about a whole 
> lot of code here.  Leveraging the fact that 99% of what needs to be 
> done is glue code between stuff that's already in twisted, a prototype 
> of his application could be easily be done in less than fifty lines 
> using the scalable approach.  In fact, I think that the "wake up and do 
> stuff every N minutes" approach would actually end up being a longer 
> and easier to screw up implementation.

	You all should probably read up on what the Nagios project
	thinks about randomizing monitoring intervals. They have a
	stable open source product that can scale reasonably well,
	and have good opinions on that subject.

-- 
:(){ :|:&};:




More information about the Twisted-Python mailing list