[Twisted-Python] How Twisted is This?
tv at twistedmatrix.com
Thu Jul 17 05:55:29 EDT 2003
On Wed, Jul 16, 2003 at 06:39:09PM -0400, Bob Ippolito wrote:
> watch out for when writing a web spider, for example. It just doesn't
> make sense to intentionally design something that behaves like:
> ______/\___________/\_____ when you really have an extremely
> parallelizable task at hand. Checking site A is in no way dependent on
> checking site B, so there's no reason to intentionally make them happen
> at the same time if you know better. We're not talking about a whole
> lot of code here. Leveraging the fact that 99% of what needs to be
> done is glue code between stuff that's already in twisted, a prototype
> of his application could be easily be done in less than fifty lines
> using the scalable approach. In fact, I think that the "wake up and do
> stuff every N minutes" approach would actually end up being a longer
> and easier to screw up implementation.
You all should probably read up on what the Nagios project
thinks about randomizing monitoring intervals. They have a
stable open source product that can scale reasonably well,
and have good opinions on that subject.
More information about the Twisted-Python