[Twisted-Python] Scalability of an rss-aggregator

[Andrew Bennetts]

On Thu, Apr 01, 2004 at 12:13:03PM +0200, Valentino Volonghi aka Dialtone wrote:
> 
> I went on testing and found some interesting things...

I just found something interesting too -- I just took a quick peek at
feedparser, and the parse function looks like it fetches the page
synchronously using urllib.  That's *not* a good thing to do from inside
Twisted's main loop.  It looks like you want your parseFeed method to call:

    r = FeedParser(baseuri)
    r.feed(data)

like feedparser.parse does internally.  (You'll need to do a little bit of
work to return the same sort dictionary that parse constructs for you).

-Andrew.