[Twisted-web] Design for HTTP client form login and scraping

Jean-Paul Calderone exarkun at divmod.com
Mon Jul 27 09:01:35 EDT 2009


On Mon, 27 Jul 2009 01:05:21 -0500, David Bern <odie5533 at gmail.com> wrote:
>I want to make multiple HTTP requests using the same set of cookies.
>Should I call client.getPage a lot thus creating multiple factories to
>do this?

This is probably the right approach for the near term.  If you're worried
about the overhead of creating a lot of factories, I don't think you should.
Creating these objects isn't very expensive (particularly compared to parsing
html).

Jean-Paul



More information about the Twisted-web mailing list