[Twisted-Python] hardcoded SIZE_LIMIT

Jp Calderone exarkun at intarweb.us
Wed Oct 8 08:46:21 MDT 2003


On Wed, Oct 08, 2003 at 10:40:10AM +0200, Christoph Wiedemann wrote:
> Hello,
> 
> i'm trying to use PB for remote procedure calls in the context of numeric
> computations. So far things work really well (Twisted is a real cool piece of
> software!), but now i'm trapped by twisted.spread.banana.SIZE_LIMIT. I need to
> send pretty much data over the network (~512 MB) and tried out to set the
> SIZE_LIMIT to 640 MB. Hmm, still getting the "String too long exception", cause
> the 640 kB are hardcoded in cBanana.c. Any chances to make the limit
> configurable ?
> 

  Check out twisted.spread.util.StringPager -- it uses the Producer/Consumer
pattern to send the string a piece at a time.  This will reduce memory usage
and probably increase network performance, since smaller chunks are being
serialized and transmitted only once the network is ready for them.

  Jp
-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 189 bytes
Desc: Digital signature
URL: </pipermail/twisted-python/attachments/20031008/42b0a2ed/attachment.sig>


More information about the Twisted-Python mailing list