[Twisted-Python] Memory usage in large file transfers

[Bob Ippolito]

On Dec 2, 2003, at 10:38 AM, Itamar Shtull-Trauring wrote:

> On Tue, 2 Dec 2003 15:46:07 +0200
> "Nikolaos Krontiris" <nkrontir at hotmail.com> wrote:
>
>> nk: I had originally thought about using basic.FileSender but a) It
>> has been commented as unstable by the twisted development team and b)I
>> need to send a client ID each time I send a single buffer (security...
>> what can you say...). To make sure that I'm not holding the entire
>> file's contents in
>
> You don't have to use FileSender as is, you could write a variant of it
> using the underlying producer/consumer APIs, that's the solution. See
> http://itamarst.org/writings/OSCON03/twisted_internet-108.html

And if you do, please don't screw with the Python garbage collector.  
Just because you can turn it off, doesn't mean you should.  Doing a 
full collect every so often is slower than letting gc take its normal 
course anyways (in my experience).

-bob
-------------- next part --------------
A non-text attachment was scrubbed...
Name: smime.p7s
Type: application/pkcs7-signature
Size: 2357 bytes
Desc: not available
Url : http://twistedmatrix.com/pipermail/twisted-python/attachments/20031202/9028808d/attachment.bin