[Twisted-Python] Need words of wisdom regarding PB

Paul G paul-lists at perforge.com
Thu Jun 29 20:18:14 EDT 2006


it saddens me to say that you can't get it. the reason is simple: i can't 
get it either. i'd erroneously thought the code was backed up before i wiped 
a box, but that was not the case :( it is now lost, along with some other 
semi-useful stuff.

with that said, i don't think it would've been useful for what you were 
attempting - i was compressing the data before sending it over pb, while you 
seem to be interested in doing this automagically at the pb or transport 


----- Original Message ----- 
From: "Tzahi Fadida" <Tzahi.ML at gmail.com>
To: "Twisted general discussion" <twisted-python at twistedmatrix.com>
Sent: Wednesday, June 28, 2006 8:39 AM
Subject: Re: [Twisted-Python] Need words of wisdom regarding PB

On Wednesday 28 June 2006 14:50, Paul G wrote:
> i implemented file transfer with an optional intermediate gzip stage using
> pb a long while ago. if you're dealing with fairly low latency, a single 
> pb
> connection is fine; for higher latencies, you'll want to multiplex 
> multiple
> pb connections (this has to do with tcp, not pb). with my quick hack, i 
> was
> able to saturate a fast-e with virtually no significant cpu utilization -
> the disk io and the network were the bottlenecks.

I am also very much interested in compressing the underlying transfers using
PB. Where can we get the hack? :)
I am looking for something that is done after serialization so all features 
jelly remains. I.e., just before transfer, compress the data. Preferably 
some control, i.e., with each message i send i want to be able to say
if to compress and to what level of compression.

Currently i have to circumvent jelly by pickle and compress but i can only
do that when server sends to client since the client trusts the server.
However the server does not trust the client and thus, cannot allow pickled
objects to be unserialized.

maybe something like callRemoteCompressed...

Tzahi Fadida
Blog: http://tzahi.blogsite.org | Home Site: http://tzahi.webhop.info

Twisted-Python mailing list
Twisted-Python at twistedmatrix.com

More information about the Twisted-Python mailing list