[Twisted-Python] clustering or process group replication

[Darran Edmundson]

On 27/05/2005, at 12:46 PM, Laran Evans wrote:

> Is MCLv3 also being used for the accessgrid work?
>

No, that's what I want to implement.  In the current model,
the VenueServer acts as a common data store.  Fine for
little things but obviously doesn't allow impromptu "ah,
here's a 100Mb dataset for everyone to preview".


> I'm curious. Why was MCLv3 chosen?

By virtue of being the first library they found that
fulfilled their needs ;-)

Our guys have a 400Mb compressed node image that
the want to distribute.  It is transmitted in 1k packets (FEC
algorithm takes a list of pointers so no need to actually break
the data up), each 32Mb chunk being verified against a SHA1
hash.  Note, there is *no* feedback from the clients, we just
set a duplication factor of 1.5, a number empirically determined
to give reliable transfer on the local network.

Cheers,
Darran.