[Twisted-Python] Twisted server is 5 times SLOWER on Solaris than Linux?

Jarrod Roberson jarrod at vertigrated.com
Fri Jan 19 20:51:33 EST 2007

On 1/18/07, glyph at divmod.com <glyph at divmod.com> wrote:
> On 01:59 am, jarrod at vertigrated.com wrote:
> >We have LOTS and LOTS of test harness code and profiling code to pinpoint
> >where bottlenecks are. We are going to have process a couple of terabytes
> a
> >day thru this system. Latency thru the system is a high priority because
> of
> >what kind of system it is.
> If you do manage to keep Twisted in the loop on this project, please share
> what strategy you used.  It is unfortunately rare that Twisted is itself a
> really performance-critical component of any system (especially a highly
> parallel system), so information about optimization is hard to find.

Here is an update. I have learned more about the Niagra chip in the
T1000/T2000 servers.
The T2000 we are using has a 8 core 1 Ghz processor, each core gets 4
threads, so Solaris sees a 32 processor machine.
We noticed from watching top that each thread is only getting 3.1% of CPU
time. Doing the math, that means our Twisted thread is running on a 250 mhz
processor :-(
The Niagra chip is basically like having 32 250mhz processors with a really
effiecient scheduler. With that information in hand, we can now begin to
understand how we need to approach deployment of our Twisted server in this

To get the kind of client counts ( 2000 clients ) we would have to run 20
instances of our Twisted server, with 100 clients each.
We have tried this and it appears it will work, we need more time to test.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://twistedmatrix.com/pipermail/twisted-python/attachments/20070119/f031e79c/attachment.htm 

More information about the Twisted-Python mailing list