[Twisted-Python] Twisted server is 5 times SLOWER on Solaris thanLinux?

[Jacob Gabrielson]

It would be interesting to know where the CPU time is actually going.
>From what I've seen of this thread, performance is worst on the SPARC
hardware, but that doesn't necessarily mean that it's the root cause.
It may be, e.g., the implementation of some service call for that
hardware is especially slow.  Do you have any profiling information that
shows whether the CPU time is spent in Twisted code itself, or in some
system call that it's making?
 
BTW, the fact that you get 1k+ connections/s on the x86 hardware is
still slow (if you're just running benchmarking code that isn't doing
any work per request).  With epoll you should be able to get way more
than that.
 
Just my $.02,
 
-- Jacob

________________________________

From: twisted-python-bounces at twistedmatrix.com
[mailto:twisted-python-bounces at twistedmatrix.com] On Behalf Of Jarrod
Roberson
Sent: Thursday, January 18, 2007 2:11 PM
To: Twisted general discussion
Subject: Re: [Twisted-Python] Twisted server is 5 times SLOWER on
Solaris thanLinux?




On 1/18/07, glyph at divmod.com <glyph at divmod.com> wrote: 

	On 01:59 am, jarrod at vertigrated.com wrote:
	
	>We have LOTS and LOTS of test harness code and profiling code
to pinpoint 
	>where bottlenecks are. We are going to have process a couple of
terabytes a
	>day thru this system. Latency thru the system is a high
priority because of
	>what kind of system it is.
	
	If you do manage to keep Twisted in the loop on this project,
please share what strategy you used.  It is unfortunately rare that
Twisted is itself a really performance-critical component of any system
(especially a highly parallel system), so information about optimization
is hard to find. 
	


It isn't really a failing of Twisted, on non-sparc hardware it preforms
awesome! The SPARC hardware is the problem, and the T1000 / T2000 we
have be benchmarking just doesn't place nice with single threaded CPU
bound apps. 

We are going to try and replace Twisted with Apache 2.2.x and create a
module that does raw connection handliing, and go with the threaded mpm
and see how that preforms with the same test client harness we are
benchmarking with now. 


-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://twistedmatrix.com/pipermail/twisted-python/attachments/20070118/e47b97b4/attachment.htm