[Twisted-Python] I found an interisting comment about Twisted vs. Erlang

Alec Matusis matusis at yahoo.com
Tue Sep 29 13:51:26 MDT 2009


PS.

>From my experience, the hardest problem in running large-scale Twisted
servers is finding memory leaks, and to a lesser extent debugging
intermittent silent server crashes.
It's not easy to attach a debugger to a production sever if you are looking
for sources of intermittent crashes for example. 
Looking for memory leaks, esp Python garbage collection problems/circular
references is not easy as well, the manhole does not always help here.
Again, attaching a debugger that allows to list *all* objects in the memory,
is not often feasible for a production server under high load. And memory
leaks often appear only under CPU utilization, due to problems with
scheduling garbage collection.

I believe E has a way to dynamically and meaningfully inspect ALL objects in
the memory of any running process.

> I think we are accounting way too much time to the unfounded
> unaccountable random blathering of a troll :-)


As you can see from the %CPU column, I have my reasons for concern ;) This
is current copy and paste from a node with 2x quad core xeon L5420  @
2.50GHz - 1 twistd process per core.

  PID USER      PR  NI  VIRT  RES  SHR S %CPU %MEM    TIME+  COMMAND

24448 nobody     20   0  991m 607m 2452 R   99  4.3  24764:37 twistd

28553 nobody     20   0  909m 453m 2412 R   95  3.2   1346:51 twistd

24640 nobody     20   0 1092m 676m 2452 R   93  4.8  32750:14 twistd

29900 nobody     20   0  802m 362m 2412 R   93  2.6   1180:53 twistd

24279 nobody     20   0  761m 277m 2424 R   42  2.0  13891:58 twistd

32422 nobody     20   0 1381m 962m 2372 R   10  6.9  13241:54 twistd

24210 nobody     20   0  599m 236m 2396 S    4  1.7   9063:29 twistd

29862 nobody     20   0  323m  14m 2384 S    2  0.1  71:53.50 twistd     





> -----Original Message-----
> From: twisted-python-bounces at twistedmatrix.com [mailto:twisted-python-
> bounces at twistedmatrix.com] On Behalf Of Laurens Van Houtven
> Sent: Tuesday, September 29, 2009 12:28 PM
> To: Twisted general discussion
> Subject: Re: [Twisted-Python] I found an interisting comment about
> Twisted vs. Erlang
> 
> I think we are accounting way too much time to the unfounded
> unaccountable random blathering of a troll :-)
> 
> _______________________________________________
> Twisted-Python mailing list
> Twisted-Python at twistedmatrix.com
> http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python



_______________________________________________
Twisted-Python mailing list
Twisted-Python at twistedmatrix.com
http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python





More information about the Twisted-Python mailing list