[Twisted-Python] I found an interisting comment about Twisted vs. Erlang
Alec Matusis
matusis at yahoo.com
Tue Sep 29 13:51:26 MDT 2009
PS.
>From my experience, the hardest problem in running large-scale Twisted
servers is finding memory leaks, and to a lesser extent debugging
intermittent silent server crashes.
It's not easy to attach a debugger to a production sever if you are looking
for sources of intermittent crashes for example.
Looking for memory leaks, esp Python garbage collection problems/circular
references is not easy as well, the manhole does not always help here.
Again, attaching a debugger that allows to list *all* objects in the memory,
is not often feasible for a production server under high load. And memory
leaks often appear only under CPU utilization, due to problems with
scheduling garbage collection.
I believe E has a way to dynamically and meaningfully inspect ALL objects in
the memory of any running process.
> I think we are accounting way too much time to the unfounded
> unaccountable random blathering of a troll :-)
As you can see from the %CPU column, I have my reasons for concern ;) This
is current copy and paste from a node with 2x quad core xeon L5420 @
2.50GHz - 1 twistd process per core.
PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
24448 nobody 20 0 991m 607m 2452 R 99 4.3 24764:37 twistd
28553 nobody 20 0 909m 453m 2412 R 95 3.2 1346:51 twistd
24640 nobody 20 0 1092m 676m 2452 R 93 4.8 32750:14 twistd
29900 nobody 20 0 802m 362m 2412 R 93 2.6 1180:53 twistd
24279 nobody 20 0 761m 277m 2424 R 42 2.0 13891:58 twistd
32422 nobody 20 0 1381m 962m 2372 R 10 6.9 13241:54 twistd
24210 nobody 20 0 599m 236m 2396 S 4 1.7 9063:29 twistd
29862 nobody 20 0 323m 14m 2384 S 2 0.1 71:53.50 twistd
> -----Original Message-----
> From: twisted-python-bounces at twistedmatrix.com [mailto:twisted-python-
> bounces at twistedmatrix.com] On Behalf Of Laurens Van Houtven
> Sent: Tuesday, September 29, 2009 12:28 PM
> To: Twisted general discussion
> Subject: Re: [Twisted-Python] I found an interisting comment about
> Twisted vs. Erlang
>
> I think we are accounting way too much time to the unfounded
> unaccountable random blathering of a troll :-)
>
> _______________________________________________
> Twisted-Python mailing list
> Twisted-Python at twistedmatrix.com
> http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python
_______________________________________________
Twisted-Python mailing list
Twisted-Python at twistedmatrix.com
http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python
More information about the Twisted-Python
mailing list