[Twisted-Python] Twisted-Python Digest, Vol 93, Issue 12

Scott M Ferguson smferguson at gmail.com
Sun Dec 11 10:12:19 EST 2011


Scratch that bit about verification emails not sending, turns out it
works fine in firefox, not in chrome.
Thanks,
Scott

On Sat, Dec 10, 2011 at 9:24 PM, Scott M Ferguson <smferguson at gmail.com> wrote:
> Hi all,
>
> A little intro first, I'm a developer by day,
> sql/plsql/java/perl/c/c++/... I've been looking for an opensource
> project to get to know and contribute to and came across twisted a
> week or so ago. It looks pretty interesting, years ago I spent time
> writing networking/remote access code.
>
> Anyway, I want to help and am starting to look through the 'easy' bugs
> - Python is pretty new to me so I figure that's where I should be. I
> took a look at http://twistedmatrix.com/trac/ticket/4966, which might
> be out-of-date. I don't see __all__ in twisted.web.server.py. Am I
> missing something there?
>
> Also, does the email verification on the website work? I've tried it a
> few times and haven't received an email, also nothing in my spam/trash
> related to it - sorry if this shouldn't go to the list.
>
> Thanks,
> Scott Ferguson
>
> On Sat, Dec 10, 2011 at 12:00 PM,
> <twisted-python-request at twistedmatrix.com> wrote:
>> Send Twisted-Python mailing list submissions to
>>        twisted-python at twistedmatrix.com
>>
>> To subscribe or unsubscribe via the World Wide Web, visit
>>        http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python
>> or, via email, send a message with subject or body 'help' to
>>        twisted-python-request at twistedmatrix.com
>>
>> You can reach the person managing the list at
>>        twisted-python-owner at twistedmatrix.com
>>
>> When replying, please edit your Subject line so it is more specific
>> than "Re: Contents of Twisted-Python digest..."
>>
>>
>> Today's Topics:
>>
>>   1. Re: Boston Twisted Sprint: Last-Minute December   Edition (Tenth)
>>   2. Re: Boston Twisted Sprint: Last-Minute December   Edition
>>      (Kevin Horn)
>>   3. MemoryError in    twisted.internet.abstract.FileDescriptor
>>      (Augusto Mecking Caringi)
>>   4. Re: MemoryError in twisted.internet.abstract.FileDescriptor
>>      (Itamar Turner-Trauring)
>>   5. Re: Boston Twisted Sprint: Last-Minute December   Edition (Glyph)
>>
>>
>> ----------------------------------------------------------------------
>>
>> Message: 1
>> Date: Fri, 9 Dec 2011 13:32:23 -0500
>> From: Tenth <tenth at twistedmatrix.com>
>> Subject: Re: [Twisted-Python] Boston Twisted Sprint: Last-Minute
>>        December        Edition
>> To: Twisted general discussion <twisted-python at twistedmatrix.com>
>> Message-ID:
>>        <CAKJpRM0NWgs47FvsodcPKEBpX_D8fbnSGXQ+OSQp1+WiXWPknQ at mail.gmail.com>
>> Content-Type: text/plain; charset="iso-8859-1"
>>
>> I should also mention that the Sprint will now officially be starting at
>> Noon, if that makes it more convenient for anyone...
>>
>> Thanks,
>>
>> - Dave
>> -------------- next part --------------
>> An HTML attachment was scrubbed...
>> URL: http://twistedmatrix.com/pipermail/twisted-python/attachments/20111209/c24e4597/attachment-0001.htm
>>
>> ------------------------------
>>
>> Message: 2
>> Date: Fri, 9 Dec 2011 13:00:38 -0600
>> From: Kevin Horn <kevin.horn at gmail.com>
>> Subject: Re: [Twisted-Python] Boston Twisted Sprint: Last-Minute
>>        December        Edition
>> To: Twisted general discussion <twisted-python at twistedmatrix.com>
>> Message-ID:
>>        <CA+U=zK3TBJBtV-asK7WjGjuwnaS0JT1+74srqBVX4w8CVW4McA at mail.gmail.com>
>> Content-Type: text/plain; charset="iso-8859-1"
>>
>> On Thu, Dec 8, 2011 at 8:23 PM, Glyph <glyph at twistedmatrix.com> wrote:
>>
>>>
>>> I'll be there, and I'll be working on at least 2 exciting and mysterious
>>> features :).
>>>
>>
>> Exciting!  Mysterious!
>>
>> Also, for this sprint or for future sprints, if you're not in the Boston
>>> metro area, we'd love to co-ordinate with events in other cities.  If you'd
>>> like to host something but you've never organized a sprint before, there
>>> are many people on this list who would be happy to help you figure that out
>>> :).
>>>
>>> -glyph
>>>
>>
>> FYI, the DFW Pythoneers have a coding/presentation session every second
>> Saturday (where it doesn't conflict with anything really obvious, like
>> PyCon/PyTexas, etc.)
>>
>> It's probably a bit too short notice this time to try to hijack the
>> meeting, but if you have future sprints on second Saturdays (this is at
>> least the second one, I don't know if that's by accident or design), I'm
>> happy to try to take it over in furtherance of Twisted.
>>
>> Kevin Horn
>> -------------- next part --------------
>> An HTML attachment was scrubbed...
>> URL: http://twistedmatrix.com/pipermail/twisted-python/attachments/20111209/7fe48b10/attachment-0001.htm
>>
>> ------------------------------
>>
>> Message: 3
>> Date: Fri, 9 Dec 2011 19:20:44 -0200
>> From: Augusto Mecking Caringi <augustocaringi at gmail.com>
>> Subject: [Twisted-Python] MemoryError in
>>        twisted.internet.abstract.FileDescriptor
>> To: twisted-python at twistedmatrix.com
>> Message-ID:
>>        <CADFy_4GAtgH=_XfyYoxE76JwWCbE-cv4zvjH_Uy4Z4wm9nj3sg at mail.gmail.com>
>> Content-Type: text/plain; charset=ISO-8859-1
>>
>> Hi!
>>
>>    I'm writing a software using Python Twisted with the following architecture:
>>
>>    [server]<->[providers]
>>
>>    The providers (that can be thousands) send events to the
>> centralized server, usually we have a few events per minute for each
>> provider, but a burst of events can happen.
>>
>>    So I write a test provider to simulate the sending of millions of
>> events without any delay, via a thread like that:
>>
>>    def stressTestTask():
>>        time.sleep(1)
>>        c = provider_reference
>>        for i in range(1000000):
>>            event = c.createTestEvent()
>>            reactor.callFromThread(c.transport.write, event)
>>
>>    Then I started to analyze memory consumption while running this
>> test code, and I find out that the memory consumption grows to
>> gigabytes and finally a MemoryError exception raises:
>>
>>        Traceback (most recent call last):
>>          File "/usr/lib/python2.5/site-packages/twisted/python/log.py",
>> line 84, in callWithLogger
>>            return callWithContext({"system": lp}, func, *args, **kw)
>>          File "/usr/lib/python2.5/site-packages/twisted/python/log.py",
>> line 69, in callWithContext
>>            return context.call({ILogContext: newCtx}, func, *args, **kw)
>>          File "/usr/lib/python2.5/site-packages/twisted/python/context.py",
>> line 118, in callWithContext
>>            return self.currentContext().callWithContext(ctx, func, *args, **kw)
>>          File "/usr/lib/python2.5/site-packages/twisted/python/context.py",
>> line 81, in callWithContext
>>            return func(*args,**kw)
>>        --- <exception caught here> ---
>>          File "/usr/lib/python2.5/site-packages/twisted/internet/selectreactor.py",
>> line 146, in _doReadOrWrite
>>            why = getattr(selectable, method)()
>>          File "/usr/lib/python2.5/site-packages/twisted/internet/tcp.py",
>> line 177, in doWrite
>>            return Connection.doWrite(self)
>>          File "/usr/lib/python2.5/site-packages/twisted/internet/tcp.py",
>> line 428, in doWrite
>>            result = abstract.FileDescriptor.doWrite(self)
>>          File "/usr/lib/python2.5/site-packages/twisted/internet/abstract.py",
>> line 199, in doWrite
>>            self.dataBuffer = buffer(self.dataBuffer, self.offset) +
>> "".join(self._tempDataBuffer)
>>        exceptions.MemoryError:
>>
>>    After a search, I found this ticket:
>> http://twistedmatrix.com/trac/ticket/3682
>>
>>    And I think that this is exact my problem.
>>
>>    What's the best solution? Apply the patch attached on this ticket,
>> moving to a producer/consumer approach, or any other idea?
>>
>>    Thanks!
>>
>> --
>> Augusto Mecking Caringi
>>
>>
>>
>> ------------------------------
>>
>> Message: 4
>> Date: Fri, 9 Dec 2011 16:31:11 -0500
>> From: "Itamar Turner-Trauring" <itamar at itamarst.org>
>> Subject: Re: [Twisted-Python] MemoryError in
>>        twisted.internet.abstract.FileDescriptor
>> To: "Twisted general discussion" <twisted-python at twistedmatrix.com>
>> Message-ID:
>>        <5252ce1aebff2c8409ffee1929227075.squirrel at webmail.zoteca.com>
>> Content-Type: text/plain;charset=iso-8859-1
>>
>>>     What's the best solution? Apply the patch attached on this ticket,
>>> moving to a producer/consumer approach, or any other idea?
>>
>> The patch will just delay the problem... you're creating a huge number of
>> strings, faster than the transport can write them out. The solution is
>> indeed to use the consumer API to pause creation of more data until the
>> transport clears its buffers.
>>
>>
>>
>>
>> ------------------------------
>>
>> Message: 5
>> Date: Sat, 10 Dec 2011 01:37:48 -0500
>> From: Glyph <glyph at twistedmatrix.com>
>> Subject: Re: [Twisted-Python] Boston Twisted Sprint: Last-Minute
>>        December        Edition
>> To: Twisted general discussion <twisted-python at twistedmatrix.com>
>> Message-ID: <125F2D03-7126-4FE2-BED4-14F4FC2FFD30 at twistedmatrix.com>
>> Content-Type: text/plain; charset="iso-8859-1"
>>
>> On Dec 9, 2011, at 2:00 PM, Kevin Horn wrote:
>>
>>> It's probably a bit too short notice this time to try to hijack the meeting,
>>
>> Understandable.  Possibly worth a shot though ;)
>>
>>> but if you have future sprints on second Saturdays (this is at least the second one, I don't know if that's by accident or design),
>>
>> It's just so happened that this is the day that works out the best for those of us who have been attending these last couple of months.  It's not clear if that will continue - it's more likely that we'll move to Sundays at some point to work around this one jerk's World of Warcraft raid schedule (not a joke, and you can probably guess who it is).
>>
>>> I'm happy to try to take it over in furtherance of Twisted.
>>
>> Twisted Prevails,
>>
>> -glyph
>>
>> -------------- next part --------------
>> An HTML attachment was scrubbed...
>> URL: http://twistedmatrix.com/pipermail/twisted-python/attachments/20111210/937d9572/attachment-0001.htm
>>
>> ------------------------------
>>
>> _______________________________________________
>> Twisted-Python mailing list
>> Twisted-Python at twistedmatrix.com
>> http://twistedmatrix.com/cgi-bin/mailman/listinfo/twisted-python
>>
>>
>> End of Twisted-Python Digest, Vol 93, Issue 12
>> **********************************************



More information about the Twisted-Python mailing list