[Twisted-Python] Client/Server to stream text logfiles?

Glyph Lefkowitz glyph at twistedmatrix.com
Tue Sep 27 19:19:30 EDT 2011


On Sep 27, 2011, at 12:09 AM, Victor Hooi wrote:

> Hi,
> 
> We have several Solaris 10 running an application that generates large text logfiles
> 
> We need to stream these logfiles in realtime to a central monitoring server.
> 
> Unfortunately (for both technical and non-technical reasons), we can't use an NFS-mount. At the moment, we're using SSH with tail -f to stream the files from the servers to the monitoring box.
> 
> However, I was going to look at hacking a client/server up in Python to monitor for filesystem events, and then stream any updates.
> 
> In terms of filesystem monitoring, this is Solaris 10, so there's not really that much available it seems. Gamin seems to be the best bet, otherwise I might have to fallback to polling.
> 
> On the Twisted side, is the above something that's fairly easy to accomplish? I haven't used Twisted before, so I thought this might be a good excuse to learn it. Any thoughts or caveats I should be aware of? Any existing projects I might be able to leverage off? Good starting docs for this sort of thing?

Hi Victor,

This should be pretty easy to accomplish; this kind of thing is generally very straightforward using Twisted.  Obviously you'd have to implement a protocol for talking to Gamin, but I think the protocol involved is well-documented and very straightforward.

However, you should be aware that Solaris 10 is not currently a supported platform.  You can see the list of supported platforms along the left-hand side of this page: <http://buildbot.twistedmatrix.com/boxes-supported>.

The primary impediment to supporting Solaris is the lack of a buildbot that can tell us whether it works or not.  We don't even have an unsupported Solaris builder (see <http://buildbot.twistedmatrix.com/boxes-all> for all the currently running buildbots, including those which are known to fail).

Most likely, Twisted will work just fine on Solaris, since it's quite a lot like a lot of other platforms we do support, and especially we've recently improved support for various less popular UNIXes like the *BSD family.

Contributing a buildbot to Twisted is pretty easy though, and we can probably even supply the hardware for you (assuming that Solaris 10 can run happily in an x86[_64] qemu/kvm-style VM) if you'd just volunteer to install the OS and make sure it's configured properly.

Do you have any interest in helping us make Solaris a supported platform?

Thanks,

-glyph

-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://twistedmatrix.com/pipermail/twisted-python/attachments/20110927/ed91a6d5/attachment.htm 


More information about the Twisted-Python mailing list