[Twisted-Python] Client/Server to stream text logfiles?
glyph at twistedmatrix.com
Tue Sep 27 19:19:30 EDT 2011
On Sep 27, 2011, at 12:09 AM, Victor Hooi wrote:
> We have several Solaris 10 running an application that generates large text logfiles
> We need to stream these logfiles in realtime to a central monitoring server.
> Unfortunately (for both technical and non-technical reasons), we can't use an NFS-mount. At the moment, we're using SSH with tail -f to stream the files from the servers to the monitoring box.
> However, I was going to look at hacking a client/server up in Python to monitor for filesystem events, and then stream any updates.
> In terms of filesystem monitoring, this is Solaris 10, so there's not really that much available it seems. Gamin seems to be the best bet, otherwise I might have to fallback to polling.
> On the Twisted side, is the above something that's fairly easy to accomplish? I haven't used Twisted before, so I thought this might be a good excuse to learn it. Any thoughts or caveats I should be aware of? Any existing projects I might be able to leverage off? Good starting docs for this sort of thing?
This should be pretty easy to accomplish; this kind of thing is generally very straightforward using Twisted. Obviously you'd have to implement a protocol for talking to Gamin, but I think the protocol involved is well-documented and very straightforward.
However, you should be aware that Solaris 10 is not currently a supported platform. You can see the list of supported platforms along the left-hand side of this page: <http://buildbot.twistedmatrix.com/boxes-supported>.
The primary impediment to supporting Solaris is the lack of a buildbot that can tell us whether it works or not. We don't even have an unsupported Solaris builder (see <http://buildbot.twistedmatrix.com/boxes-all> for all the currently running buildbots, including those which are known to fail).
Most likely, Twisted will work just fine on Solaris, since it's quite a lot like a lot of other platforms we do support, and especially we've recently improved support for various less popular UNIXes like the *BSD family.
Contributing a buildbot to Twisted is pretty easy though, and we can probably even supply the hardware for you (assuming that Solaris 10 can run happily in an x86[_64] qemu/kvm-style VM) if you'd just volunteer to install the OS and make sure it's configured properly.
Do you have any interest in helping us make Solaris a supported platform?
-------------- next part --------------
An HTML attachment was scrubbed...
More information about the Twisted-Python