Hi, If I may ask, is there any OSS that can serve as a log bank or log server, where it aggregate logs from different sources , and the logs can be accessed using the web from any location on the network and can do graphical presentations based on.the frequency or content os the logs. Thank you Joshua -- Sent from my Nokia N9
You probably want spunk, but if you want to do aggregation in an OSS fashion, scribe or flume is the way to go. -John Sent from my iPhone On Nov 8, 2011, at 11:59, joshua.klubi@gmail.com wrote:
Hi,
If I may ask, is there any OSS that can serve as a log bank or log server, where it aggregate logs from different sources , and the logs can be accessed using the web from any location on the network and can do graphical presentations based on.the frequency or content os the logs.
Thank you
Joshua
-- Sent from my Nokia N9
On 11/08/2011 03:00 PM, John Adams wrote:
You probably want spunk, but if you want to do aggregation in an OSS fashion, scribe or flume is the way to go.
Agree with Splunk, while not open source, is the most functional of these products. Be warned, while they offer a free license, once you start using it you'll be hooked, and their pricing beyond the free license is borderline extortionist.
On 8 November 2011 11:59, <joshua.klubi@gmail.com> wrote:
Hi,
If I may ask, is there any OSS that can serve as a log bank or log server, where it aggregate logs from different sources , and the logs can be accessed using the web from any location on the network and can do graphical presentations based on.the frequency or content os the logs.
Do you mean like Splunk? http://www.splunk.com -- Landon Stewart <LStewart@SUPERB.NET> SuperbHosting.Net by Superb Internet Corp. Toll Free (US/Canada): 888-354-6128 x 4199 Direct: 206-438-5879 Web hosting and more "Ahead of the Rest": http://www.superbhosting.net
Yes. Check out rsyslog and logstash. joshua.klubi@gmail.com wrote:
Hi,
If I may ask, is there any OSS that can serve as a log bank or log server, where it aggregate logs from different sources , and the logs can be accessed using the web from any location on the network and can do graphical presentations based on.the frequency or content os the logs.
Thank you
Joshua
-- Sent from my Nokia N9
-- Charles N Wyble @charlesnw charles@knownelement.com Building a cost effective, open, secure bit moving platform for tomorrows default free zone.
Octopussy (8pussy.org) is another option as well. Natively ties into various network monitoring packages (Nagios, Zabbix) for alerting capabilities. - Peter On 11/8/2011 3:00 PM, Charles N Wyble wrote:
Yes. Check out rsyslog and logstash.
joshua.klubi@gmail.com wrote:
Hi,
If I may ask, is there any OSS that can serve as a log bank or log server, where it aggregate logs from different sources , and the logs can be accessed using the web from any location on the network and can do graphical presentations based on.the frequency or content os the logs.
Thank you
Joshua
-- Sent from my Nokia N9
http://www.8pussy.org/dokuwiki/doku.php -- free. open source. http://logstash.net/ -- free. open source. http://splunk.com (already mentioned, of course) -- pay to play. And expensive, too. There are far more out there.
Oh! And http://graylog2.org/ -- free, open source. That's the last of the ones I can muster up. On Tue, 2011-11-08 at 14:06 -0600, David wrote:
http://www.8pussy.org/dokuwiki/doku.php -- free. open source. http://logstash.net/ -- free. open source. http://splunk.com (already mentioned, of course) -- pay to play. And expensive, too.
There are far more out there.
To answer your question. "yes" However, with almost everything I can think of, there will be an element of development required in order to achieve the results you're after. - at a previous work place a few years ago we fed all event logs into hadoop, from where we produced reports, initially just into excel files, and then later created a webapp which produced near realtime stats/reports/graphs. I've not looked recently at LogStash, or 8pussy, but primary concern would be how well they deal with huge log volumes, how they scale when one server is not big enough to hold all the logs any more, how they deal with many users searching at the same time etc. If you want to actually just get on with crunching logs, and drawing graphs in a timely fashion, Splunk is proven, and works well up to big scale (we were feeding almost 1TB/day of logs into it at my last company)... Splunk is not cheap, but when considering the cost of development + suppport if you went down the route of task of rolling something equivalent in capabilities, its not bad value. thanks Andrew On Tue, Nov 8, 2011 at 7:59 PM, <joshua.klubi@gmail.com> wrote:
Hi,
If I may ask, is there any OSS that can serve as a log bank or log server, where it aggregate logs from different sources , and the logs can be accessed using the web from any location on the network and can do graphical presentations based on.the frequency or content os the logs.
Thank you
Joshua
-- Sent from my Nokia N9
participants (9)
-
Andrew Mulholland
-
Charles N Wyble
-
David
-
Derek Bodner
-
John Adams
-
joshua.klubi@gmail.com
-
Landon Stewart
-
Matthew Walster
-
Peter Kristolaitis