Using Elasticsearch for NON weblogs

Hi gang,
I have a buttload of logs across a buttload of servers. I am NOT talking
web logs. I am talking about misc log files on U/Linux systems. Error logs,
security logs, access logs, sometimes a web log, and other misc system
message logs. I want to use Elasticsearch for ALL my logs everywhere.
I assume this is what ES does and can easily handle it. Question is, how do
I point my logs from multiple systems to ES? For example, how would I point
/var/messages on machine A to ES running on machine B?

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

Did you look at rsyslog elasticsearch backend?

http://wiki.rsyslog.com/index.php/HOWTO:rsyslog%2B_elasticsearch

Jörg

Am 25.02.13 18:21, schrieb Justin Franks:

Question is, how do I point my logs from multiple systems to ES? For
example, how would I point /var/messages on machine A to ES running on
machine B?

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

Hi Jörg Prante,
No, I have not. I'l look at that.
Thanks for sharing

On Monday, February 25, 2013 9:21:05 AM UTC-8, Justin Franks wrote:

Hi gang,
I have a buttload of logs across a buttload of servers. I am NOT talking
web logs. I am talking about misc log files on U/Linux systems. Error logs,
security logs, access logs, sometimes a web log, and other misc system
message logs. I want to use Elasticsearch for ALL my logs everywhere.
I assume this is what ES does and can easily handle it. Question is, how
do I point my logs from multiple systems to ES? For example, how would I
point /var/messages on machine A to ES running on machine B?

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

On Mon, 2013-02-25 at 09:21 -0800, Justin Franks wrote:

Hi gang,
I have a buttload of logs across a buttload of servers. I am NOT
talking web logs. I am talking about misc log files on U/Linux
systems. Error logs, security logs, access logs, sometimes a web
log, and other misc system message logs. I want to use Elasticsearch
for ALL my logs everywhere.
I assume this is what ES does and can easily handle it. Question is,
how do I point my logs from multiple systems to ES? For example, how
would I point /var/messages on machine A to ES running on machine B?

Have a look at logstash
http://www.logstash.net/

clint

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.