I have 3 server with beat service installed , passing the logs to logstash on different ports 5044,5045,4046
with different index .but all indexes have the same data .
I have 3 server with beat service installed , passing the logs to logstash on different ports 5044,5045,4046
with different index .but all indexes have the same data .
input {
beats {
port => 5045
}
}
filter
{
xml
{
source => "message"
target => "doc"
}
}
output
{
elasticsearch
{
codec => json
hosts => ["10.100.76.90:9200"]
# index => "aimlogs"
index => "zic_uat-%{+yyyy.MM.dd}"
document_type => "vdf_xml"
}
stdout {}
}
~
Thanks in advance for help
I have 3 server with beat service installed , passing the logs to logstash on different ports 5044,5045,4046
What's the point of using different ports?
with different index .but all indexes have the same data .
That's because you're running all configuration files in the same Logstash pipeline. Logstash will concatenate the configuration files so that all filters and outputs apply to all events from all inputs. You can use conditionals to selectively apply filters and outputs. This is an extremely common question here and has been covered many times before.
Can you please share any example for source ip rule ?
The documentation contains many examples of conditionals: https://www.elastic.co/guide/en/logstash/current/event-dependent-configuration.html#conditionals
If you want a specific example you must ask a more specific question than "source ip rule".
Thanks
Can you please share the syntax for nested if ,
input {
beats {
port => 5044
}
}
output {
if "json" in [tags] {
elasticsearch {
hosts => "10.11.19.133:9200"
index => "first_indexer"
}
}else if "new" in [tags] {
elasticsearch {
hosts => "10.11.19.133:9200"
index => "second_indexer"
}
else {
elasticsearch {
hosts => "10.11.19.133:9200"
index => "new"
}
}
}
}
Is this corect ?
That syntax is okay, but since I don't know what you want to accomplish I can't tell whether it'll do what you expect.
Let me explain you here what I want .I have 3 filebeat location and I have specified tags in every filebeat now i want difffrent index for each filebeat using the tags.
Is it possible ?
I would use a custom field instead of tags but either way works.
Thanks a alot for help
any example for custom filed with condition
The documentation I linked to contains lots of examples of how the compare field values.
This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
© 2020. All Rights Reserved - Elasticsearch
Apache, Apache Lucene, Apache Hadoop, Hadoop, HDFS and the yellow elephant logo are trademarks of the Apache Software Foundation in the United States and/or other countries.