Duplicating the documents

[sivap (sivakumar)]

Hi Team,

we are trying to index logs from a file to elasticsearch using fluentd
when we use logstash_format : true in our fluent config file we are getting duplicate documents in elasticsearch(viewing from kibana)
if we index without logstash_format parameter its giving the right count.
sample output config

<match samplelog.**>
@type elasticsearch
logstash_format true
logstash_prefix samplelog
host localhost
port 9200

where we are missing, could you please suggest..

Thanks

[dadoonet (David Pilato)]

Please format your code, logs or configuration files using </> icon as explained in this guide and not the citation button. It will make your post more readable.

Or use markdown style like:

```
CODE
```

There's a live preview panel for exactly this reasons.

Lots of people read these forums, and many of them will simply skip over a post that is difficult to read, because it's just too large an investment of their time to try and follow a wall of badly formatted text.
If your goal is to get an answer to your questions, it's in your interest to make it as easy to read and understand as possible.
Please update your post.

I moved your question to #logstash where I think it might fit better.