# Logstash sending same message 3 times to elasticsearch

**URL:** <https://discuss.elastic.co/t/logstash-sending-same-message-3-times-to-elasticsearch/244749>\
**Category:** Logstash\
**Created:** [August 12, 2020, 3:26pm UTC](https://discuss.elastic.co/t/logstash-sending-same-message-3-times-to-elasticsearch/244749 "2020-08-12T15:26:31Z")\
**Posts on this page:** 2\
**Page:** 1

<div class="post-metadata">

**Author:** ![srbhklkrn](https://avatars.discourse-cdn.com/v4/letter/s/e480ec/32.png) [@srbhklkrn](https://discuss.elastic.co/u/srbhklkrn)\
**Post date:** [August 12, 2020, 3:26pm UTC](https://discuss.elastic.co/t/logstash-sending-same-message-3-times-to-elasticsearch/244749/1 "2020-08-12T15:26:31Z")

</div>

We have Pivotal Cloud Foundry as a platform and we are sending logs to ELK. So our setup is like we have an F5 load balancer that sends logs to 3 Logstash servers and these 3 Logstash servers send logs to 3 Elastic servers and on one Kibana server.

Problem is I'm seeing the same log repeating 3 times in one document for e.g

 ![s](https://us1.discourse-cdn.com/elastic/original/3X/e/b/ebf0a198f7c5d4083e475d7d8ab5adcb1ff10486.png)

As you can see in syslog5424\_host field host is getting repeated 3 times also in `syslog5424_pri, syslog5424_sd, syslog5424_proc`, etc

I tried shutting down 2 out of 3 Logstash servers and I don't see thing issue again but as soon as I start all 3 of them I'm seeing the same repeating pattern.

About Logstash setup:

Each Logstash is running on its own host as a service and they all start at the same time using Ansible and have the same config file on them.

Any tip where I should look?

Sample sys log:

```
<14>1 2020-08-12T14:49:16.976868Z 192.168.20.41 loggr-syslog-agent rs2
- [instance@47450 director="" deployment="cf-3dde5b0b8438522ad805" group="nats" az="AZ2" id="b216747b-a2fb-4da9-b559-6a7cc229bcf3"] 2020/08/12 14:49:16 failed to write to doppler.service.cf.internal:6067, retrying in 4.096s, err: dial tcp
192.168.20.72:6067: connect: connection refused

```

Logstash Config:

```
input {
  tcp {
    port => 10514
    type => syslog
  }

  udp {
    port => 10514
    type => syslog
  }
}

filter {
  if [type] == "syslog" {
    grok {
      match => { "message" => "%{SYSLOG5424PRI}%{NONNEGINT:syslog5424_ver} +(?:%{TIMESTAMP_ISO8601:syslog5424_ts}|-) +(?:%{HOSTNAME:syslog5424_host}|-) +(?:%{NOTSPACE:syslog5424_app}|-) +(?:%{NOTSPACE:syslog5424_proc}|-) +(?:%{WORD:syslog5424_msgid}|-) +(?:%{SYSLOG5424SD:syslog5424_sd}|-|) +%{GREEDYDATA:syslog5424_msg}" }
    }

    syslog_pri { }

    date {
      match => ["syslog_timestamp", "MMM d HH:mm:ss", "MMM dd HH:mm:ss"]
    }

    if !("_grokparsefailure" in [tags]) {
      mutate {
        replace => ["@source_host", "%{syslog_hostname}"]
        replace => ["@message", "%{syslog_message}"]
      }
    }

    mutate {
      remove_field => ["syslog_hostname", "syslog_message", "syslog_timestamp"]
    }
  }
}

output {
  if [type] == "syslog" {
    elasticsearch {
      hosts => ["10.64.20.85:9200","10.64.20.86:9200","10.64.20.87:9200"]
      index => "logstash-%{+yyyy.MM.dd}"
    }
  }
}
```

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [September 9, 2020, 3:26pm UTC](https://discuss.elastic.co/t/logstash-sending-same-message-3-times-to-elasticsearch/244749/2 "2020-09-09T15:26:33Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.