Filebeat Log

Elastic Stack Beats
1

When i am sending the log data to logstash the data was not going to logstash and in file beat we got this error.

2018-07-18T12:56:30.482+0100 INFO [monitoring] log/log.go:124 Non-zero metrics in the last 30s {"monitoring": {"metrics": {"beat":{"cpu":{"system":{"ticks":140,"time":142},"total":{"ticks":2050,"time":2059,"value":2050},
"user":{"ticks":1910,"time":1917}},"info":{"ephemeral_id":"7c45d1c7-7e33-483f-8241-7557b8c48fb9","uptime":{"ms":240011}},"memstats":{"gc_next":22721136,"memory_alloc":17744776,"memory_total":155118128,"rss":876544}},"filebeat":{"harveste
r":{"open_files":1,"running":1}},"libbeat":{"config":{"module":{"running":0}},"output":{"events":{"batches":3,"failed":4267,"total":4267},"read":{"errors":1},"write":{"bytes":618996}},"pipeline":{"clients":1,"events":{"active":4117,"retr
y":9491}}},"registrar":{"states":{"current":6}},"system":{"load":{"1":0.34,"15":0.33,"5":0.38,"norm":{"1":0.0425,"15":0.0413,"5":0.0475}}}}}}
2018-07-18T12:56:32.861+0100 ERROR pipeline/output.go:74 Failed to connect: dial tcp ...:****: getsockopt: connection refused
2018-07-18T12:56:40.862+0100 ERROR pipeline/output.go:74 Failed to connect: dial tcp ...:: getsockopt: connection refused
2018-07-18T12:56:56.864+0100 ERROR pipeline/output.go:74 Failed to connect: dial tcp ...**:: getsockopt: connection refused
2018-07-18T12:56:58.822+0100 ERROR logstash/async.go:235 Failed to publish events caused by: read tcp 172.18.57.11:52866->...:****: read: connection reset by peer
2018-07-18T12:56:58.822+0100 ERROR logstash/async.go:235 Failed to publish events caused by: read tcp 172.18.57.11:52866- ...:****: read: connection reset by peer
2018-07-18T12:56:58.911+0100 ERROR logstash/async.go:235 Failed to publish events caused by: client is not connected
2018-07-18T12:56:59.911+0100 ERROR pipeline/output.go:92 Failed to publish events: client is not connected

  • ---Mark for the ip and port.
2

That indicates that filebeat cannot connect to Logstash.

Have you configured Logstash to listen on a port that filebeat can access? Is there perhaps a firewall rule preventing filebeat from connecting?

3

yah it is connecting for sometime and loading but after that this error is coming

4

So, does it work some of the time, but not all of the time?

5

yes it works some time and some time it gets stopped.

6

Can some one help me on this

7

It is working for 10 min and the logs are pushed to logstash also but after 10 min it is getting stopped.
And after 10 min it is giving connection error as i have shared the logs you can see there.

Can someone help on this we are facing issue to send the logs .

8

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.