Thanks for the response. Can you please review below and advise.
I see the same error again. Here is the yml config file where I did the modification and below is the log entries for your reference.
#-------------------------- Elasticsearch output ------------------------------
output.elasticsearch:
Array of hosts to connect to.
hosts: ["10.10.6.180:9200"]
Optional protocol and basic auth credentials.
#protocol: "https"
#username: "elastic"
#password: "changeme"
timeout: 180
2017/01/28 16:59:44.182193 prospector_log.go:245: DBG Update existing file for harvesting: /opt/IBM/tivoli/netcool/omnibus/log/SPI.log, offset: 565308
2017/01/28 16:59:44.182234 prospector_log.go:297: DBG Harvester for file is still running: /opt/IBM/tivoli/netcool/omnibus/log/SPI.log
2017/01/28 16:59:44.182256 prospector_log.go:83: DBG Prospector states cleaned up. Before: 1, After: 1
2017/01/28 16:59:45.596578 client.go:632: DBG Ping request failed with: Get http://10.10.6.180:9200: net/http: request canceled (Client.Timeout exceeded while awaiting headers)
2017/01/28 16:59:45.596633 single.go:140: ERR Connecting error publishing events (retrying): Get http://10.10.6.180:9200: net/http: request canceled (Client.Timeout exceeded while awaiting headers)
2017/01/28 16:59:45.596645 single.go:156: DBG send fail
2017/01/28 16:59:47.596967 client.go:627: DBG ES Ping(url=http://10.10.6.180:9200, timeout=3m0s)
2017/01/28 16:59:54.182469 prospector.go:155: DBG Run prospector
2017/01/28 16:59:54.182515 prospector_log.go:62: DBG Start next scan
2017/01/28 16:59:54.182620 prospector_log.go:212: DBG Check file for harvesting: /opt/IBM/tivoli/netcool/omnibus/log/SPI.log
2017/01/28 16:59:54.182639 prospector_log.go:245: DBG Update existing file for harvesting: /opt/IBM/tivoli/netcool/omnibus/log/SPI.log, offset: 565308
I see the same error message after it tried multiple times.
