Hi,
I have started logstash with the following error:
[2020-07-28T15:19:51,466][ERROR][logstash.outputs.elasticsearch][main][ac34975042de783740a7fba68d15a74cca99c92e561d5fc2f692e54892613f0d] Encountered a retryable error. Will Retry with exponential backoff {:code=>400, :url=>"http://host:9200/_bulk"}
Here is the config file:
input
{
#here we have used file plugin of logstash, specify what file we want to ingest
file {
#location of log file
path => "/u01/logstash/logstash-7.8.0/logs"
type => "logs"
start_position => "beginning"
}
beats {
port => 5044
}
}
#multiple pulgins are used in this filter stage
filter
{
#grok plugin regular expression matcher, and we have used COMBINEDAPACHELOG here
#you can use different pattern from this link https://github.com/elastic/logstash/blob/v1.4.2/patterns/grok-patterns
grok{
match => {
"message" => "%{COMBINEDAPACHELOG}"
}
}
#mutate convert data types
mutate{
convert => { "bytes" => "integer" }
}
#date plugin format dates
date {
match => [ "timestamp", "dd/MMM/YYYY:HH:mm:ss Z" ]
locale => en
remove_field => "timestamp"
}
#geoip filter gets client ip from request
geoip {
source => "clientip"
}
}
output
{
#standard output on console
stdout {
codec => rubydebug
}
#output to elasticsearch hosts
elasticsearch {
hosts => ["host:9200"]
user => "user"
password => "Pass"
}
}
Anyone, can guide on how to resolve this issue?
Thanks,
Grace