I am getting the following error. while trying to run S3 input
[2019-04-24T17:46:30,448][INFO ][logstash.pipeline ] Starting pipeline {:pipeline_id=>"main", "pipeline.workers"=>2, "pipeline.batch.size"=>125, "pipeline.batch.delay"=>50}
[2019-04-24T17:46:31,280][INFO ][logstash.outputs.elasticsearch] Elasticsearch pool URLs updated {:changes=>{:removed=>, :added=>[http://elastic:xxxxxx@104.248.72.193:5601/]}}
[2019-04-24T17:46:31,811][WARN ][logstash.outputs.elasticsearch] Restored connection to ES instance {:url=>"http://elastic:xxxxxx@104.248.72.193:5601/"}
[2019-04-24T17:46:31,975][ERROR][logstash.pipeline ] Error registering plugin {:pipeline_id=>"main", :plugin=>"#LogStash::OutputDelegator:0x25300336", :error=>"Unexpected character ('<' (code 60)): expected a valid value (number, String, array, object, 'true', 'false' or 'null')\n at [Source: (byte)"<html lang="en"><meta charset="utf-8"><meta http-equiv="X-UA-Compatible" content="IE=edge,chrome=1"><meta name="viewport" content="width=device-width">Kibana@font-face {\n font-family: 'Open Sans';\n font-style: normal;\n font-weight: 300;\n src: local('Open Sans Light'), local('OpenSans-Light'),\n url('/ui/fonts/open_sans/open_sans_v15_latin_300.woff2') format('woff2'),\n url('/ui/fonts/open_sans/open_sans_v15_latin_300.woff') format('woff'),"[truncated 68711 bytes]; line: 1, column: 2]", :thread=>"#<Thread:0x6b36d161 run>"}
[2019-04-24T17:46:31,985][ERROR][logstash.pipeline ] Pipeline aborted due to error {:pipeline_id=>"main", :exception=>#<LogStash::Json::ParserError: Unexpected character ('<' (code 60)): expected a valid value (number, String, array, object, 'true', 'false' or 'null')
This is my config file
input {
s3 {
"access_key_id" => " "
"secret_access_key" => " "
"region" => "us-east-1"
"bucket" => "reports"
"prefix" => "year=2019/month=04/day=24/zipcode=2304/"
"interval" => "10"
"additional_settings" => {
"force_path_style" => true
"follow_redirects" => false
}
}
}
output {
elasticsearch {
hosts => "http://104.248.72.193:5601"
index => "logs"
user => "elastic"
password => " "
}
}
logstash-6.6.1-1.noarch
Plugin version
logstash-output-s3 (4.1.7)
logstash-output-sns (4.0.7)
logstash-output-sqs (5.1.2)
logstash-output-stdout (3.1.4)
logstash-output-tcp (5.0.4)
logstash-output-udp (3.0.6)
logstash-output-webhdfs (3.0.6)
logstash-patterns-core (4.1.2)
Regards,
Prem.