I am configuring to read from s3 like below:
input {
s3 {
access_key_id => ""
secret_access_key => "********"
bucket => "fotolia-prod-logs"
region => "eu-west-1"
type => "syslog"
delete => false
}
}
But get invalid config error from s3 part:
fetched an invalid config {:config=>"input {\n s3 {\n access_key_id => "ASIAIK7HB5C7TJIDRYXA"\n secret_access_key => "Uyr5uU307vUrQVWtRdqu5ykFIm+S+ttnlE7hn54L"\n bucket => "fotolia-prod-logs"\n region => "eu-west-1"\n type => "syslog"\n delete => false\n}\n}\n\n\nfilter {\n grok{\n break_on_match => false \n match => { "message" => "%{SYSLOGBASE} %{GREEDYDATA:message}" }\n overwrite => [ "message" ] \n} \n}\n\n\noutput {\n stdout { codec => rubydebug }\n}\n\n", :reason=>"Expected one of #, ", ', } at line 3, column 1 (byte 17) after input {\n s3 {\n", :level=>:error}
Should I specify a prefix? But the prefix are all different, like 2016/01/event_log/generic.log; 2015/10/event_log/generic.log. etc..