Unable to get the logs either to File or Elasticsearch using logstash-input-azureblob plugin for logstash.
Used this config,
input
{
azureblob
{
storage_account_name => "storage_account_name"
storage_access_key => "storage_key"
container => "container_name"
}
}
output
{
file {
path => '/tmp/output.txt'
codec => rubydebug
}
stdout {
codec => rubydebug
}
}
########
2017-12-11 11:57:26,485 main ERROR Unable to locate appender "${sys:ls.log.format}_console" for logger config "root"
2017-12-11 11:57:26,486 main ERROR Unable to locate appender "${sys:ls.log.format}_rolling" for logger config "root"
2017-12-11 11:57:26,486 main ERROR Unable to locate appender "${sys:ls.log.format}_rolling_slowlog" for logger config "slowlog"
2017-12-11 11:57:26,487 main ERROR Unable to locate appender "${sys:ls.log.format}_console_slowlog" for logger config "slowlog"
2017-12-11 11:57:29,486 main ERROR Unable to locate appender "${sys:ls.log.format}_console" for logger config "root"
2017-12-11 11:57:29,493 main ERROR Unable to locate appender "${sys:ls.log.format}_rolling" for logger config "root"
2017-12-11 11:57:29,494 main ERROR Unable to locate appender "${sys:ls.log.format}_rolling_slowlog" for logger config "slowlog"
2017-12-11 11:57:29,494 main ERROR Unable to locate appender "${sys:ls.log.format}_console_slowlog" for logger config "slowlog"
Sending Logstash's logs to /home/logziotest/logstash-6.0.0/logs which is now configured via log4j2.properties
[2017-12-11T11:57:29,628][INFO ][logstash.modules.scaffold] Initializing module {:module_name=>"fb_apache", :directory=>"/home/logziotest/logstash-6.0.0/modules/fb_apache/configuration"}
[2017-12-11T11:57:29,634][INFO ][logstash.modules.scaffold] Initializing module {:module_name=>"netflow", :directory=>"/home/logziotest/logstash-6.0.0/modules/netflow/configuration"}
[2017-12-11T11:57:29,980][WARN ][logstash.config.source.multilocal] Ignoring the 'pipelines.yml' file because modules or command line options are specified
[2017-12-11T11:57:30,528][INFO ][logstash.agent ] Successfully started Logstash API endpoint {:port=>9600}
[2017-12-11T11:57:32,191][INFO ][logstash.inputs.logstashinputazureblob] Using version 0.9.x input plugin 'azureblob'. This plugin should work but would benefit from use by folks like you. Please let us know if you find bugs or have suggestions on how to improve this plugin.
[2017-12-11T11:57:32,509][INFO ][logstash.pipeline ] Starting pipeline {:pipeline_id=>"main", "pipeline.workers"=>1, "pipeline.batch.size"=>125, "pipeline.batch.delay"=>5, "pipeline.max_inflight"=>125, :thread=>"#<Thread:0x4ce0bcf2@/home/logziotest/logstash-6.0.0/logstash-core/lib/logstash/pipeline.rb:290 run>"}
[2017-12-11T11:57:35,193][INFO ][logstash.pipeline ] Pipeline started {"pipeline.id"=>"main"}
[2017-12-11T11:57:35,207][INFO ][logstash.agent ] Pipelines running {:count=>1, :pipelines=>["main"]}
But would return nothing to the file or stdout.