Logs filled with thousands of lines from PipelineReporter::Snapshot

Elastic Stack Logstash
1

Hi --

I recently upgraded to logstash 2.2.2 and at certain times my logs are getting filled up with lines like:

{:timestamp=>"2016-05-12T17:59:52.342000+0000", :message=>#<LogStash::PipelineReporter::Snapshot:0x30684855

They are warnings and contain a plethora of information and come every 3 seconds roughly.

I can't see what causes them to show up though. Is there any info in the huge line it produces that I should look for?
Any thing else I should look for?

Thanks.

2

Hi

Trying to resurrect this topic: during ELK deployment we are getting several events on our syslog like the following:

Jul 11 13:42:46 myhost mylogstash[2507]: {:timestamp=>"2016-07-11T11:42:46.332000+0000", :message=>#<LogStash::PipelineReporter::Snapshot:0x237afad8 @data={:events_filtered=>184943, :events_consumed=>184943, :worker_count=>8, :inflight_count=>186, :worker_states=>[{:status=>"sleep", :alive=>true, :index=>0, :inflight_count=>26}, {:status=>"sleep", :alive=>true, :index=>1, :inflight_count=>3}, {:status=>"sleep", :alive=>true, :index=>2, :inflight_count=>12}, {:status=>"sleep", :alive=>true, :index=>3, :inflight_count=>18}, {:status=>"sleep", :alive=>true, :index=>4, :inflight_count=>44}, {:status=>"run", :alive=>true, :index=>5, :inflight_count=>19}, {:status=>"sleep", :alive=>true, :index=>6, :inflight_count=>39}, {:status=>"sleep", :alive=>true, :index=>7, :inflight_count=>25}], :output_info=>[{:type=>"redis", :config=>{"host"=>"...", "ALLOW_ENV"=>true}, :is_multi_worker=>false, :events_received=>65756, :workers=><Java::JavaUtilConcurrent::CopyOnWriteArrayList:-801385667 [<LogStash::Outputs::Redis host=>["myredis"], data_type=>"list", key=>"mylist", codec=><LogStash::Codecs::JSON charset=>"UTF-8">, workers=>1, name=>"default", shuffle_hosts=>true, port=>6379, db=>0, timeout=>5, batch=>false, batch_events=>50, batch_timeout=>5, reconnect_interval=>1, congestion_threshold=>0, congestion_interval=>1>]>, :busy_workers=>0}, {:type=>"redis", :config=>{"host"=>"...", "ALLOW_ENV"=>true}, :is_multi_worker=>false, :events_received=>119187, :workers=><Java::JavaUtilConcurrent::CopyOnWriteArrayList:-793018002 [<LogStash::Outputs::Redis host=>["myredis"], data_type=>"channel", key=>"mykey", codec=><LogStash::Codecs::JSON charset=>"UTF-8">, workers=>1, name=>"default", shuffle_hosts=>true, port=>6379, db=>0, timeout=>5, batch=>false, batch_events=>50, batch_timeout=>5, reconnect_interval=>1, congestion_t

We are concerned about this being somehow related with bottlenecks, memory consumption and OOM in Redis.

Could someone elaborate about what's this, what does it means, how to avoid it...and so on?

Regards