# Pushing flush onto Pipeline

**URL:** <https://discuss.elastic.co/t/pushing-flush-onto-pipeline/47802>\
**Category:** Logstash\
**Created:** [April 19, 2016, 2:47pm UTC](https://discuss.elastic.co/t/pushing-flush-onto-pipeline/47802 "2016-04-19T14:47:05Z")\
**Posts on this page:** 5\
**Page:** 1

<div class="post-metadata">

**Author:** ![Mag\_Carl](https://avatars.discourse-cdn.com/v4/letter/m/e274bd/32.png) [@Mag\_Carl](https://discuss.elastic.co/u/Mag_Carl)\
**Post date:** [April 19, 2016, 2:47pm UTC](https://discuss.elastic.co/t/pushing-flush-onto-pipeline/47802/1 "2016-04-19T14:47:05Z")

</div>

I am trying to get twitter feed using below config file

input {  
twitter {

# add your data

consumer\_key =\> "**_"  
consumer\_secret =\>"_**"  
oauth\_token =\> "**_"  
oauth\_token\_secret =\> "_**"  
keywords =\> ["Trump"]  
full\_tweet =\> true  
}  
}  
output {  
stdout { codec =\> rubydebug }  
}  
}

I am putting log below...The last set of lines just keep on repeating..Please help

---

<div class="post-metadata">

**Author:** ![Mag\_Carl](https://avatars.discourse-cdn.com/v4/letter/m/e274bd/32.png) [@Mag\_Carl](https://discuss.elastic.co/u/Mag_Carl)\
**Post date:** [April 19, 2016, 2:48pm UTC](https://discuss.elastic.co/t/pushing-flush-onto-pipeline/47802/2 "2016-04-19T14:48:14Z")

</div>

{:timestamp=\>"2016-04-15T00:08:45.027000+0530", :message=\>"Reading config file", :config\_file=\>"C:/logstash/bin/twitter\_logstash.conf", :level=\>:debug, :file=\>"/logstash/vendor/bundle/jruby/1.9/gems/logstash-core-2.3.1-java/lib/logstash/config/loader.rb", :line=\>"69", :method=\>"local\_config"}  
{:timestamp=\>"2016-04-15T00:08:45.097000+0530", :message=\>"Plugin not defined in namespace, checking for plugin file", :type=\>"input", :name=\>"twitter", :path=\>"logstash/inputs/twitter", :level=\>:debug, :file=\>"/logstash/vendor/bundle/jruby/1.9/gems/logstash-core-2.3.1-java/lib/logstash/plugin.rb", :line=\>"76", :method=\>"lookup"}  
{:timestamp=\>"2016-04-15T00:08:45.707000+0530", :message=\>"Plugin not defined in namespace, checking for plugin file", :type=\>"codec", :name=\>"plain", :path=\>"logstash/codecs/plain", :level=\>:debug, :file=\>"/logstash/vendor/bundle/jruby/1.9/gems/logstash-core-2.3.1-java/lib/logstash/plugin.rb", :line=\>"76", :method=\>"lookup"}  
{:timestamp=\>"2016-04-15T00:08:45.727000+0530", :message=\>"config LogStash::Codecs::Plain/@charset = "UTF-8"", :level=\>:debug, :file=\>"/logstash/vendor/bundle/jruby/1.9/gems/logstash-core-2.3.1-java/lib/logstash/config/mixin.rb", :line=\>"153", :method=\>"config\_init"}  
{:timestamp=\>"2016-04-15T00:08:45.727000+0530", :message=\>"config LogStash::Inputs::Twitter/@consumer\_key = "**"", :level=\>:debug, :file=\>"/logstash/vendor/bundle/jruby/1.9/gems/logstash-core-2.3.1-java/lib/logstash/config/mixin.rb", :line=\>"153", :method=\>"config\_init"}  
{:timestamp=\>"2016-04-15T00:08:45.727000+0530", :message=\>"config LogStash::Inputs::Twitter/@consumer\_secret = ", :level=\>:debug, :file=\>"/logstash/vendor/bundle/jruby/1.9/gems/logstash-core-2.3.1-java/lib/logstash/config/mixin.rb", :line=\>"153", :method=\>"config\_init"}  
{:timestamp=\>"2016-04-15T00:08:45.727000+0530", :message=\>"config LogStash::Inputs::Twitter/@oauth\_token = "**\*\*"", :level=\>:debug, :file=\>"/logstash/vendor/bundle/jruby/1.9/gems/logstash-core-2.3.1-java/lib/logstash/config/mixin.rb", :line=\>"153", :method=\>"config\_init"}  
{:timestamp=\>"2016-04-15T00:08:45.737000+0530", :message=\>"config LogStash::Inputs::Twitter/@oauth\_token\_secret = ", :level=\>:debug, :file=\>"/logstash/vendor/bundle/jruby/1.9/gems/logstash-core-2.3.1-java/lib/logstash/config/mixin.rb", :line=\>"153", :method=\>"config\_init"}  
{:timestamp=\>"2016-04-15T00:08:45.737000+0530", :message=\>"config LogStash::Inputs::Twitter/@keywords = ["logstash"]", :level=\>:debug, :file=\>"/logstash/vendor/bundle/jruby/1.9/gems/logstash-core-2.3.1-java/lib/logstash/config/mixin.rb", :line=\>"153", :method=\>"config\_init"}  
{:timestamp=\>"2016-04-15T00:08:45.737000+0530", :message=\>"config LogStash::Inputs::Twitter/@full\_tweet = true", :level=\>:debug, :file=\>"/logstash/vendor/bundle/jruby/1.9/gems/logstash-core-2.3.1-java/lib/logstash/config/mixin.rb", :line=\>"153", :method=\>"config\_init"}  
{:timestamp=\>"2016-04-15T00:08:45.737000+0530", :message=\>"config LogStash::Inputs::Twitter/@codec = "UTF-8"\>", :level=\>:debug, :file=\>"/logstash/vendor/bundle/jruby/1.9/gems/logstash-core-2.3.1-java/lib/logstash/config/mixin.rb", :line=\>"153", :method=\>"config\_init"}  
{:timestamp=\>"2016-04-15T00:08:45.737000+0530", :message=\>"config LogStash::Inputs::Twitter/@add\_field = {}", :level=\>:debug, :file=\>"/logstash/vendor/bundle/jruby/1.9/gems/logstash-core-2.3.1-java/lib/logstash/config/mixin.rb", :line=\>"153", :method=\>"config\_init"}  
{:timestamp=\>"2016-04-15T00:08:45.737000+0530", :message=\>"config LogStash::Inputs::Twitter/@use\_samples = false", :level=\>:debug,

---

<div class="post-metadata">

**Author:** ![Mag\_Carl](https://avatars.discourse-cdn.com/v4/letter/m/e274bd/32.png) [@Mag\_Carl](https://discuss.elastic.co/u/Mag_Carl)\
**Post date:** [April 19, 2016, 2:48pm UTC](https://discuss.elastic.co/t/pushing-flush-onto-pipeline/47802/3 "2016-04-19T14:48:54Z")

</div>

:file=\>"/logstash/vendor/bundle/jruby/1.9/gems/logstash-core-2.3.1-java/lib/logstash/config/mixin.rb", :line=\>"153", :method=\>"config\_init"}  
{:timestamp=\>"2016-04-15T00:08:45.747000+0530", :message=\>"config LogStash::Inputs::Twitter/@use\_proxy = false", :level=\>:debug, :file=\>"/logstash/vendor/bundle/jruby/1.9/gems/logstash-core-2.3.1-java/lib/logstash/config/mixin.rb", :line=\>"153", :method=\>"config\_init"}  
{:timestamp=\>"2016-04-15T00:08:45.747000+0530", :message=\>"config LogStash::Inputs::Twitter/@proxy\_address = "127.0.0.1"", :level=\>:debug, :file=\>"/logstash/vendor/bundle/jruby/1.9/gems/logstash-core-2.3.1-java/lib/logstash/config/mixin.rb", :line=\>"153", :method=\>"config\_init"}  
{:timestamp=\>"2016-04-15T00:08:45.747000+0530", :message=\>"config LogStash::Inputs::Twitter/@proxy\_port = 3128", :level=\>:debug, :file=\>"/logstash/vendor/bundle/jruby/1.9/gems/logstash-core-2.3.1-java/lib/logstash/config/mixin.rb", :line=\>"153", :method=\>"config\_init"}  
{:timestamp=\>"2016-04-15T00:08:45.747000+0530", :message=\>"Plugin not defined in namespace, checking for plugin file", :type=\>"output", :name=\>"stdout", :path=\>"logstash/outputs/stdout", :level=\>:debug, :file=\>"/logstash/vendor/bundle/jruby/1.9/gems/logstash-core-2.3.1-java/lib/logstash/plugin.rb", :line=\>"76", :method=\>"lookup"}  
{:timestamp=\>"2016-04-15T00:08:45.757000+0530", :message=\>"starting agent", :level=\>:info, :file=\>"/logstash/vendor/bundle/jruby/1.9/gems/logstash-core-2.3.1-java/lib/logstash/agent.rb", :line=\>"207", :method=\>"execute"}  
{:timestamp=\>"2016-04-15T00:08:45.757000+0530", :message=\>"starting pipeline", :id=\>"main", :level=\>:info, :file=\>"/logstash/vendor/bundle/jruby/1.9/gems/logstash-core-2.3.1-java/lib/logstash/agent.rb", :line=\>"461", :method=\>"start\_pipeline"}  
{:timestamp=\>"2016-04-15T00:08:47.014000+0530", :message=\>"Starting twitter tracking", :track=\>"logstash", :level=\>:info, :file=\>"/logstash/vendor/bundle/jruby/1.9/gems/logstash-input-twitter-2.2.2/lib/logstash/inputs/twitter.rb", :line=\>"120", :method=\>"run"}  
{:timestamp=\>"2016-04-15T00:08:47.014000+0530", :message=\>"Plugin not defined in namespace, checking for plugin file", :type=\>"codec", :name=\>"rubydebug", :path=\>"logstash/codecs/rubydebug", :level=\>:debug, :file=\>"/logstash/vendor/bundle/jruby/1.9/gems/logstash-core-2.3.1-java/lib/logstash/plugin.rb", :line=\>"76", :method=\>"lookup"}  
{:timestamp=\>"2016-04-15T00:08:47.054000+0530", :message=\>"config LogStash::Codecs::RubyDebug/@metadata = false", :level=\>:debug, :file=\>"/logstash/vendor/bundle/jruby/1.9/gems/logstash-core-2.3.1-java/lib/logstash/config/mixin.rb", :line=\>"153", :method=\>"config\_init"}  
{:timestamp=\>"2016-04-15T00:08:47.374000+0530", :message=\>"config LogStash::Outputs::Stdout/@codec = false\>", :level=\>:debug,

---

<div class="post-metadata">

**Author:** ![Mag\_Carl](https://avatars.discourse-cdn.com/v4/letter/m/e274bd/32.png) [@Mag\_Carl](https://discuss.elastic.co/u/Mag_Carl)\
**Post date:** [April 19, 2016, 2:49pm UTC](https://discuss.elastic.co/t/pushing-flush-onto-pipeline/47802/4 "2016-04-19T14:49:31Z")

</div>

:file=\>"/logstash/vendor/bundle/jruby/1.9/gems/logstash-core-2.3.1-java/lib/logstash/config/mixin.rb", :line=\>"153", :method=\>"config\_init"}  
{:timestamp=\>"2016-04-15T00:08:47.374000+0530", :message=\>"config LogStash::Outputs::Stdout/@workers = 1", :level=\>:debug, :file=\>"/logstash/vendor/bundle/jruby/1.9/gems/logstash-core-2.3.1-java/lib/logstash/config/mixin.rb", :line=\>"153", :method=\>"config\_init"}  
{:timestamp=\>"2016-04-15T00:08:47.374000+0530", :message=\>"Will start workers for output", :worker\_count=\>1, :class=\>LogStash::Outputs::Stdout, :level=\>:debug, :file=\>"/logstash/vendor/bundle/jruby/1.9/gems/logstash-core-2.3.1-java/lib/logstash/output\_delegator.rb", :line=\>"77", :method=\>"register"}  
{:timestamp=\>"2016-04-15T00:08:47.384000+0530", :message=\>"Starting pipeline", :id=\>"main", :pipeline\_workers=\>8, :batch\_size=\>125, :batch\_delay=\>5, :max\_inflight=\>1000, :level=\>:info, :file=\>"/logstash/vendor/bundle/jruby/1.9/gems/logstash-core-2.3.1-java/lib/logstash/pipeline.rb", :line=\>"188", :method=\>"start\_workers"}  
{:timestamp=\>"2016-04-15T00:08:47.384000+0530", :message=\>"Pipeline main started", :file=\>"/logstash/vendor/bundle/jruby/1.9/gems/logstash-core-2.3.1-java/lib/logstash/agent.rb", :line=\>"465", :method=\>"start\_pipeline"}  
{:timestamp=\>"2016-04-15T00:08:52.393000+0530", :message=\>"Pushing flush onto pipeline", :level=\>:debug, :file=\>"/logstash/vendor/bundle/jruby/1.9/gems/logstash-core-2.3.1-java/lib/logstash/pipeline.rb", :line=\>"458", :method=\>"flush"}  
{:timestamp=\>"2016-04-15T00:08:57.395000+0530", :message=\>"Pushing flush onto pipeline", :level=\>:debug, :file=\>"/logstash/vendor/bundle/jruby/1.9/gems/logstash-core-2.3.1-java/lib/logstash/pipeline.rb", :line=\>"458", :method=\>"flush"}  
{:timestamp=\>"2016-04-15T00:09:02.402000+0530", :message=\>"Pushing flush onto pipeline", :level=\>:debug, :file=\>"/logstash/vendor/bundle/jruby/1.9/gems/logstash-core-2.3.1-java/lib/logstash/pipeline.rb", :line=\>"458", :method=\>"flush"}  
{:timestamp=\>"2016-04-15T00:09:07.402000+0530", :message=\>"Pushing flush onto pipeline", :level=\>:debug, :file=\>"/logstash/vendor/bundle/jruby/1.9/gems/logstash-core-2.3.1-java/lib/logstash/pipeline.rb", :line=\>"458", :method=\>"flush"}  
{:timestamp=\>"2016-04-15T00:09:12.409000+0530", :message=\>"Pushing flush onto pipeline", :level=\>:debug, :file=\>"/logstash/vendor/bundle/jruby/1.9/gems/logstash-core-2.3.1-java/lib/logstash/pipeline.rb", :line=\>"458", :method=\>"flush"}

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [July 6, 2017, 5:01am UTC](https://discuss.elastic.co/t/pushing-flush-onto-pipeline/47802/5 "2017-07-06T05:01:34Z")

</div>