# Unable to pull from kineses using the kinesis logstash plugin

**URL:** <https://discuss.elastic.co/t/unable-to-pull-from-kineses-using-the-kinesis-logstash-plugin/185466>\
**Category:** Logstash\
**Created:** [June 12, 2019, 4:11pm UTC](https://discuss.elastic.co/t/unable-to-pull-from-kineses-using-the-kinesis-logstash-plugin/185466 "2019-06-12T16:11:26Z")\
**Posts on this page:** 2\
**Page:** 1

<div class="post-metadata">

**Author:** ![asrinivasan](https://avatars.discourse-cdn.com/v4/letter/a/b4bc9f/32.png) [@asrinivasan](https://discuss.elastic.co/u/asrinivasan)\
**Post date:** [June 12, 2019, 4:11pm UTC](https://discuss.elastic.co/t/unable-to-pull-from-kineses-using-the-kinesis-logstash-plugin/185466/1 "2019-06-12T16:11:26Z")

</div>

Hi  
I have installed logstash 7.1.1 on centos 7, I have installed the kineseis plugin and codec plugin. the aws credentials and the perm to access the stream are all good what i see in the logs is and shows its connected to my stream  
Jun 12 05:38:43 logstash-server logstash: OpenJDK 64-Bit Server VM warning: If the number of processors is expected to increase from one, then you should configure the number of parallel GC threads appropriately using -XX:ParallelGCThreads=N  
Jun 12 05:39:23 logstash-server logstash: Sending Logstash logs to /var/log/logstash which is now configured via log4j2.properties  
Jun 12 05:39:24 logstash-server logstash: [2019-06-12T05:39:24,759][INFO][logstash.runner] Starting Logstash {"logstash.version"=\>"7.1.1"}  
Jun 12 05:39:37 logstash-server logstash: [2019-06-12T05:39:37,105][INFO][logstash.javapipeline] Starting pipeline {:pipeline\_id=\>"main", "pipeline.workers"=\>1, "pipeline.batch.size"=\>125, "pipeline.batch.delay"=\>50, "pipeline.max\_inflight"=\>125, :thread=\>"#\<Thread:0x550e226f run\>"}  
Jun 12 05:39:37 logstash-server logstash: [2019-06-12T05:39:37,643][INFO][logstash.javapipeline] Pipeline started {"pipeline.id"=\>"main"}  
Jun 12 05:39:37 logstash-server logstash: [2019-06-12T05:39:37,818][INFO][logstash.agent] Pipelines running {:count=\>1, :running\_pipelines=\>[:main], :non\_running\_pipelines=\>}  
Jun 12 05:39:37 logstash-server logstash: Jun 12, 2019 5:39:37 AM com.amazonaws.services.kinesis.clientlibrary.lib.worker.Worker createClient  
Jun 12 05:39:37 logstash-server logstash: WARNING: Received configuration for region as us-west-2.  
Jun 12 05:39:38 logstash-server logstash: Jun 12, 2019 5:39:38 AM com.amazonaws.services.kinesis.clientlibrary.lib.worker.Worker createClient  
Jun 12 05:39:38 logstash-server logstash: WARNING: Received configuration for region as us-west-2.  
Jun 12 05:39:38 logstash-server logstash: Jun 12, 2019 5:39:38 AM com.amazonaws.services.kinesis.clientlibrary.lib.worker.Worker createClient  
Jun 12 05:39:38 logstash-server logstash: WARNING: Received configuration for region as us-west-2.  
Jun 12 05:39:39 logstash-server logstash: [2019-06-12T05:39:39,474][INFO][logstash.agent] Successfully started Logstash API endpoint {:port=\>9600}

As a test i have posted data to my stream using json and also verified pulling it using a python program and all works, however with this configuration

input {  
kinesis {  
kinesis\_stream\_name =\> "estest"  
application\_name =\> "logstash"  
profile =\> "xxxx"  
initial\_position\_in\_stream =\> "TRIM\_HORIZON"  
region =\> "xxxx"

}  
}

output {  
file {  
path =\> "/tmp/estest"

}  
}

With the above config i dont see anything happening, it doesnt seem to pull the messages.  
Plz advise any bug in the plugin or 7.1.1 logstash?

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [July 10, 2019, 4:11pm UTC](https://discuss.elastic.co/t/unable-to-pull-from-kineses-using-the-kinesis-logstash-plugin/185466/2 "2019-07-10T16:11:28Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.