# Is PQ needed for logstash kinesis input plugin?

**URL:** <https://discuss.elastic.co/t/is-pq-needed-for-logstash-kinesis-input-plugin/225970>\
**Category:** Logstash\
**Created:** [April 1, 2020, 4:10am UTC](https://discuss.elastic.co/t/is-pq-needed-for-logstash-kinesis-input-plugin/225970 "2020-04-01T04:10:59Z")\
**Posts on this page:** 4\
**Page:** 1

<div class="post-metadata">

**Author:** ![deepak\_deore](https://avatars.discourse-cdn.com/v4/letter/d/9fc29f/32.png) [@deepak\_deore](https://discuss.elastic.co/u/deepak_deore)\
**Post date:** [April 1, 2020, 4:10am UTC](https://discuss.elastic.co/t/is-pq-needed-for-logstash-kinesis-input-plugin/225970/1 "2020-04-01T04:10:59Z")

</div>

logstash pulls the logs from aws kinesis, so it will read as per its own speed and there wont be sudden spike because data isnt pushed to logstash instead logstash pulls it.

in this case is PQ (persistent queue) really needed?

---

<div class="post-metadata">

**Author:** ![deepak\_deore](https://avatars.discourse-cdn.com/v4/letter/d/9fc29f/32.png) [@deepak\_deore](https://discuss.elastic.co/u/deepak_deore)\
**Post date:** [April 3, 2020, 4:29am UTC](https://discuss.elastic.co/t/is-pq-needed-for-logstash-kinesis-input-plugin/225970/2 "2020-04-03T04:29:21Z")

</div>

does anyone know the answer?

---

<div class="post-metadata">

**Author:** ![Mike.Heyns](https://avatars.discourse-cdn.com/v4/letter/m/da6949/32.png) [@Mike.Heyns](https://discuss.elastic.co/u/Mike.Heyns)\
**Post date:** [April 17, 2020, 5:09am UTC](https://discuss.elastic.co/t/is-pq-needed-for-logstash-kinesis-input-plugin/225970/3 "2020-04-17T05:09:20Z")

</div>

I presume persistent queues may help preserve events that were pulled from Kinesis but weren't able to reach ElasticSearch. (cluster maintenance?)

But this is just speculation. I can't find information on if PQ is compatible with Kinesis input.

Confirmation would be really helpful. Or better yet, updated documentation.

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [May 15, 2020, 5:09am UTC](https://discuss.elastic.co/t/is-pq-needed-for-logstash-kinesis-input-plugin/225970/4 "2020-05-15T05:09:24Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.