# Cloudwatch logs input plugin not streaming all log groups

**URL:** <https://discuss.elastic.co/t/cloudwatch-logs-input-plugin-not-streaming-all-log-groups/252300>\
**Category:** Logstash\
**Created:** [October 16, 2020, 5:42am UTC](https://discuss.elastic.co/t/cloudwatch-logs-input-plugin-not-streaming-all-log-groups/252300 "2020-10-16T05:42:04Z")\
**Posts on this page:** 5\
**Page:** 1

<div class="post-metadata">

**Author:** ![sainath](https://avatars.discourse-cdn.com/v4/letter/s/919ad9/32.png) [@sainath](https://discuss.elastic.co/u/sainath)\
**Post date:** [October 16, 2020, 5:42am UTC](https://discuss.elastic.co/t/cloudwatch-logs-input-plugin-not-streaming-all-log-groups/252300/1 "2020-10-16T05:42:04Z")

</div>

Hi ,

I am using cloudwatch log input plugin to stream logs to ES using logstash.  
below is my configuration.

```
input {
    cloudwatch_logs {
       log_group => ["/aws"]
       log_group_prefix => true
       access_key_id => "ABC"
       secret_access_key => "ABCD"
       #since_db => "dev/null"
       #start_position => "beginning"
       #type => "lambda"
       region => "us-east-2"
       
    }

```

But the issue is i am not able to see all log groups in kibana which are available in AWS Cloudwatch.Few of the log groups are missing.

Can you please help me on this..!!

---

<div class="post-metadata">

**Author:** ![sainath](https://avatars.discourse-cdn.com/v4/letter/s/919ad9/32.png) [@sainath](https://discuss.elastic.co/u/sainath)\
**Post date:** [October 27, 2020, 2:07pm UTC](https://discuss.elastic.co/t/cloudwatch-logs-input-plugin-not-streaming-all-log-groups/252300/2 "2020-10-27T14:07:35Z")

</div>

Any help on this ..!!

---

<div class="post-metadata">

**Author:** ![Akshay\_Pandhare](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/akshay_pandhare/32/78248_2.png) [@Akshay\_Pandhare](https://discuss.elastic.co/u/Akshay_Pandhare)\
**Post date:** [November 18, 2020, 4:25am UTC](https://discuss.elastic.co/t/cloudwatch-logs-input-plugin-not-streaming-all-log-groups/252300/3 "2020-11-18T04:25:39Z")

</div>

Hi Sainath, Can you help me to install this cloudwatch\_logs plugin. I did not found this plugin any where in internet. Can you please help me?

---

<div class="post-metadata">

**Author:** ![sainath](https://avatars.discourse-cdn.com/v4/letter/s/919ad9/32.png) [@sainath](https://discuss.elastic.co/u/sainath)\
**Post date:** [November 24, 2020, 11:22am UTC](https://discuss.elastic.co/t/cloudwatch-logs-input-plugin-not-streaming-all-log-groups/252300/4 "2020-11-24T11:22:18Z")

</div>

> **[lukewaite/logstash-input-cloudwatch-logs](https://github.com/lukewaite/logstash-input-cloudwatch-logs)**
>
> Input plugin for Logstash to stream events from CloudWatch Logs - lukewaite/logstash-input-cloudwatch-logs

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [December 22, 2020, 11:22am UTC](https://discuss.elastic.co/t/cloudwatch-logs-input-plugin-not-streaming-all-log-groups/252300/5 "2020-12-22T11:22:27Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.