# Logstash config with filebeat fields

**URL:** <https://discuss.elastic.co/t/logstash-config-with-filebeat-fields/166373>\
**Category:** Logstash\
**Created:** [January 30, 2019, 2:12pm UTC](https://discuss.elastic.co/t/logstash-config-with-filebeat-fields/166373 "2019-01-30T14:12:54Z")\
**Posts on this page:** 10\
**Page:** 1

<div class="post-metadata">

**Author:** ![sundarm](https://avatars.discourse-cdn.com/v4/letter/s/9de0a6/32.png) [@sundarm](https://discuss.elastic.co/u/sundarm)\
**Post date:** [January 30, 2019, 2:12pm UTC](https://discuss.elastic.co/t/logstash-config-with-filebeat-fields/166373/1 "2019-01-30T14:12:54Z")

</div>

HI,

```
 I have filebeat installed on all my dev server and qa server in my filebeat config i have added the field as env: dev and env:qa how do i use this in my logstash config output index pattern. i tried this method but its not working index =>"%{env} -%{+YYYY.MM.dd}"  

```

Thanks

---

<div class="post-metadata">

**Author:** ![Badger](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/badger/32/25190_2.png) [@Badger](https://discuss.elastic.co/u/Badger)\
**Post date:** [January 30, 2019, 2:34pm UTC](https://discuss.elastic.co/t/logstash-config-with-filebeat-fields/166373/2 "2019-01-30T14:34:45Z")

</div>

> [@sundarm](#):
>
> index =\>"%{env} -%{+YYYY.MM.dd}"

What result to you get? What do you mean by "its not working"?

---

<div class="post-metadata">

**Author:** ![sundarm](https://avatars.discourse-cdn.com/v4/letter/s/9de0a6/32.png) [@sundarm](https://discuss.elastic.co/u/sundarm)\
**Post date:** [January 30, 2019, 3:47pm UTC](https://discuss.elastic.co/t/logstash-config-with-filebeat-fields/166373/3 "2019-01-30T15:47:26Z")

</div>

Hi ,

i am getting this error .  
Invalid index name [%{env} -2019.01.30]

Thanks

---

<div class="post-metadata">

**Author:** ![Badger](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/badger/32/25190_2.png) [@Badger](https://discuss.elastic.co/u/Badger)\
**Post date:** [January 30, 2019, 3:56pm UTC](https://discuss.elastic.co/t/logstash-config-with-filebeat-fields/166373/4 "2019-01-30T15:56:43Z")

</div>

> [@sundarm](#):
>
> Invalid index name [%{env} -2019.01.30]

That's invalid because it contains a space character, but if that's what you get in the error message it may mean %{env} was not substituted because the env field does not exist.

---

<div class="post-metadata">

**Author:** ![pjanzen](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/pjanzen/32/13756_2.png) [@pjanzen](https://discuss.elastic.co/u/pjanzen)\
**Post date:** [January 30, 2019, 3:57pm UTC](https://discuss.elastic.co/t/logstash-config-with-filebeat-fields/166373/5 "2019-01-30T15:57:41Z")

</div>

> [@sundarm](#):
>
> index =\>"%{env} -%{+YYYY.MM.dd}"

There is a space in the index name and that is not alllowed...

Change

```auto
index =>"%{env} -%{+YYYY.MM.dd}"

```

To

```auto
index =>"%{env}-%{+YYYY.MM.dd}"

```

That should clear up your error...

---

<div class="post-metadata">

**Author:** ![sundarm](https://avatars.discourse-cdn.com/v4/letter/s/9de0a6/32.png) [@sundarm](https://discuss.elastic.co/u/sundarm)\
**Post date:** [January 30, 2019, 9:16pm UTC](https://discuss.elastic.co/t/logstash-config-with-filebeat-fields/166373/6 "2019-01-30T21:16:11Z")

</div>

HI,

Since i have added in my filebeats.yml  
fields  
env: qa

I am getting this same in my output. But still the index pattern is not working as expected . (example env:dev env:qa)

Thanks

---

<div class="post-metadata">

**Author:** ![Badger](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/badger/32/25190_2.png) [@Badger](https://discuss.elastic.co/u/Badger)\
**Post date:** [January 30, 2019, 9:23pm UTC](https://discuss.elastic.co/t/logstash-config-with-filebeat-fields/166373/7 "2019-01-30T21:23:19Z")

</div>

Have you looked at an event in Kibana? Does it have an env field? If you do not set fields\_under\_root then you may have [fields][env] instead of [env].

---

<div class="post-metadata">

**Author:** ![sundarm](https://avatars.discourse-cdn.com/v4/letter/s/9de0a6/32.png) [@sundarm](https://discuss.elastic.co/u/sundarm)\
**Post date:** [January 30, 2019, 9:45pm UTC](https://discuss.elastic.co/t/logstash-config-with-filebeat-fields/166373/8 "2019-01-30T21:45:56Z")

</div>

Hi,

Yes in my kibana events i am getting as fields.env:qa but still i am not able to index this pattern as qa or dev

Thanks

---

<div class="post-metadata">

**Author:** ![Badger](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/badger/32/25190_2.png) [@Badger](https://discuss.elastic.co/u/Badger)\
**Post date:** [January 30, 2019, 10:49pm UTC](https://discuss.elastic.co/t/logstash-config-with-filebeat-fields/166373/9 "2019-01-30T22:49:44Z")

</div>

OK. So try

```
index =>"%{[fields][env]}-%{+YYYY.MM.dd}"
```

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [February 27, 2019, 10:49pm UTC](https://discuss.elastic.co/t/logstash-config-with-filebeat-fields/166373/10 "2019-02-27T22:49:50Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
