# Filebeat indices for each type of source log

**URL:** https://discuss.elastic.co/t/filebeat-indices-for-each-type-of-source-log/244410
**Category:** Beats
**Tags:** filebeat
**Created:** [August 10, 2020, 1:59pm UTC](https://discuss.elastic.co/t/filebeat-indices-for-each-type-of-source-log/244410 "2020-08-10T13:59:23Z")
**Posts on this page:** 5
**Page:** 1

<div class="post-metadata">

### Author: ![robertitox](https://avatars.discourse-cdn.com/v4/letter/r/4491bb/32.png) [@robertitox](https://discuss.elastic.co/u/robertitox)
#### Post date: [August 10, 2020, 1:59pm UTC](https://discuss.elastic.co/t/filebeat-indices-for-each-type-of-source-log/244410/1 "2020-08-10T13:59:23Z")

</div>

Dear all, I have an ELK 7.8.1 server with syslog and cisco module enabled from Filebeat.

At the moment I'm receiving data from:

- Linux servers (syslog)
- Cisco ASA (cisco module, asa data set)
- Cisco IOS (cisco module, ios data set)

All of these data point to filebeat-\* index pattern, and filebeat is the default index with 50 GB of capacity.

Please, I have two questions:

1. Should I have to create a new index to store data coming from Linux servers, another for Cisco ASA and the last one for Cisco IOS ??? Or it's the same to point all of them to filebeat-\* indices ???

2. In case I create new indexes defining index templates, do I have to define every field name and type from each source log??? I think this is hard to do taking into account that Cisco ASA, Cisco IOS and Linux servers have several type of logs.

![image](https://us1.discourse-cdn.com/elastic/original/3X/8/e/8e84409e4fd699140f0e17203ea211c3fb7fbe5c.png)

Special thanks!!!

---

<div class="post-metadata">

### Author: ![shaunak](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/shaunak/32/6643_2.png) [@shaunak](https://discuss.elastic.co/u/shaunak)
#### Post date: [August 10, 2020, 11:21pm UTC](https://discuss.elastic.co/t/filebeat-indices-for-each-type-of-source-log/244410/2 "2020-08-10T23:21:50Z")

</div>

Generally, you do not need to create separate indices to store different types of data being ingested by Filebeat.

The only reason you might want to do this is if you want different types of data to have different lifecycle policies. Otherwise, by default all data being ingested from Filebeat will be indexed into `filebeat-*` indices. The indices are named `filebeat-000001`, `filebeat-000002`, etc. Initially the data will get indexed into `filebeat-000001`. Once this index reaches either [50GB in size or is 30 days old](https://github.com/elastic/beats/blob/091f66de1f8ecbda80ef47089e7062e0ce218245/libbeat/idxmgmt/ilm/config.go#L62-L80), a new index named `filebeat-000002` will automatically be created and data will start getting indexed there. And so on.

---

<div class="post-metadata">

### Author: ![robertitox](https://avatars.discourse-cdn.com/v4/letter/r/4491bb/32.png) [@robertitox](https://discuss.elastic.co/u/robertitox)
#### Post date: [August 11, 2020, 12:38pm UTC](https://discuss.elastic.co/t/filebeat-indices-for-each-type-of-source-log/244410/3 "2020-08-11T12:38:30Z")

</div>

Dear Shaunak, thank you so much for your response.

Let me ask you a last question:

Having different indices for each type of data, is it better to search or store tasks performance times? Or it's the same as having just one index filebeat-\* ?

Regards!!!

---

<div class="post-metadata">

### Author: ![shaunak](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/shaunak/32/6643_2.png) [@shaunak](https://discuss.elastic.co/u/shaunak)
#### Post date: [August 12, 2020, 7:05pm UTC](https://discuss.elastic.co/t/filebeat-indices-for-each-type-of-source-log/244410/4 "2020-08-12T19:05:31Z")

</div>

As I mentioned in my previous comment, it depends on whether you need each type of data to have different lifecycles. The other reason you might want different indices is if you want each index to have different number of shards or different number of replicas, or really any other [index-level settings](https://www.elastic.co/guide/en/elasticsearch/reference/current/index-modules.html#index-modules-settings).

Personally I would suggest starting out with the defaults provided by Filebeat and Elasticsearch. If you start seeing specific problems or find yourself having specific use cases that aren't being satisfied with the defaults, then you can tune your setup accordingly, depending on what the specific needs are.

Shaunak

---

<div class="post-metadata">

### Author: ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)
#### Post date: [September 9, 2020, 9:05pm UTC](https://discuss.elastic.co/t/filebeat-indices-for-each-type-of-source-log/244410/5 "2020-09-09T21:05:51Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
