# Create index based in filename in Elasticsearch

**URL:** <https://discuss.elastic.co/t/create-index-based-in-filename-in-elasticsearch/164379>\
**Category:** Elasticsearch\
**Created:** [January 15, 2019, 10:09pm UTC](https://discuss.elastic.co/t/create-index-based-in-filename-in-elasticsearch/164379 "2019-01-15T22:09:30Z")\
**Posts on this page:** 10\
**Page:** 1

<div class="post-metadata">

**Author:** ![vijayakrishna.rg](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/vijayakrishna.rg/32/36798_2.png) [@vijayakrishna.rg](https://discuss.elastic.co/u/vijayakrishna.rg)\
**Post date:** [January 15, 2019, 10:09pm UTC](https://discuss.elastic.co/t/create-index-based-in-filename-in-elasticsearch/164379/1 "2019-01-15T22:09:31Z")

</div>

Hi,

We have new log files get created every time when we run load test on jenkins machine.

Ex:  
Load test1 creates file called: /jenkins/var/lib/simulation-1.log  
Load test2 Creates file: jenkins/var/lib/simulation-2.log.  
Load testx Creates file: jenkins/var/lib/simulation-x.log.

Like the above we will generate more then 10 log files each day, i can create index called "simulation-\*.log", it includes all the logs in single index.

we want to have separate index get created on Elastic machine every time when there is new simulation file with build number, so that we will filter data in kibana based on each simulation log file.

Please suggest me how can we send those logs from Jenkins machine to Elastic machine separately, Thanks.

---

<div class="post-metadata">

**Author:** ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)\
**Post date:** [January 15, 2019, 10:24pm UTC](https://discuss.elastic.co/t/create-index-based-in-filename-in-elasticsearch/164379/2 "2019-01-15T22:24:03Z")

</div>

Why not just create a filter for each filename?

---

<div class="post-metadata">

**Author:** ![vijayakrishna.rg](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/vijayakrishna.rg/32/36798_2.png) [@vijayakrishna.rg](https://discuss.elastic.co/u/vijayakrishna.rg)\
**Post date:** [January 15, 2019, 10:30pm UTC](https://discuss.elastic.co/t/create-index-based-in-filename-in-elasticsearch/164379/3 "2019-01-15T22:30:33Z")

</div>

Filter in Kibana Dashboard?

---

<div class="post-metadata">

**Author:** ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)\
**Post date:** [January 15, 2019, 10:30pm UTC](https://discuss.elastic.co/t/create-index-based-in-filename-in-elasticsearch/164379/4 "2019-01-15T22:30:50Z")

</div>

Yep.

---

<div class="post-metadata">

**Author:** ![vijayakrishna.rg](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/vijayakrishna.rg/32/36798_2.png) [@vijayakrishna.rg](https://discuss.elastic.co/u/vijayakrishna.rg)\
**Post date:** [January 15, 2019, 10:31pm UTC](https://discuss.elastic.co/t/create-index-based-in-filename-in-elasticsearch/164379/5 "2019-01-15T22:31:34Z")

</div>

it means elastic will create a separate index based on file name automatically?

---

<div class="post-metadata">

**Author:** ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)\
**Post date:** [January 15, 2019, 10:32pm UTC](https://discuss.elastic.co/t/create-index-based-in-filename-in-elasticsearch/164379/6 "2019-01-15T22:32:32Z")

</div>

No, it means you don't need to worry about that complexity, and you can simply filter to the file you want.

---

<div class="post-metadata">

**Author:** ![vijayakrishna.rg](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/vijayakrishna.rg/32/36798_2.png) [@vijayakrishna.rg](https://discuss.elastic.co/u/vijayakrishna.rg)\
**Post date:** [January 15, 2019, 10:34pm UTC](https://discuss.elastic.co/t/create-index-based-in-filename-in-elasticsearch/164379/7 "2019-01-15T22:34:31Z")

</div>

how can filter data with build number, only file name contains build number not logs in the file, how can i filter in kibana?

i want to separate logs based on build number.

---

<div class="post-metadata">

**Author:** ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)\
**Post date:** [January 15, 2019, 10:45pm UTC](https://discuss.elastic.co/t/create-index-based-in-filename-in-elasticsearch/164379/8 "2019-01-15T22:45:03Z")

</div>

How are you sending data to Elasticsearch?

---

<div class="post-metadata">

**Author:** ![vijayakrishna.rg](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/vijayakrishna.rg/32/36798_2.png) [@vijayakrishna.rg](https://discuss.elastic.co/u/vijayakrishna.rg)\
**Post date:** [January 15, 2019, 10:47pm UTC](https://discuss.elastic.co/t/create-index-based-in-filename-in-elasticsearch/164379/9 "2019-01-15T22:47:07Z")

</div>

I am using fluentd for Kubernetes logs, Filebeat for Nginx and kafka logs.

in the same way either i use filebeat or logstash to forward logs from jenkins machine to Elasticsearch, i haven't tried before that make sure clarify recommended way.

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [February 12, 2019, 10:47pm UTC](https://discuss.elastic.co/t/create-index-based-in-filename-in-elasticsearch/164379/10 "2019-02-12T22:47:09Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
