# Logstash maximum indexes

**URL:** <https://discuss.elastic.co/t/logstash-maximum-indexes/248563>\
**Category:** Logstash\
**Created:** [September 14, 2020, 4:31pm UTC](https://discuss.elastic.co/t/logstash-maximum-indexes/248563 "2020-09-14T16:31:12Z")\
**Posts on this page:** 3\
**Page:** 1

<div class="post-metadata">

**Author:** ![headtea](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/headtea/32/24271_2.png) [@headtea](https://discuss.elastic.co/u/headtea)\
**Post date:** [September 14, 2020, 4:31pm UTC](https://discuss.elastic.co/t/logstash-maximum-indexes/248563/1 "2020-09-14T16:31:12Z")

</div>

I saw that today's data is missing in kibana. After investigating I noticed that today's index doesn't exist (I create an index everyday. Today's index should be `filebeat-7.9.0-2020.09.14`)

This is what logstash has to say:

```
[2020-09-14T16:25:15,547][WARN][logstash.outputs.elasticsearch][main][a29a4184179dd47220949906feec16011fdc502307795a338054c74d48168ab8] Could not index event to Elasticsearch. {:status=>400, :action=>["index", {:_id=>nil, :_index=>"filebeat-7.9.0-2020.09.14", :routing=>nil, :_type=>"_doc"}, #<LogStash::Event:0x7f043384>], :response=>{"index"=>{"_index"=>"filebeat-7.9.0-2020.09.14", "_type"=>"_doc", "_id"=>nil, "status"=>400, "error"=>{"type"=>"validation_exception", "reason"=>"Validation Failed: 1: this action would add [2] total shards, but this cluster currently has [1000]/[1000] maximum shards open;"}}}}

```

Does it mean that I have too many indexes? If so, can I increase number of indexes? I don't think it should have that many open.

Thanks ahead!

---

<div class="post-metadata">

**Author:** ![Badger](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/badger/32/25190_2.png) [@Badger](https://discuss.elastic.co/u/Badger)\
**Post date:** [September 14, 2020, 5:48pm UTC](https://discuss.elastic.co/t/logstash-maximum-indexes/248563/2 "2020-09-14T17:48:15Z")

</div>

[This](https://www.elastic.co/blog/how-many-shards-should-i-have-in-my-elasticsearch-cluster) blog post talks about the number of shards in a cluster.

The limit of 1000 can be [changed](https://www.elastic.co/guide/en/elasticsearch/reference/master/modules-cluster.html#misc-cluster-settings), but read that blog to understand why the limit is there by default.

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [October 12, 2020, 5:48pm UTC](https://discuss.elastic.co/t/logstash-maximum-indexes/248563/3 "2020-10-12T17:48:15Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.