# Help for extra large load

**URL:** <https://discuss.elastic.co/t/help-for-extra-large-load/296380>\
**Category:** Elasticsearch\
**Created:** [February 6, 2022, 8:30am UTC](https://discuss.elastic.co/t/help-for-extra-large-load/296380 "2022-02-06T08:30:04Z")\
**Posts on this page:** 6\
**Page:** 1

<div class="post-metadata">

**Author:** ![Milad\_Akhlaghi](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/milad_akhlaghi/32/99256_2.png) [@Milad\_Akhlaghi](https://discuss.elastic.co/u/Milad_Akhlaghi)\
**Post date:** [February 6, 2022, 8:30am UTC](https://discuss.elastic.co/t/help-for-extra-large-load/296380/1 "2022-02-06T08:30:04Z")

</div>

Hi Everybody,  
I have 20 machines that each one has about 100,000 logs per minute, I'm using elk right now but the problem is sometimes logs are not showing real-time in kibana discovery. I used tuning, performance got better but the delayed logs were not fixed. any suggestions or tips fellas?

---

<div class="post-metadata">

**Author:** ![Christian\_Dahlqvist](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/christian_dahlqvist/32/4617_2.png) [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)\
**Post date:** [February 6, 2022, 8:41am UTC](https://discuss.elastic.co/t/help-for-extra-large-load/296380/2 "2022-02-06T08:41:15Z")

</div>

I think you need to provide some additional information in order to allow someone to help, e.g:

- Which version of Elasticsearch are you using?
- What is the full output of the [cluster stats API](https://www.elastic.co/guide/en/elasticsearch/reference/current/cluster-stats.html)?
- What is the specification of your cluster with respect to node types, configuration and hardware used (CPUs, RAM and type of storage used)?
- Have you followed [these guidelines](https://www.elastic.co/guide/en/elasticsearch/reference/7.17/tune-for-indexing-speed.html)?
- How are you indexing data into Elasticsearch?
- How many different types of data are you ingesting? How many different indices and shards are you actively indexing into?

---

<div class="post-metadata">

**Author:** ![Milad\_Akhlaghi](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/milad_akhlaghi/32/99256_2.png) [@Milad\_Akhlaghi](https://discuss.elastic.co/u/Milad_Akhlaghi)\
**Post date:** [February 7, 2022, 9:15am UTC](https://discuss.elastic.co/t/help-for-extra-large-load/296380/3 "2022-02-07T09:15:28Z")

</div>

Hi dear Christian  
I'm using version 7.16  
I have 9 Elasticsearch and 5 logstash  
8 core CPU and 16 G ram on each elastic, 8 core CPU and 12 G ram on each logstash.  
yes, I used these guidelines.  
3 kinds of log levels (custom logs) about 5 indices 1 shard .  
this problem appears sometimes not always.  
I can't find the problem I don't know if it's a network problem or something else.  
thank you for your time friend

---

<div class="post-metadata">

**Author:** ![Milad\_Akhlaghi](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/milad_akhlaghi/32/99256_2.png) [@Milad\_Akhlaghi](https://discuss.elastic.co/u/Milad_Akhlaghi)\
**Post date:** [February 9, 2022, 11:28am UTC](https://discuss.elastic.co/t/help-for-extra-large-load/296380/4 "2022-02-09T11:28:50Z")

</div>

do you have any idea what should I do?

---

<div class="post-metadata">

**Author:** ![Christian\_Dahlqvist](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/christian_dahlqvist/32/4617_2.png) [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)\
**Post date:** [February 9, 2022, 11:49am UTC](https://discuss.elastic.co/t/help-for-extra-large-load/296380/5 "2022-02-09T11:49:37Z")

</div>

Can you please answer all the questions I asked?

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [March 9, 2022, 11:50am UTC](https://discuss.elastic.co/t/help-for-extra-large-load/296380/6 "2022-03-09T11:50:35Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
