# Latest

**URL:** https://discuss.elastic.co/latest.md?page=1889

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1890

---

## [Elasticsearch7.x have serious performance problems](https://discuss.elastic.co/t/elasticsearch7-x-have-serious-performance-problems/261362)

<div class="topic-metadata">

**Author:** [@gaocx2000cn](https://discuss.elastic.co/u/gaocx2000cn)\
**Replies:** 2\
**Last updated:** [January 18, 2021, 12:47am UTC](https://discuss.elastic.co/t/elasticsearch7-x-have-serious-performance-problems/261362 "2021-01-18T00:47:05Z")

</div>

Elasticsearch7.x have serious performance problems. We have a indexes set which have total 3800M doc, 5000G bytes. 1. Searching performance We run a lot of queries against Elasticsearch6.2.1 and Elasticsearch7.9.2 clu…

---

## [I want to add more nodes in my existing cluster](https://discuss.elastic.co/t/i-want-to-add-more-nodes-in-my-existing-cluster/261233)

<div class="topic-metadata">

**Author:** [@Rohit\_Kumbhar](https://discuss.elastic.co/u/Rohit_Kumbhar)\
**Replies:** 7\
**Last updated:** [January 17, 2021, 10:50pm UTC](https://discuss.elastic.co/t/i-want-to-add-more-nodes-in-my-existing-cluster/261233 "2021-01-17T22:50:26Z")

</div>

Hi, I have 3 Node cluster (7.9.2) with elasticsearch license. I want to add more 5 Data nodes on my existing cluster. Do I need to have License for extra nodes also? Please Help me with this situation Thanks Regard…

---

## [Seamingly sporadic increases in indexing latency](https://discuss.elastic.co/t/seamingly-sporadic-increases-in-indexing-latency/261166)

<div class="topic-metadata">

**Author:** [@rex-remind](https://discuss.elastic.co/u/rex-remind)\
**Replies:** 21\
**Last updated:** [January 17, 2021, 10:29pm UTC](https://discuss.elastic.co/t/seamingly-sporadic-increases-in-indexing-latency/261166 "2021-01-17T22:29:30Z")

</div>

We have a setup where Flink is writing to Elasticsearch, and at sporadic moments latency increases due to volume of IOPS. Looking for suggestions. Attached are some graphs, when IOPS are high, indexing latency is high, …

---

## [Need help regarding relevancy score sorting in elastic search](https://discuss.elastic.co/t/need-help-regarding-relevancy-score-sorting-in-elastic-search/261361)

<div class="topic-metadata">

**Author:** [@Soumya\_Ranjan\_Sahoo](https://discuss.elastic.co/u/Soumya_Ranjan_Sahoo)\
**Replies:** 0\
**Last updated:** [January 17, 2021, 9:57pm UTC](https://discuss.elastic.co/t/need-help-regarding-relevancy-score-sorting-in-elastic-search/261361 "2021-01-17T21:57:25Z")

</div>

\### Settings for Indexing ### import requests import json import logging settings = { 'settings': { 'index': { 'number\_of\_shards': 1, 'number\_of\_replicas': 1, …

---

## [How does one restore just missing backups from a snapshot](https://discuss.elastic.co/t/how-does-one-restore-just-missing-backups-from-a-snapshot/261308)

<div class="topic-metadata">

**Author:** [@Russell\_Fulton](https://discuss.elastic.co/u/Russell_Fulton)\
**Replies:** 2\
**Last updated:** [January 17, 2021, 9:10pm UTC](https://discuss.elastic.co/t/how-does-one-restore-just-missing-backups-from-a-snapshot/261308 "2021-01-17T21:10:55Z")

</div>

I am recovering from a disaster with my cluster and I have a lost about 150 out of 500 indexes. What I would like to do is restore just the missing ones from kibana but not the ones that are OK. Is there a way to do t…

---

## [\[Logstash\] elasticsearch filter error on mark logs](https://discuss.elastic.co/t/logstash-elasticsearch-filter-error-on-mark-logs/261293)

<div class="topic-metadata">

**Author:** [@Joao\_Palma](https://discuss.elastic.co/u/Joao_Palma)\
**Replies:** 3\
**Last updated:** [January 17, 2021, 8:25pm UTC](https://discuss.elastic.co/t/logstash-elasticsearch-filter-error-on-mark-logs/261293 "2021-01-17T20:25:29Z")

</div>

Hello, I have two pipeline one main, listen filebeat and put data in elastic, and other with post process, the input is elastic, have one elastic filter (bellow), and put back data in elastic with updates. The main goa…

---

## [Can't curl a just installed elastic in a vm - time out issues](https://discuss.elastic.co/t/cant-curl-a-just-installed-elastic-in-a-vm-time-out-issues/261359)

<div class="topic-metadata">

**Author:** [@Simon\_Poirier](https://discuss.elastic.co/u/Simon_Poirier)\
**Replies:** 2\
**Last updated:** [January 17, 2021, 7:39pm UTC](https://discuss.elastic.co/t/cant-curl-a-just-installed-elastic-in-a-vm-time-out-issues/261359 "2021-01-17T19:39:27Z")

</div>

Hi there, I have a VM with Elastic and kibana working fine in an 20.04 ubuntu. I am now trying to send curl operations on the rest api, from my host, but i got timed out. in the vm it's working fine. when i do : sudo …

---

## [How does Elasticsearch map Integer doc IDs to shards](https://discuss.elastic.co/t/how-does-elasticsearch-map-integer-doc-ids-to-shards/261329)

<div class="topic-metadata">

**Author:** [@rex-remind](https://discuss.elastic.co/u/rex-remind)\
**Replies:** 7\
**Last updated:** [January 17, 2021, 6:58pm UTC](https://discuss.elastic.co/t/how-does-elasticsearch-map-integer-doc-ids-to-shards/261329 "2021-01-17T18:58:59Z")

</div>

How does Elasticsearch map Integer doc IDs to shards? What algorithm does it use? I've been digging around but haven't seemed to find the answer. For context, every document we have has an id that's a row id from postg…

---

## [Lines chart visualization problem](https://discuss.elastic.co/t/lines-chart-visualization-problem/261356)

<div class="topic-metadata">

**Author:** [@Tim\_Zachow](https://discuss.elastic.co/u/Tim_Zachow)\
**Replies:** 2\
**Last updated:** [January 17, 2021, 6:56pm UTC](https://discuss.elastic.co/t/lines-chart-visualization-problem/261356 "2021-01-17T18:56:54Z")

</div>

Good day everyone, I successfully loaded a data set into my elasticsearch index about import data of a given country. As you can see, it seems bugged since not every line is getting visualized correctly. I'm fairly ce…

---

## [Elasticsearch: Failed to obtain node locks](https://discuss.elastic.co/t/elasticsearch-failed-to-obtain-node-locks/260102)

<div class="topic-metadata">

**Author:** [@rahulnama](https://discuss.elastic.co/u/rahulnama)\
**Replies:** 12\
**Last updated:** [January 17, 2021, 6:34pm UTC](https://discuss.elastic.co/t/elasticsearch-failed-to-obtain-node-locks/260102 "2021-01-17T18:34:45Z")

</div>

Kibana version : 7.8.0 Elasticsearch version : 7.8.0 APM Server version : 7.8.0 Hi Team My elasticsearch server is up and running from more than 2-3 months. All of a sudden it's down today. When I tried to debug I se…

---

## [Logstash read previous events fields from elasticsearch in case of high events rate](https://discuss.elastic.co/t/logstash-read-previous-events-fields-from-elasticsearch-in-case-of-high-events-rate/260756)

<div class="topic-metadata">

**Author:** [@mostafaelsayed](https://discuss.elastic.co/u/mostafaelsayed)\
**Replies:** 3\
**Last updated:** [January 17, 2021, 6:29pm UTC](https://discuss.elastic.co/t/logstash-read-previous-events-fields-from-elasticsearch-in-case-of-high-events-rate/260756 "2021-01-17T18:29:06Z")

</div>

Hello In case of high events rate, if I have multiple events (with predefined order) and I want to copy field from the first event to the subsequent events using logstash elasticsearch filter Is there a way to guarante…

---

## [Elasticsearch OpenJDK process takes over every available TCP port](https://discuss.elastic.co/t/elasticsearch-openjdk-process-takes-over-every-available-tcp-port/261107)

<div class="topic-metadata">

**Author:** [@MiriamJu](https://discuss.elastic.co/u/MiriamJu)\
**Replies:** 5\
**Last updated:** [January 17, 2021, 12:42pm UTC](https://discuss.elastic.co/t/elasticsearch-openjdk-process-takes-over-every-available-tcp-port/261107 "2021-01-17T12:42:16Z")

</div>

Hi, I am facing an issue with Elastic Search: In one of our PCs, The ES Java process took over every available TCP port on the system and held them, so the system entered TCP starvation and failed to continue functionin…

---

## [Direct correlation between pending tasks and GC](https://discuss.elastic.co/t/direct-correlation-between-pending-tasks-and-gc/260704)

<div class="topic-metadata">

**Author:** [@tutunak](https://discuss.elastic.co/u/tutunak)\
**Replies:** 6\
**Last updated:** [January 17, 2021, 12:23pm UTC](https://discuss.elastic.co/t/direct-correlation-between-pending-tasks-and-gc/260704 "2021-01-17T12:23:31Z")

</div>

Hi for all my clusters I see the direct correlation between pending tasks and GC time. What can I do with that? How can avoid this situation?

---

## [Lucene commit failed: checksum failed, while indexing](https://discuss.elastic.co/t/lucene-commit-failed-checksum-failed-while-indexing/253215)

<div class="topic-metadata">

**Author:** [@SuperToma](https://discuss.elastic.co/u/SuperToma)\
**Replies:** 1\
**Last updated:** [January 17, 2021, 8:44am UTC](https://discuss.elastic.co/t/lucene-commit-failed-checksum-failed-while-indexing/253215 "2021-01-17T08:44:07Z")

</div>

Hello guys ! I'm faced with this error while indexing: \[2020-10-24T18:18:31,520\]\[WARN \]\[o.e.i.e.Engine \] \[mini-server\] \[release\]\[0\] failed engine \[lucene commit failed\] org.apache.lucene.index.CorruptInde…

---

## [Why replica shard is not allocated](https://discuss.elastic.co/t/why-replica-shard-is-not-allocated/259768)

<div class="topic-metadata">

**Author:** [@Aniket\_Pant](https://discuss.elastic.co/u/Aniket_Pant)\
**Replies:** 16\
**Last updated:** [January 17, 2021, 8:30am UTC](https://discuss.elastic.co/t/why-replica-shard-is-not-allocated/259768 "2021-01-17T08:30:03Z")

</div>

I have 8 nodes of cluster 3 master node 3 data node and 2 coordinate node.Everyday i saw this Missing replica shards and manually i close those index and open and then refresh those index in kibana and my problem gets so…

---

## ['Access Denied' trying to open Elasticsearch for first time on Windows 10](https://discuss.elastic.co/t/access-denied-trying-to-open-elasticsearch-for-first-time-on-windows-10/261343)

<div class="topic-metadata">

**Author:** [@Rookie2011](https://discuss.elastic.co/u/Rookie2011)\
**Replies:** 1\
**Last updated:** [January 17, 2021, 8:15am UTC](https://discuss.elastic.co/t/access-denied-trying-to-open-elasticsearch-for-first-time-on-windows-10/261343 "2021-01-17T08:15:01Z")

</div>

C:\\Users\\jorda\>cd C:\\Program Files\\Elastic\\Elasticsearch\\7.10.2 C:\\Program Files\\Elastic\\Elasticsearch\\7.10.2\>bin\>elasticsearch-setup-passwords auto Access is denied.

---

## [How to add a global dashboard filter that will only be shown when the dashboard is not embedded](https://discuss.elastic.co/t/how-to-add-a-global-dashboard-filter-that-will-only-be-shown-when-the-dashboard-is-not-embedded/260284)

<div class="topic-metadata">

**Author:** [@ranitg](https://discuss.elastic.co/u/ranitg)\
**Replies:** 5\
**Last updated:** [January 17, 2021, 7:53am UTC](https://discuss.elastic.co/t/how-to-add-a-global-dashboard-filter-that-will-only-be-shown-when-the-dashboard-is-not-embedded/260284 "2021-01-17T07:53:18Z")

</div>

Hi, I'm trying to add a filter to a dashboard without the filter shown in the embedded dashboard. Is there a way to do so? Add it in edit mode, save it and somehow for it not to be visible to the user while he is using…

---

## [Elastic Templates:](https://discuss.elastic.co/t/elastic-templates/261328)

<div class="topic-metadata">

**Author:** [@charleseblack126](https://discuss.elastic.co/u/charleseblack126)\
**Replies:** 4\
**Last updated:** [January 17, 2021, 3:20am UTC](https://discuss.elastic.co/t/elastic-templates/261328 "2021-01-17T03:20:19Z")

</div>

I have installed Winlogbeats and have created an elastic template using a PowerShell statement. I wish to install it on a version elastic in my Ubuntu installation. The PowerShell statement does not allow transfer of tha…

---

## [Score calculation with nested object](https://discuss.elastic.co/t/score-calculation-with-nested-object/261340)

<div class="topic-metadata">

**Author:** [@Indy](https://discuss.elastic.co/u/Indy)\
**Replies:** 0\
**Last updated:** [January 17, 2021, 12:24am UTC](https://discuss.elastic.co/t/score-calculation-with-nested-object/261340 "2021-01-17T00:24:02Z")

</div>

Hello ! I try to do this : I have books, books have many tags. It's a nested relation ! When a user search "starwars vador", I search in all books to find books with this tags. If a book has tags "starwars" and "vado…

---

## [Service elasticsearch start but not the ports](https://discuss.elastic.co/t/service-elasticsearch-start-but-not-the-ports/261292)

<div class="topic-metadata">

**Author:** [@Emiliano\_Baum](https://discuss.elastic.co/u/Emiliano_Baum)\
**Replies:** 2\
**Last updated:** [January 16, 2021, 11:17pm UTC](https://discuss.elastic.co/t/service-elasticsearch-start-but-not-the-ports/261292 "2021-01-16T23:17:36Z")

</div>

Hi , I am struggling with a rare problem, the elasticsearch service starts but not the ports. I have been running a maintenance routine on my cluster and in two nodes I have the same problem, the elastic search service…

---

## [Why 1000 shards?](https://discuss.elastic.co/t/why-1000-shards/261324)

<div class="topic-metadata">

**Author:** [@Aniket\_Pant](https://discuss.elastic.co/u/Aniket_Pant)\
**Replies:** 1\
**Last updated:** [January 16, 2021, 11:17pm UTC](https://discuss.elastic.co/t/why-1000-shards/261324 "2021-01-16T23:17:17Z")

</div>

Why elasticsearch has 1000 shards at a cluster level is there any specific reason because i know too many shards causes memory problem, query speed low, recovery of shards etc

---

## [Elasticsearch: Snapshot repository - index compression - "hard" archiving](https://discuss.elastic.co/t/elasticsearch-snapshot-repository-index-compression-hard-archiving/261334)

<div class="topic-metadata">

**Author:** [@Rysiu](https://discuss.elastic.co/u/Rysiu)\
**Replies:** 1\
**Last updated:** [January 16, 2021, 9:37pm UTC](https://discuss.elastic.co/t/elasticsearch-snapshot-repository-index-compression-hard-archiving/261334 "2021-01-16T21:37:56Z")

</div>

Hi! Are the snapshots taken within elasticsearch repositories compressed in some fairly efficient way by default? When you "permanently" secure (e.g. BD-ROM) a snapshot repository, is it worth compressing it to some ar…

---

## [Match all terms of field with fuzziness](https://discuss.elastic.co/t/match-all-terms-of-field-with-fuzziness/261323)

<div class="topic-metadata">

**Author:** [@floryan](https://discuss.elastic.co/u/floryan)\
**Replies:** 0\
**Last updated:** [January 16, 2021, 5:34pm UTC](https://discuss.elastic.co/t/match-all-terms-of-field-with-fuzziness/261323 "2021-01-16T17:34:01Z")

</div>

Hi everyone, I've been trying to figure out how to perform a specific search but cannot wrap my head around it and was hoping that someone here could give me some helpful input. I'd like to write a query against one sp…

---

## [Metricbeat Index Lifecycle Error](https://discuss.elastic.co/t/metricbeat-index-lifecycle-error/261071)

<div class="topic-metadata">

**Author:** [@Aniket\_Pant](https://discuss.elastic.co/u/Aniket_Pant)\
**Replies:** 3\
**Last updated:** [January 16, 2021, 3:21pm UTC](https://discuss.elastic.co/t/metricbeat-index-lifecycle-error/261071 "2021-01-16T15:21:50Z")

</div>

i am not using user remote\_monitoring\_user i've created user called test as superuser but after an hour it show me unauthorized user remote\_monitoring\_user.I am using metricbeat for ELK i have not used user remote\_mon…

---

## [Elastic Agent - Indeces](https://discuss.elastic.co/t/elastic-agent-indeces/260745)

<div class="topic-metadata">

**Author:** [@blcyb](https://discuss.elastic.co/u/blcyb)\
**Replies:** 2\
**Last updated:** [January 16, 2021, 12:01pm UTC](https://discuss.elastic.co/t/elastic-agent-indeces/260745 "2021-01-16T12:01:25Z")

</div>

Is it possible to send Elastic Agent data based on the policy applied to it or namespace when deployed via fleet? E.g. Group 1 sensors have data sent to a specfic set of indices specifically for group 2 and the same for …

---

## [TSVB math aggregation on multiple series](https://discuss.elastic.co/t/tsvb-math-aggregation-on-multiple-series/261288)

<div class="topic-metadata">

**Author:** [@Hugo\_Pires](https://discuss.elastic.co/u/Hugo_Pires)\
**Replies:** 4\
**Last updated:** [January 16, 2021, 10:43am UTC](https://discuss.elastic.co/t/tsvb-math-aggregation-on-multiple-series/261288 "2021-01-16T10:43:22Z")

</div>

Hello I've read discussion on https://discuss.elastic.co/t/tsvb-creating-variables-for-math/228385. I was using different series with index pattern override to plot data from two different indexes, but I've figured out…

---

## [Start elasticsearch as a single node](https://discuss.elastic.co/t/start-elasticsearch-as-a-single-node/261317)

<div class="topic-metadata">

**Author:** [@Mohammad\_Mousavi](https://discuss.elastic.co/u/Mohammad_Mousavi)\
**Replies:** 1\
**Last updated:** [January 16, 2021, 10:30am UTC](https://discuss.elastic.co/t/start-elasticsearch-as-a-single-node/261317 "2021-01-16T10:30:50Z")

</div>

Hi, I have a cluster with 3 nodes. it's configured for 1 shard and 2 replica so all 3 nodes have all data. I have a back up of one of them, ( backup from VM ). I'm going to restore and start this backup as a single node…

---

## [The age of index which is using ilm policy management](https://discuss.elastic.co/t/the-age-of-index-which-is-using-ilm-policy-management/261198)

<div class="topic-metadata">

**Author:** [@carpeDiem](https://discuss.elastic.co/u/carpeDiem)\
**Replies:** 7\
**Last updated:** [January 16, 2021, 9:42am UTC](https://discuss.elastic.co/t/the-age-of-index-which-is-using-ilm-policy-management/261198 "2021-01-16T09:42:03Z")

</div>

Hello, I'm currently trying to configure and using ilm lifecycle management and data stream for my indices,we are metting a question,when the index was rollovered,the age of index will be reset,this got us into trouble.…

---

## [Redirect or POST to "press the button"](https://discuss.elastic.co/t/redirect-or-post-to-press-the-button/261289)

<div class="topic-metadata">

**Author:** [@Rnx](https://discuss.elastic.co/u/Rnx)\
**Replies:** 2\
**Last updated:** [January 16, 2021, 9:27am UTC](https://discuss.elastic.co/t/redirect-or-post-to-press-the-button/261289 "2021-01-16T09:27:43Z")

</div>

Hi, my heartbeat (7.8.0) is stuck on page asking for "press the button", to redirect further. Is there any way to configure Heartbeat to get past the page? Output which I'm receiving is: \<!DOCTYPE html\> \<html\> \<body o…

---

## [How to calculate a delta value and show it in visualization](https://discuss.elastic.co/t/how-to-calculate-a-delta-value-and-show-it-in-visualization/261154)

<div class="topic-metadata">

**Author:** [@nguyenduyhung1979](https://discuss.elastic.co/u/nguyenduyhung1979)\
**Replies:** 10\
**Last updated:** [January 16, 2021, 7:41am UTC](https://discuss.elastic.co/t/how-to-calculate-a-delta-value-and-show-it-in-visualization/261154 "2021-01-16T07:41:20Z")

</div>

I have a data in format below: Release Num - Server Name - CPU Average 15.4.001 - App01 - 55.56 15.4.001 - App02 - 34.12 16.1.003 - App01 - 71.04 16.1.003 - App02 - 26.82 What I want is to have a graph displaying o…

[Previous page](https://discuss.elastic.co/latest.md?page=1888)

[Next page](https://discuss.elastic.co/latest.md?page=1890)