# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=542

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 543

---

## [Trouble authenticating with API Keys and the .Net Client Elasticsearch.Extensions.Logging](https://discuss.elastic.co/t/trouble-authenticating-with-api-keys-and-the-net-client-elasticsearch-extensions-logging/288392)

<div class="topic-metadata">

**Author:** [@ajuch](https://discuss.elastic.co/u/ajuch)\
**Replies:** 1\
**Last updated:** [November 15, 2021, 8:37am UTC](https://discuss.elastic.co/t/trouble-authenticating-with-api-keys-and-the-net-client-elasticsearch-extensions-logging/288392 "2021-11-15T08:37:36Z")

</div>

Hi, I'm having a hard time getting log data from an aspnet core application into an elastic cloud instance. I created an API Key in Kibana and passed the Base64 encoded variant of the API Key and the Cloud ID to the .Ad…

---

## [Elasticsearch-migrate returns java NullPointer error](https://discuss.elastic.co/t/elasticsearch-migrate-returns-java-nullpointer-error/289129)

<div class="topic-metadata">

**Author:** [@bchill](https://discuss.elastic.co/u/bchill)\
**Replies:** 2\
**Last updated:** [November 15, 2021, 7:21am UTC](https://discuss.elastic.co/t/elasticsearch-migrate-returns-java-nullpointer-error/289129 "2021-11-15T07:21:19Z")

</div>

Hello, I am getting a java error when using Elasticsearch-migrate. I realize this tool is deprecated and don't expect help. To simplify the problem, I emptied the users file and created a single user, 'joe', with passw…

---

## [How do I get the real total when PAGING](https://discuss.elastic.co/t/how-do-i-get-the-real-total-when-paging/289156)

<div class="topic-metadata">

**Author:** [@KhalidDu](https://discuss.elastic.co/u/KhalidDu)\
**Replies:** 4\
**Last updated:** [November 15, 2021, 7:16am UTC](https://discuss.elastic.co/t/how-do-i-get-the-real-total-when-paging/289156 "2021-11-15T07:16:04Z")

</div>

When.NET uses NEST for paging query, when I get the total number of data from Hits, I find the maximum value is 10000, but my real data amount should be 50000+, I have set max\_result\_window value to 200000000, but it doe…

---

## [Create automatic indexes per client per day automatically](https://discuss.elastic.co/t/create-automatic-indexes-per-client-per-day-automatically/289148)

<div class="topic-metadata">

**Author:** [@stasya](https://discuss.elastic.co/u/stasya)\
**Replies:** 4\
**Last updated:** [November 15, 2021, 5:14am UTC](https://discuss.elastic.co/t/create-automatic-indexes-per-client-per-day-automatically/289148 "2021-11-15T05:14:38Z")

</div>

Hi All, I am writing the following documents structure into my Elasticsearch: { "date":"2021-11-03", "clientId":"123", ... \<some other fields\> } What I would like to happen, is that whenever a document is written to E…

---

## [Elactic Injection .Data injection to particular node by index name](https://discuss.elastic.co/t/elactic-injection-data-injection-to-particular-node-by-index-name/289051)

<div class="topic-metadata">

**Author:** [@akshay\_dindure1994](https://discuss.elastic.co/u/akshay_dindure1994)\
**Replies:** 1\
**Last updated:** [November 14, 2021, 9:16pm UTC](https://discuss.elastic.co/t/elactic-injection-data-injection-to-particular-node-by-index-name/289051 "2021-11-14T21:16:38Z")

</div>

Hello Team, I have 3 node setup. 1 is master and 2 are data node. i am storing data in 2 data node. But i have one requirement to store data name wise to node. For e.g elastic-kibana-index-2021.01.\* -- \> node 1 a…

---

## [Some logs aren't being received by ElasticSearch / showing in Kibana](https://discuss.elastic.co/t/some-logs-arent-being-received-by-elasticsearch-showing-in-kibana/288139)

<div class="topic-metadata">

**Author:** [@nwright](https://discuss.elastic.co/u/nwright)\
**Replies:** 6\
**Last updated:** [November 14, 2021, 9:08pm UTC](https://discuss.elastic.co/t/some-logs-arent-being-received-by-elasticsearch-showing-in-kibana/288139 "2021-11-14T21:08:13Z")

</div>

I'm using Elasticsearch primarily to record log messages from a .NET API hosted on an AWS lambda. Whenever there are two or more API requests sent to this API, only the logs from one call are sent to Elasticsearch where…

---

## [Elasticsearch 6.8 Windows .msi upgrade from 6.8.2 to 6.8.20, using a service](https://discuss.elastic.co/t/elasticsearch-6-8-windows-msi-upgrade-from-6-8-2-to-6-8-20-using-a-service/289126)

<div class="topic-metadata">

**Author:** [@newschapmj1](https://discuss.elastic.co/u/newschapmj1)\
**Replies:** 1\
**Last updated:** [November 14, 2021, 5:42pm UTC](https://discuss.elastic.co/t/elasticsearch-6-8-windows-msi-upgrade-from-6-8-2-to-6-8-20-using-a-service/289126 "2021-11-14T17:42:55Z")

</div>

We are patching a single node cluster from 6.8.2 to 6.8.20 on Windows server 2012 R2. The original version was installed with .msi I have only had experience using the .zip file previously on Windows I've read the not…

---

## [What is the method to create Index Pattern in Python](https://discuss.elastic.co/t/what-is-the-method-to-create-index-pattern-in-python/289121)

<div class="topic-metadata">

**Author:** [@ElnurHello](https://discuss.elastic.co/u/ElnurHello)\
**Replies:** 4\
**Last updated:** [November 14, 2021, 4:14pm UTC](https://discuss.elastic.co/t/what-is-the-method-to-create-index-pattern-in-python/289121 "2021-11-14T16:14:20Z")

</div>

Hello, All In Python, I use let say "es.indices.put\_index\_template()" method to create Index Template, "es.indices.create()" to create index but what method should be used to create Index Pattern ?

---

## [How to remove scientific format](https://discuss.elastic.co/t/how-to-remove-scientific-format/288843)

<div class="topic-metadata">

**Author:** [@paigekim](https://discuss.elastic.co/u/paigekim)\
**Replies:** 1\
**Last updated:** [November 14, 2021, 2:54pm UTC](https://discuss.elastic.co/t/how-to-remove-scientific-format/288843 "2021-11-14T14:54:02Z")

</div>

Hello, I am currently using Elasticsearch query to find out an accumulated revenue and an accumulated sum. The values calculated fast as I needed it but I would like to get the numbers in float value, not by scientific …

---

## [Refresh interval guarantee](https://discuss.elastic.co/t/refresh-interval-guarantee/289125)

<div class="topic-metadata">

**Author:** [@krezno](https://discuss.elastic.co/u/krezno)\
**Replies:** 2\
**Last updated:** [November 14, 2021, 12:40pm UTC](https://discuss.elastic.co/t/refresh-interval-guarantee/289125 "2021-11-14T12:40:19Z")

</div>

The documentation on refreshes says: By default, Elasticsearch periodically refreshes indices every second, but only on indices that have received one search request or more in the last 30 seconds. What happens if th…

---

## [Shard waiting for node even though the node is back](https://discuss.elastic.co/t/shard-waiting-for-node-even-though-the-node-is-back/289108)

<div class="topic-metadata">

**Author:** [@jthoni](https://discuss.elastic.co/u/jthoni)\
**Replies:** 3\
**Last updated:** [November 14, 2021, 9:35am UTC](https://discuss.elastic.co/t/shard-waiting-for-node-even-though-the-node-is-back/289108 "2021-11-14T09:35:44Z")

</div>

We have a patching run that is hitting our servers. I don't want relocation to happen during the patching, so I set the delay to a window longer than the patching takes. This generally works as the node goes down, then a…

---

## [ES Cluster status with no data nodes](https://discuss.elastic.co/t/es-cluster-status-with-no-data-nodes/289089)

<div class="topic-metadata">

**Author:** [@rschirin](https://discuss.elastic.co/u/rschirin)\
**Replies:** 13\
**Last updated:** [November 13, 2021, 7:31am UTC](https://discuss.elastic.co/t/es-cluster-status-with-no-data-nodes/289089 "2021-11-13T07:31:23Z")

</div>

Hey there, if I start a cluster with 3 nodes from scratch without any DATA nodes, is there a way to mark immediately it with YELLOW status?

---

## [Is there a way to determine the timestamp of index consistency](https://discuss.elastic.co/t/is-there-a-way-to-determine-the-timestamp-of-index-consistency/289025)

<div class="topic-metadata">

**Author:** [@Richard\_Ney](https://discuss.elastic.co/u/Richard_Ney)\
**Replies:** 5\
**Last updated:** [November 12, 2021, 10:21pm UTC](https://discuss.elastic.co/t/is-there-a-way-to-determine-the-timestamp-of-index-consistency/289025 "2021-11-12T22:21:37Z")

</div>

We're designing a system where we are indexing a large number of document and we want the ability to determine a time watermark where we can claim all documents in an index inserted/update before a certain timestamp are …

---

## [Mapbox vector tile with elasticsearch 7.15](https://discuss.elastic.co/t/mapbox-vector-tile-with-elasticsearch-7-15/289092)

<div class="topic-metadata">

**Author:** [@tleduong](https://discuss.elastic.co/u/tleduong)\
**Replies:** 1\
**Last updated:** [November 12, 2021, 10:14pm UTC](https://discuss.elastic.co/t/mapbox-vector-tile-with-elasticsearch-7-15/289092 "2021-11-12T22:14:40Z")

</div>

Anyone have experience enabling mapbox vector tile for Elastic? I have a v7.15 docker container of Elasticsearch running with basic authentication but getting this error when I try to access to index/\_mvt/spatial\_field/:…

---

## [Does elasticsearch provide technical help through any call apps?](https://discuss.elastic.co/t/does-elasticsearch-provide-technical-help-through-any-call-apps/288758)

<div class="topic-metadata">

**Author:** [@MinwooKim](https://discuss.elastic.co/u/MinwooKim)\
**Replies:** 3\
**Last updated:** [November 12, 2021, 12:34pm UTC](https://discuss.elastic.co/t/does-elasticsearch-provide-technical-help-through-any-call-apps/288758 "2021-11-12T12:34:43Z")

</div>

I am an amateur that has to cover any problem with Elasticsearch.... I have troubles covering the management in this system.... Is there any way I could get checkup for the status of our system in realtime like phone …

---

## [Constant GC warnings with small indexes](https://discuss.elastic.co/t/constant-gc-warnings-with-small-indexes/288433)

<div class="topic-metadata">

**Author:** [@lesleyr1](https://discuss.elastic.co/u/lesleyr1)\
**Replies:** 3\
**Last updated:** [November 12, 2021, 6:15am UTC](https://discuss.elastic.co/t/constant-gc-warnings-with-small-indexes/288433 "2021-11-12T06:15:10Z")

</div>

Hello everyone, My team is getting constant GC overhead warnings on our production Elasticsearch cluster for our Liferay application, at least 5 times each minute. This occurs any time, not just when reindexing. "mess…

---

## [Some vulnerabilities in Elasticsearch v7.10.0](https://discuss.elastic.co/t/some-vulnerabilities-in-elasticsearch-v7-10-0/289030)

<div class="topic-metadata">

**Author:** [@Sagarika\_Mahalik](https://discuss.elastic.co/u/Sagarika_Mahalik)\
**Replies:** 2\
**Last updated:** [November 12, 2021, 5:12am UTC](https://discuss.elastic.co/t/some-vulnerabilities-in-elasticsearch-v7-10-0/289030 "2021-11-12T05:12:40Z")

</div>

There are few vulnerabilities coming from Elasticsearch 7.10.0 Can you have a look into these issues? Are they false positive issues? If not how can we mitigate these issues? NVD - CVE-2021-22147 NVD - CVE-2021-22145 …

---

## [Cannot use database\_file in ingest-geoip, please send help every thread here is a dead end](https://discuss.elastic.co/t/cannot-use-database-file-in-ingest-geoip-please-send-help-every-thread-here-is-a-dead-end/289016)

<div class="topic-metadata">

**Author:** [@reyjrar](https://discuss.elastic.co/u/reyjrar)\
**Replies:** 2\
**Last updated:** [November 11, 2021, 8:58pm UTC](https://discuss.elastic.co/t/cannot-use-database-file-in-ingest-geoip-please-send-help-every-thread-here-is-a-dead-end/289016 "2021-11-11T20:58:18Z")

</div>

Hi, I've been trying to setup ingest-geoip with our paid MaxMind databases. I cannot get them to work, regardless of where I put these files, I get "reason" : "\[database\_file\] database file \[GeoIP2-City.mmdb\] …

---

## [Most Efficient way to fetch multiple records by their Id](https://discuss.elastic.co/t/most-efficient-way-to-fetch-multiple-records-by-their-id/288035)

<div class="topic-metadata">

**Author:** [@Spyros\_Giannopoulos](https://discuss.elastic.co/u/Spyros_Giannopoulos)\
**Replies:** 3\
**Last updated:** [November 11, 2021, 4:16pm UTC](https://discuss.elastic.co/t/most-efficient-way-to-fetch-multiple-records-by-their-id/288035 "2021-11-11T16:16:21Z")

</div>

Hello, I have a case where I need to fetch a huge number of records but I know already their Id. I'm using c# Nest library. What would be the most efficient way to fetch them? The size of the records can vary from a few…

---

## [Elastic search-ui - not working](https://discuss.elastic.co/t/elastic-search-ui-not-working/289003)

<div class="topic-metadata">

**Author:** [@Baljeet](https://discuss.elastic.co/u/Baljeet)\
**Replies:** 0\
**Last updated:** [November 11, 2021, 3:15pm UTC](https://discuss.elastic.co/t/elastic-search-ui-not-working/289003 "2021-11-11T15:15:47Z")

</div>

Hi Elastic team, I am evaluating Elasticsearch-ui for work. I am not able to run elastic “search-ui” @ search-ui/examples/elasticsearch at master · elastic/search-ui · GitHub iMac Elasticsearch running at localhost…

---

## ['illegal\_argument\_exception', 'reason': 'Unable to Tessellate shape 6.6.0](https://discuss.elastic.co/t/illegal-argument-exception-reason-unable-to-tessellate-shape-6-6-0/288859)

<div class="topic-metadata">

**Author:** [@Lemon\_C](https://discuss.elastic.co/u/Lemon_C)\
**Replies:** 2\
**Last updated:** [November 11, 2021, 1:26pm UTC](https://discuss.elastic.co/t/illegal-argument-exception-reason-unable-to-tessellate-shape-6-6-0/288859 "2021-11-11T13:26:57Z")

</div>

dear all, I am trying to post data to es but failed for the reason as following: " 'caused\_by': {'type': 'illegal\_argument\_exception', 'reason': 'Unable to Tessellate shape" but its ok on geojson.io to make a polygon…

---

## [Problems with indexes.fielddata.cache.size and high I/O on HDD](https://discuss.elastic.co/t/problems-with-indexes-fielddata-cache-size-and-high-i-o-on-hdd/288915)

<div class="topic-metadata">

**Author:** [@KaZuKi\_Yashiro](https://discuss.elastic.co/u/KaZuKi_Yashiro)\
**Replies:** 0\
**Last updated:** [November 10, 2021, 4:44pm UTC](https://discuss.elastic.co/t/problems-with-indexes-fielddata-cache-size-and-high-i-o-on-hdd/288915 "2021-11-10T16:44:27Z")

</div>

Good evening. ES version 6.8.8 in docker "docker.elastic.co/elasticsearch/elasticsearch:6.8.8" heap\_size: 31g CPU Model on node 1: Intel(R) Xeon(R) CPU E3-1270 v5 @ 3.60GHz CPU Model on node 2: Intel(R) Xeon(R) CPU E…

---

## [Elasticsearch docker container fails to start with provided environmet variable](https://discuss.elastic.co/t/elasticsearch-docker-container-fails-to-start-with-provided-environmet-variable/288990)

<div class="topic-metadata">

**Author:** [@michthom](https://discuss.elastic.co/u/michthom)\
**Replies:** 0\
**Last updated:** [November 11, 2021, 12:09pm UTC](https://discuss.elastic.co/t/elasticsearch-docker-container-fails-to-start-with-provided-environmet-variable/288990 "2021-11-11T12:09:04Z")

</div>

Hi guys, new here and unsure if this is Elasticsearch or docker issue, I think the former. I'm trying to run Elasticsearch docker container but it fails to process supplied environment variable. docker run -e "discover…

---

## [Snapshots not showing in a timely manner](https://discuss.elastic.co/t/snapshots-not-showing-in-a-timely-manner/287778)

<div class="topic-metadata">

**Author:** [@chrisgg](https://discuss.elastic.co/u/chrisgg)\
**Replies:** 8\
**Last updated:** [November 11, 2021, 11:35am UTC](https://discuss.elastic.co/t/snapshots-not-showing-in-a-timely-manner/287778 "2021-11-11T11:35:26Z")

</div>

Hi all I will preface this by saying that I know that CCR would do what we want, but we requested a quote for this and the company said no way, the cost was just too high! We are only using ES very lightly and it is not…

---

## [Is it possible to record all the commands run in Mariadb to the elasticsearch?](https://discuss.elastic.co/t/is-it-possible-to-record-all-the-commands-run-in-mariadb-to-the-elasticsearch/288987)

<div class="topic-metadata">

**Author:** [@kennethcheung](https://discuss.elastic.co/u/kennethcheung)\
**Replies:** 0\
**Last updated:** [November 11, 2021, 11:01am UTC](https://discuss.elastic.co/t/is-it-possible-to-record-all-the-commands-run-in-mariadb-to-the-elasticsearch/288987 "2021-11-11T11:01:34Z")

</div>

Let say someone in my team run a command "SELECT \* FORM TESTTABLE" in the Mariadb, and I hope the Elasticsearch can receive the command and record it down rather the output result. Can anyone show me how to do this in…

---

## [Specifying field weight during query time](https://discuss.elastic.co/t/specifying-field-weight-during-query-time/288982)

<div class="topic-metadata">

**Author:** [@Newbie111985](https://discuss.elastic.co/u/Newbie111985)\
**Replies:** 0\
**Last updated:** [November 11, 2021, 10:45am UTC](https://discuss.elastic.co/t/specifying-field-weight-during-query-time/288982 "2021-11-11T10:45:48Z")

</div>

I have an index with below mapping. { "mappings" : { "\_doc" : { "properties" : { "author" : {"type" : "keyword"}, "title" : { "type" : "keyword" }, …

---

## [Scripting aggregation order](https://discuss.elastic.co/t/scripting-aggregation-order/288980)

<div class="topic-metadata">

**Author:** [@yen\_l\_ng\_th](https://discuss.elastic.co/u/yen_l_ng_th)\
**Replies:** 0\
**Last updated:** [November 11, 2021, 10:29am UTC](https://discuss.elastic.co/t/scripting-aggregation-order/288980 "2021-11-11T10:29:44Z")

</div>

Would it be possible to script the sort order of aggregations? Let me explain with a contrived example: { "aggs": { "agg1": { "terms": { "field": "somefield", "order": { "avg1": "desc" }, "size" : 100 }, "agg…

---

## [\_ilm/explain returns illegal\_argument\_exception: "duration cannot be negative, was given \[-1613792563\]"](https://discuss.elastic.co/t/ilm-explain-returns-illegal-argument-exception-duration-cannot-be-negative-was-given-1613792563/288868)

<div class="topic-metadata">

**Author:** [@fuphil](https://discuss.elastic.co/u/fuphil)\
**Replies:** 3\
**Last updated:** [November 11, 2021, 8:12am UTC](https://discuss.elastic.co/t/ilm-explain-returns-illegal-argument-exception-duration-cannot-be-negative-was-given-1613792563/288868 "2021-11-11T08:12:01Z")

</div>

Hi guys, I am running Kibana 7.15 and somehow the ilm information of each index got lost in the UI. Usually (still like this in my test and monitoring cluster) when loading all indices via "Stack Management -\> Index Ma…

---

## [Remove from \_source.fieldA if fieldA is zero](https://discuss.elastic.co/t/remove-from-source-fielda-if-fielda-is-zero/288961)

<div class="topic-metadata">

**Author:** [@anon17386273](https://discuss.elastic.co/u/anon17386273)\
**Replies:** 0\
**Last updated:** [November 11, 2021, 7:55am UTC](https://discuss.elastic.co/t/remove-from-source-fielda-if-fielda-is-zero/288961 "2021-11-11T07:55:16Z")

</div>

Hi I am using ES 7.10.2 and wanted to remove from existing indices \_source fieldA if fieldA is zero. I tried to use update\_by\_query \> pipeline \> processor \> remove to remove a field if it's value is zero but when I ran…

---

## [Merge matching documents](https://discuss.elastic.co/t/merge-matching-documents/288959)

<div class="topic-metadata">

**Author:** [@samhagin](https://discuss.elastic.co/u/samhagin)\
**Replies:** 0\
**Last updated:** [November 11, 2021, 7:51am UTC](https://discuss.elastic.co/t/merge-matching-documents/288959 "2021-11-11T07:51:09Z")

</div>

I have two different indices with matching documents - the \_id field is the same. How can I copy documents from one index to another and overwrite the document at the destination, and also insert a document if it doesn't…

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=541)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=543)
