# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=641

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 642

---

## [Nest client not retrying with other nodes when master node abruptly crashes](https://discuss.elastic.co/t/nest-client-not-retrying-with-other-nodes-when-master-node-abruptly-crashes/273131)

<div class="topic-metadata">

**Author:** [@Johan\_Lindberg](https://discuss.elastic.co/u/Johan_Lindberg)\
**Replies:** 8\
**Last updated:** [May 24, 2021, 1:04pm UTC](https://discuss.elastic.co/t/nest-client-not-retrying-with-other-nodes-when-master-node-abruptly-crashes/273131 "2021-05-24T13:04:51Z")

</div>

We're using a three node Elasticsearch cluster v6.5.4 which seems to work fine. All master eligible. The clients use NEST for communication. But when our at the time master node died because of power shortage all clie…

---

## [Are the aggregations in the response of an aggs search query ordered?](https://discuss.elastic.co/t/are-the-aggregations-in-the-response-of-an-aggs-search-query-ordered/273816)

<div class="topic-metadata">

**Author:** [@ashwinbhaskar](https://discuss.elastic.co/u/ashwinbhaskar)\
**Replies:** 1\
**Last updated:** [May 24, 2021, 11:48am UTC](https://discuss.elastic.co/t/are-the-aggregations-in-the-response-of-an-aggs-search-query-ordered/273816 "2021-05-24T11:48:14Z")

</div>

I could not find any explicit statement in the documentation of data range aggregation that talks about the ordering of the elements inside the aggregations field. But I noticed that the results are always reverse of th…

---

## [How to get counts / stats for different periods of time?](https://discuss.elastic.co/t/how-to-get-counts-stats-for-different-periods-of-time/273799)

<div class="topic-metadata">

**Author:** [@ashwinbhaskar](https://discuss.elastic.co/u/ashwinbhaskar)\
**Replies:** 2\
**Last updated:** [May 24, 2021, 10:46am UTC](https://discuss.elastic.co/t/how-to-get-counts-stats-for-different-periods-of-time/273799 "2021-05-24T10:46:22Z")

</div>

I am trying to get the count of documents that were created for the last 10 weeks grouped by week. To get the count for the last week, I would do something like this GET my\_index/\_count { "query": { "range": { …

---

## [Delete\_by\_query increases the storage size](https://discuss.elastic.co/t/delete-by-query-increases-the-storage-size/273806)

<div class="topic-metadata">

**Author:** [@Billz1026](https://discuss.elastic.co/u/Billz1026)\
**Replies:** 4\
**Last updated:** [May 24, 2021, 10:22am UTC](https://discuss.elastic.co/t/delete-by-query-increases-the-storage-size/273806 "2021-05-24T10:22:13Z")

</div>

Hi All, I have used following "delete\_by\_query" to delete large number of documents from an index of my ES. POST /winlogbeat-7.12.0-2021.05.20-000029/\_delete\_by\_query { "query": { "match": { "event.code": "…

---

## [Connecting google sheets to elasticsearch](https://discuss.elastic.co/t/connecting-google-sheets-to-elasticsearch/273758)

<div class="topic-metadata">

**Author:** [@Rgvr\_S](https://discuss.elastic.co/u/Rgvr_S)\
**Replies:** 0\
**Last updated:** [May 23, 2021, 11:48am UTC](https://discuss.elastic.co/t/connecting-google-sheets-to-elasticsearch/273758 "2021-05-23T11:48:55Z")

</div>

I'm trying to connect a few sheets saved in my google drive to visualize in Kibana, I tried using Google sheets to elasticsearch add-on and it looks like the add-on no longer exists. Is there an alternative for this ? T…

---

## [Edge ngram for numeric value](https://discuss.elastic.co/t/edge-ngram-for-numeric-value/273793)

<div class="topic-metadata">

**Author:** [@vikramdayma](https://discuss.elastic.co/u/vikramdayma)\
**Replies:** 0\
**Last updated:** [May 24, 2021, 8:28am UTC](https://discuss.elastic.co/t/edge-ngram-for-numeric-value/273793 "2021-05-24T08:28:52Z")

</div>

Hi, I am implementing edge ngram on a text field for letters and digits. But it is not able to search numeric value. My code is: PUT my-index-00001 { "settings": { "analysis": { "analyzer": { "aut…

---

## [Elasticsearch - added LDAP authentication, error "Invalid username or password"](https://discuss.elastic.co/t/elasticsearch-added-ldap-authentication-error-invalid-username-or-password/273509)

<div class="topic-metadata">

**Author:** [@d.silwon](https://discuss.elastic.co/u/d.silwon)\
**Replies:** 1\
**Last updated:** [May 24, 2021, 7:12am UTC](https://discuss.elastic.co/t/elasticsearch-added-ldap-authentication-error-invalid-username-or-password/273509 "2021-05-24T07:12:52Z")

</div>

Dears, ELK 7.7.0 When I trying to login to Kibana through domain account I've got an error "Invalid username or password". No message errors in elasticsearchlog files. Built-in/internal accounts works well. This is co…

---

## [Out of memory error in elasticsearch](https://discuss.elastic.co/t/out-of-memory-error-in-elasticsearch/273785)

<div class="topic-metadata">

**Author:** [@jake\_JJ](https://discuss.elastic.co/u/jake_JJ)\
**Replies:** 1\
**Last updated:** [May 24, 2021, 6:39am UTC](https://discuss.elastic.co/t/out-of-memory-error-in-elasticsearch/273785 "2021-05-24T06:39:05Z")

</div>

jvm.options ################################################################ ## ## JVM configuration ## ################################################################ ## ## WARNING: DO NOT EDIT THIS FILE. If you wa…

---

## [Constant score + Fuzzy query issue](https://discuss.elastic.co/t/constant-score-fuzzy-query-issue/273779)

<div class="topic-metadata">

**Author:** [@jihyun\_ahn](https://discuss.elastic.co/u/jihyun_ahn)\
**Replies:** 0\
**Last updated:** [May 24, 2021, 3:52am UTC](https://discuss.elastic.co/t/constant-score-fuzzy-query-issue/273779 "2021-05-24T03:52:13Z")

</div>

We are using a constant score to ignore the distance score while using the Fuzzy Query. The result is successful. However, the difference between the CPU usage of Elasticsearch and the one used with the Constant score i…

---

## [Get Users API in CSV format?](https://discuss.elastic.co/t/get-users-api-in-csv-format/273773)

<div class="topic-metadata">

**Author:** [@AClerk](https://discuss.elastic.co/u/AClerk)\
**Replies:** 2\
**Last updated:** [May 24, 2021, 3:51am UTC](https://discuss.elastic.co/t/get-users-api-in-csv-format/273773 "2021-05-24T03:51:05Z")

</div>

Hi All, Is there a way o get users list in a nicer format than JSON? CSV maybe? GET /\_security/user Cheers!

---

## [How to send ingest pipeline output to a index alias name](https://discuss.elastic.co/t/how-to-send-ingest-pipeline-output-to-a-index-alias-name/273697)

<div class="topic-metadata">

**Author:** [@Kannappan\_Somu](https://discuss.elastic.co/u/Kannappan_Somu)\
**Replies:** 11\
**Last updated:** [May 23, 2021, 2:26pm UTC](https://discuss.elastic.co/t/how-to-send-ingest-pipeline-output-to-a-index-alias-name/273697 "2021-05-23T14:26:15Z")

</div>

Hi , I am trying to send ingest pipeline output to a index alias name , so that the index rollovers correctly. what is the required processor or how do we do this ?

---

## [Where does the documents and segments are present in the system](https://discuss.elastic.co/t/where-does-the-documents-and-segments-are-present-in-the-system/273756)

<div class="topic-metadata">

**Author:** [@surya3](https://discuss.elastic.co/u/surya3)\
**Replies:** 1\
**Last updated:** [May 23, 2021, 1:50pm UTC](https://discuss.elastic.co/t/where-does-the-documents-and-segments-are-present-in-the-system/273756 "2021-05-23T13:50:22Z")

</div>

Hi team, I got one doubt while I was exploring on how documents are retrieved based on the search query. Then I came to know that the search query will be given to the shards in the cluster of the nodes by the one of th…

---

## [Failed to start elastic search](https://discuss.elastic.co/t/failed-to-start-elastic-search/273323)

<div class="topic-metadata">

**Author:** [@cedler](https://discuss.elastic.co/u/cedler)\
**Replies:** 18\
**Last updated:** [May 22, 2021, 10:27pm UTC](https://discuss.elastic.co/t/failed-to-start-elastic-search/273323 "2021-05-22T22:27:36Z")

</div>

Good evening, all seems ok, I have installed java 11, etc... But when I want to start the service I have somes errors... I put you the commandes and answers in putty : \[root@ortie-bio ~\]# systemctl start elasticsearch…

---

## [Can't got actual data size and documents](https://discuss.elastic.co/t/cant-got-actual-data-size-and-documents/273714)

<div class="topic-metadata">

**Author:** [@Aniket\_Pant](https://discuss.elastic.co/u/Aniket_Pant)\
**Replies:** 5\
**Last updated:** [May 22, 2021, 3:02pm UTC](https://discuss.elastic.co/t/cant-got-actual-data-size-and-documents/273714 "2021-05-22T15:02:33Z")

</div>

I was reindexing one index but while using the reindex api the size of the previous index and new index is not same. source index GET /\_cat/indices/log-test1?v&pretty health status index uuid pri…

---

## [XMLHttpRequest error for flutter web requests (chrome)?](https://discuss.elastic.co/t/xmlhttprequest-error-for-flutter-web-requests-chrome/273715)

<div class="topic-metadata">

**Author:** [@sabetai](https://discuss.elastic.co/u/sabetai)\
**Replies:** 0\
**Last updated:** [May 22, 2021, 5:09am UTC](https://discuss.elastic.co/t/xmlhttprequest-error-for-flutter-web-requests-chrome/273715 "2021-05-22T05:09:07Z")

</div>

http requests to elasticsearch work when I debug my app for android/ios, but not for web (through chrome). Are there headers or server-side permissions I'm missing to make http requests through a browser?

---

## [Indexing after merging data from 2 tables from 2 different postgres db](https://discuss.elastic.co/t/indexing-after-merging-data-from-2-tables-from-2-different-postgres-db/273658)

<div class="topic-metadata">

**Author:** [@ravi-shanker](https://discuss.elastic.co/u/ravi-shanker)\
**Replies:** 0\
**Last updated:** [May 21, 2021, 11:48am UTC](https://discuss.elastic.co/t/indexing-after-merging-data-from-2-tables-from-2-different-postgres-db/273658 "2021-05-21T11:48:12Z")

</div>

Dear ELK User's Could you please guide me on how to approach the below requirement. -- There are two tables in two different postgres db say db1 (table1) and db2 (table2). -- There is one column in table1 which has 14…

---

## [Problem with elastic in grafana](https://discuss.elastic.co/t/problem-with-elastic-in-grafana/273578)

<div class="topic-metadata">

**Author:** [@Luis\_Garavatti](https://discuss.elastic.co/u/Luis_Garavatti)\
**Replies:** 2\
**Last updated:** [May 21, 2021, 6:36pm UTC](https://discuss.elastic.co/t/problem-with-elastic-in-grafana/273578 "2021-05-21T18:36:35Z")

</div>

Hi guys today I found a problem when adding my elasticsearch to graphana, besides it takes a while to load the reports, several times I get this error message and I need to delete my pod and recreate it, has anyone been …

---

## [Maximums for searchAfter (and scroll) size parameter?](https://discuss.elastic.co/t/maximums-for-searchafter-and-scroll-size-parameter/273591)

<div class="topic-metadata">

**Author:** [@elastic\_yogi](https://discuss.elastic.co/u/elastic_yogi)\
**Replies:** 3\
**Last updated:** [May 21, 2021, 5:23pm UTC](https://discuss.elastic.co/t/maximums-for-searchafter-and-scroll-size-parameter/273591 "2021-05-21T17:23:24Z")

</div>

Hi, I'm curious about ES 7.12 searchAfter and scroll. Both of these have a size parameter. What's the recommended limit to this parameter? I see none given, so I take it's a function of memory and cluster capacity someho…

---

## [Updating index gives number of documents in the index cannot exceed 2147483519](https://discuss.elastic.co/t/updating-index-gives-number-of-documents-in-the-index-cannot-exceed-2147483519/273547)

<div class="topic-metadata">

**Author:** [@NLSVTN](https://discuss.elastic.co/u/NLSVTN)\
**Replies:** 7\
**Last updated:** [May 21, 2021, 4:31pm UTC](https://discuss.elastic.co/t/updating-index-gives-number-of-documents-in-the-index-cannot-exceed-2147483519/273547 "2021-05-21T16:31:28Z")

</div>

We are trying to write 42522080 documents into Elasticsearch in python using Hail: mt = hl.import\_vcf(dataset\_path, reference\_genome='GRCh' + genome\_version, force\_bgz=True, min\_partitions=500) mt = hl.split\_mul…

---

## [Is it possible to upgrade log4j from 2.11.1 to latest non-vul-ner-able version?](https://discuss.elastic.co/t/is-it-possible-to-upgrade-log4j-from-2-11-1-to-latest-non-vul-ner-able-version/273602)

<div class="topic-metadata">

**Author:** [@Elango\_P](https://discuss.elastic.co/u/Elango_P)\
**Replies:** 2\
**Last updated:** [May 21, 2021, 1:03pm UTC](https://discuss.elastic.co/t/is-it-possible-to-upgrade-log4j-from-2-11-1-to-latest-non-vul-ner-able-version/273602 "2021-05-21T13:03:12Z")

</div>

Found that ES internally using log4j 2.11.1 which is hitting this NVD - CVE-2020-9488. As we are more concerned about security issues, is there any plan to upgrade this in ES v6.8.x or latest versions of ES ? Or manuall…

---

## [Is there a way to export \_ttl from docs?](https://discuss.elastic.co/t/is-there-a-way-to-export-ttl-from-docs/273028)

<div class="topic-metadata">

**Author:** [@rschirin](https://discuss.elastic.co/u/rschirin)\
**Replies:** 9\
**Last updated:** [May 21, 2021, 10:49am UTC](https://discuss.elastic.co/t/is-there-a-way-to-export-ttl-from-docs/273028 "2021-05-21T10:49:09Z")

</div>

Hey there, if \_ttl expiration value is configured within the documents of an index, is there a way to export/reindex those documents with the \_ttl value of that moment? For instance, using Logstash elasticsearch input …

---

## [Distinct search using Java API](https://discuss.elastic.co/t/distinct-search-using-java-api/272978)

<div class="topic-metadata">

**Author:** [@MinwooKim](https://discuss.elastic.co/u/MinwooKim)\
**Replies:** 22\
**Last updated:** [May 21, 2021, 9:07am UTC](https://discuss.elastic.co/t/distinct-search-using-java-api/272978 "2021-05-21T09:07:09Z")

</div>

Inquiry with Java API. Is there any method to configure a search for distinct data? SearchSourceBuilder searchSourceBuilder = new SearchSourceBuilder(); BoolQueryBuilder queryBuilder = QueryBuilders.boolQuery()…

---

## [Snapshot and restore keep reporting 29 number indices](https://discuss.elastic.co/t/snapshot-and-restore-keep-reporting-29-number-indices/272758)

<div class="topic-metadata">

**Author:** [@lusynda](https://discuss.elastic.co/u/lusynda)\
**Replies:** 7\
**Last updated:** [May 21, 2021, 7:56am UTC](https://discuss.elastic.co/t/snapshot-and-restore-keep-reporting-29-number-indices/272758 "2021-05-21T07:56:32Z")

</div>

Hi all I have a problem with the snapshot feature. I have a little script that will take snapshot of an indices of my choice in a file. But recently when i upgrade to version 7.12 when i take the snapshot, not only th…

---

## [Load more than 1 million row from SQL Server to ES with Logstash](https://discuss.elastic.co/t/load-more-than-1-million-row-from-sql-server-to-es-with-logstash/273627)

<div class="topic-metadata">

**Author:** [@Dai\_Thai\_Hoa\_Vo](https://discuss.elastic.co/u/Dai_Thai_Hoa_Vo)\
**Replies:** 1\
**Last updated:** [May 21, 2021, 7:48am UTC](https://discuss.elastic.co/t/load-more-than-1-million-row-from-sql-server-to-es-with-logstash/273627 "2021-05-21T07:48:26Z")

</div>

Hi every one. I have one case that my table has more 1 million rows in SQL Server and I used logstash JDBC to load them to Elastic Search. It work fine but run very slow. This is my file config. input { jdbc { jdbc\_dr…

---

## [PKI security realm lisence](https://discuss.elastic.co/t/pki-security-realm-lisence/273392)

<div class="topic-metadata">

**Author:** [@Armen\_Petrosyan](https://discuss.elastic.co/u/Armen_Petrosyan)\
**Replies:** 8\
**Last updated:** [May 21, 2021, 6:17am UTC](https://discuss.elastic.co/t/pki-security-realm-lisence/273392 "2021-05-21T06:17:18Z")

</div>

In subscription page Subscriptions | Elastic Stack Products & Support | Elastic Stated that Encrypted communications is under basic subscription. However when I defined pki real for client authentication, it didn't wor…

---

## [Elasticsearch/kibana mapping multi-layered/nested data](https://discuss.elastic.co/t/elasticsearch-kibana-mapping-multi-layered-nested-data/272821)

<div class="topic-metadata">

**Author:** [@stcdarrell](https://discuss.elastic.co/u/stcdarrell)\
**Replies:** 1\
**Last updated:** [May 21, 2021, 12:21am UTC](https://discuss.elastic.co/t/elasticsearch-kibana-mapping-multi-layered-nested-data/272821 "2021-05-21T00:21:32Z")

</div>

hi, i'm having some issues wrapping my head around how to map this data in elasticsearch/kibana: I'm pulling query data from VirusTotal.com's API on malware. here is a SMALL portion of a HUGE chunk of the query: (1) …

---

## [Bucket anomalies on interfaces that belong to a server](https://discuss.elastic.co/t/bucket-anomalies-on-interfaces-that-belong-to-a-server/273592)

<div class="topic-metadata">

**Author:** [@ElasticLiver](https://discuss.elastic.co/u/ElasticLiver)\
**Replies:** 1\
**Last updated:** [May 21, 2021, 12:07am UTC](https://discuss.elastic.co/t/bucket-anomalies-on-interfaces-that-belong-to-a-server/273592 "2021-05-21T00:07:14Z")

</div>

Hi, I have bandwidth utilization data from multiple interfaces that belong to multiple specifics server. and I was wondering if I can configure the job to create buckets anomalies only when interfaces that belong to a s…

---

## [SLM: Only one snapshot can be taken at a time. To avoid snapshot failures, edit or delete the policies](https://discuss.elastic.co/t/slm-only-one-snapshot-can-be-taken-at-a-time-to-avoid-snapshot-failures-edit-or-delete-the-policies/273500)

<div class="topic-metadata">

**Author:** [@ewolfman](https://discuss.elastic.co/u/ewolfman)\
**Replies:** 4\
**Last updated:** [May 20, 2021, 4:02pm UTC](https://discuss.elastic.co/t/slm-only-one-snapshot-can-be-taken-at-a-time-to-avoid-snapshot-failures-edit-or-delete-the-policies/273500 "2021-05-20T16:02:29Z")

</div>

Hi, Does it mean that if you do schedule multiple snapshots on the same time they: Will be queued, meaning that they might start later than scheduled but eventually they will execute and take a snapshot. Or does i…

---

## [Aggregation across multiple indices](https://discuss.elastic.co/t/aggregation-across-multiple-indices/271350)

<div class="topic-metadata">

**Author:** [@ice2021](https://discuss.elastic.co/u/ice2021)\
**Replies:** 8\
**Last updated:** [May 20, 2021, 3:07pm UTC](https://discuss.elastic.co/t/aggregation-across-multiple-indices/271350 "2021-05-20T15:07:36Z")

</div>

I have 2 indices and they store data of the same mappings on different dates - t1 and t2. I have a multi term aggregation below which works on a single index. How can I get elasticsearch to return the same aggregation a…

---

## [Is there a KQL API endpoint and/or a way to run KQL queries from CLI?](https://discuss.elastic.co/t/is-there-a-kql-api-endpoint-and-or-a-way-to-run-kql-queries-from-cli/273557)

<div class="topic-metadata">

**Author:** [@el\_tedward](https://discuss.elastic.co/u/el_tedward)\
**Replies:** 0\
**Last updated:** [May 20, 2021, 2:49pm UTC](https://discuss.elastic.co/t/is-there-a-kql-api-endpoint-and-or-a-way-to-run-kql-queries-from-cli/273557 "2021-05-20T14:49:20Z")

</div>

In older versions of Kibana, you could get the full Kibana query syntax by just running query\_string queries with a few options that Kibana sets by default, though it doesn't appear you can do that any longer (in a fully…

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=640)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=642)
