# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=884

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 885

---

## [Coordinating node to route requests from intranet/internet to two distinct subsets of nodes](https://discuss.elastic.co/t/coordinating-node-to-route-requests-from-intranet-internet-to-two-distinct-subsets-of-nodes/237981)

<div class="topic-metadata">

**Author:** [@xandmaga](https://discuss.elastic.co/u/xandmaga)\
**Replies:** 5\
**Last updated:** [June 22, 2020, 5:54pm UTC](https://discuss.elastic.co/t/coordinating-node-to-route-requests-from-intranet-internet-to-two-distinct-subsets-of-nodes/237981 "2020-06-22T17:54:43Z")

</div>

Hi, we have very different throughput scenarios for our cluster regarding the same indexes. Our product will be available through our private intranet, but it will be released publicly too, and available through internet…

---

## [Return nested fields from query using source filter](https://discuss.elastic.co/t/return-nested-fields-from-query-using-source-filter/238091)

<div class="topic-metadata">

**Author:** [@misheck](https://discuss.elastic.co/u/misheck)\
**Replies:** 1\
**Last updated:** [June 22, 2020, 3:25pm UTC](https://discuss.elastic.co/t/return-nested-fields-from-query-using-source-filter/238091 "2020-06-22T15:25:58Z")

</div>

I am trying to query my signals indices in Elastic and I would like the results to return only the fields that I am interested and my current challenge is that some of the fields are nested. I have tried various methods …

---

## [ODBC Connection to Elasticsearch v6.8](https://discuss.elastic.co/t/odbc-connection-to-elasticsearch-v6-8/238094)

<div class="topic-metadata">

**Author:** [@Garry](https://discuss.elastic.co/u/Garry)\
**Replies:** 1\
**Last updated:** [June 22, 2020, 3:15pm UTC](https://discuss.elastic.co/t/odbc-connection-to-elasticsearch-v6-8/238094 "2020-06-22T15:15:17Z")

</div>

I am looking to connect to Elasticsearch in AWS via odbc, but get the following error... connection failed: \[Elastic\]\[EsODBC 6.8(c0ace37 +,u,r) Driver\]{"Message":"Your Request: '/\_xpack/sql' is not allowed."} Where can…

---

## [ERROR Unable to delete file](https://discuss.elastic.co/t/error-unable-to-delete-file/237948)

<div class="topic-metadata">

**Author:** [@rezekiel](https://discuss.elastic.co/u/rezekiel)\
**Replies:** 5\
**Last updated:** [June 22, 2020, 3:13pm UTC](https://discuss.elastic.co/t/error-unable-to-delete-file/237948 "2020-06-22T15:13:28Z")

</div>

Hi , I use elasticsearch for windows amd getting

---

## [Sincronizar](https://discuss.elastic.co/t/sincronizar/238102)

<div class="topic-metadata">

**Author:** [@Juliano\_de\_Mello](https://discuss.elastic.co/u/Juliano_de_Mello)\
**Replies:** 1\
**Last updated:** [June 22, 2020, 3:10pm UTC](https://discuss.elastic.co/t/sincronizar/238102 "2020-06-22T15:10:20Z")

</div>

Estou com dificuldades para sincronizar minha base mongoDB com elasticsearch. Há algum tutorial recente que possa me ajudar? I'm having trouble synchronizing my mongoDB base with elasticsearch. Are there any recent tuto…

---

## [@timestamp field slow range query "DocValuesFieldExistsQuery"](https://discuss.elastic.co/t/timestamp-field-slow-range-query-docvaluesfieldexistsquery/234995)

<div class="topic-metadata">

**Author:** [@YvorL](https://discuss.elastic.co/u/YvorL)\
**Replies:** 12\
**Last updated:** [June 22, 2020, 2:27pm UTC](https://discuss.elastic.co/t/timestamp-field-slow-range-query-docvaluesfieldexistsquery/234995 "2020-06-22T14:27:31Z")

</div>

Hi! I was profiling my queries and I run into this: According to this thread there's isn't anything I can do to avoid this behavior and it seems that the newest ES version has older Lucene version (8.5) which doesn't…

---

## [How to create multiple pattern dissect processor - Ingest pipeline](https://discuss.elastic.co/t/how-to-create-multiple-pattern-dissect-processor-ingest-pipeline/237688)

<div class="topic-metadata">

**Author:** [@Mohan\_vel](https://discuss.elastic.co/u/Mohan_vel)\
**Replies:** 1\
**Last updated:** [June 22, 2020, 1:50pm UTC](https://discuss.elastic.co/t/how-to-create-multiple-pattern-dissect-processor-ingest-pipeline/237688 "2020-06-22T13:50:11Z")

</div>

I have created the ingest pipeline to dissect the incoming message with single pattern but the challenge is going with multiple patterns. Given my pipeline for reference. PUT \_ingest/pipeline/dissectpipeline { …

---

## [SAML settings on elasticsearch and kibana](https://discuss.elastic.co/t/saml-settings-on-elasticsearch-and-kibana/236158)

<div class="topic-metadata">

**Author:** [@Muhammad\_Umair\_Baig](https://discuss.elastic.co/u/Muhammad_Umair_Baig)\
**Replies:** 32\
**Last updated:** [June 22, 2020, 11:36am UTC](https://discuss.elastic.co/t/saml-settings-on-elasticsearch-and-kibana/236158 "2020-06-22T11:36:42Z")

</div>

Hi Guys, i am using kibana and elasticsearch version 7.6.2 free version and trying to enable SAML 2.0 on elasticsearch and kibana. Mentioned below are the configuration files that i am using: elasticsearch log trace: \[…

---

## [Fastest way to restore ElasticSearch snapshot](https://discuss.elastic.co/t/fastest-way-to-restore-elasticsearch-snapshot/236572)

<div class="topic-metadata">

**Author:** [@bhuvaneshdct](https://discuss.elastic.co/u/bhuvaneshdct)\
**Replies:** 2\
**Last updated:** [June 22, 2020, 11:04am UTC](https://discuss.elastic.co/t/fastest-way-to-restore-elasticsearch-snapshot/236572 "2020-06-22T11:04:34Z")

</div>

I have 2 node elasticsearch cluster version 7.4. CPU 32 Memory 250G Disk IOPS 50K IOPS (SSD) Heap 32GB Snapshot size 3TB since its a bigger instance, how to change the config files to restore the snapshot in the faste…

---

## [How to debug elasticsearch logstash ingestion pipelines](https://discuss.elastic.co/t/how-to-debug-elasticsearch-logstash-ingestion-pipelines/237618)

<div class="topic-metadata">

**Author:** [@genehunter29009](https://discuss.elastic.co/u/genehunter29009)\
**Replies:** 1\
**Last updated:** [June 22, 2020, 10:28am UTC](https://discuss.elastic.co/t/how-to-debug-elasticsearch-logstash-ingestion-pipelines/237618 "2020-06-22T10:28:57Z")

</div>

Trying to use the pipelines in a beats config on logstash. The issue is its not seeing the pipeline so the data is going straight into the index unprocessed. I am sure something is wrong with the code that builds the pip…

---

## [Terms aggregation on a nested field for calculating stats based on a parent-field](https://discuss.elastic.co/t/terms-aggregation-on-a-nested-field-for-calculating-stats-based-on-a-parent-field/237932)

<div class="topic-metadata">

**Author:** [@Andy1990](https://discuss.elastic.co/u/Andy1990)\
**Replies:** 1\
**Last updated:** [June 22, 2020, 10:01am UTC](https://discuss.elastic.co/t/terms-aggregation-on-a-nested-field-for-calculating-stats-based-on-a-parent-field/237932 "2020-06-22T10:01:58Z")

</div>

Hello, in my use case i have documents with a client and a price. The client is a nested object (containing id, and acronym), the price is on the first json level of my source). I would like to calculate metric values (…

---

## [Aggregations & or query](https://discuss.elastic.co/t/aggregations-or-query/237784)

<div class="topic-metadata">

**Author:** [@gbu](https://discuss.elastic.co/u/gbu)\
**Replies:** 2\
**Last updated:** [June 22, 2020, 9:01am UTC](https://discuss.elastic.co/t/aggregations-or-query/237784 "2020-06-22T09:01:17Z")

</div>

Hi, { 'id': 1, 'productType': 'a'} { 'id': 2, 'productType': 'b'} { 'id': 3, 'productType': 'c'} we are doing a query with aggregations like { "aggs": { "productType": { …

---

## [/usr/share/elasticsearch/tmp\] does not exist](https://discuss.elastic.co/t/usr-share-elasticsearch-tmp-does-not-exist/238046)

<div class="topic-metadata">

**Author:** [@Matt\_Ayres](https://discuss.elastic.co/u/Matt_Ayres)\
**Replies:** 0\
**Last updated:** [June 22, 2020, 8:56am UTC](https://discuss.elastic.co/t/usr-share-elasticsearch-tmp-does-not-exist/238046 "2020-06-22T08:56:48Z")

</div>

Hi GUys after downloading the latest rpm and and installing for the first time I am getting this error in the logs: Jun 22 09:47:31 ssd316r.simpleservers.co.uk systemd\[1\]: Starting Elasticsearch... Jun 22 09:47:32 ssd31…

---

## [Elasticsearch as primary datastore for chat application](https://discuss.elastic.co/t/elasticsearch-as-primary-datastore-for-chat-application/238014)

<div class="topic-metadata">

**Author:** [@Deshmukhm](https://discuss.elastic.co/u/Deshmukhm)\
**Replies:** 1\
**Last updated:** [June 22, 2020, 8:29am UTC](https://discuss.elastic.co/t/elasticsearch-as-primary-datastore-for-chat-application/238014 "2020-06-22T08:29:56Z")

</div>

As per various articles to choose elasticsearch as a primary datasource is solely depends on the usecase. So if I want to implement chat application similar to Microsoft teams or any, Will it be a good idea to use it as …

---

## [Cross Cluster Search in kubernetes clusters](https://discuss.elastic.co/t/cross-cluster-search-in-kubernetes-clusters/238035)

<div class="topic-metadata">

**Author:** [@a3984](https://discuss.elastic.co/u/a3984)\
**Replies:** 0\
**Last updated:** [June 22, 2020, 8:10am UTC](https://discuss.elastic.co/t/cross-cluster-search-in-kubernetes-clusters/238035 "2020-06-22T08:10:18Z")

</div>

We have 2 kubernetes clusters each with fluentd/elasticsearch/kibana in it but we would like to pool this data together into a single kibana UI for investigations etc... Am I right in thinking that I would need to have a…

---

## [Elasticsearch Log Files](https://discuss.elastic.co/t/elasticsearch-log-files/238015)

<div class="topic-metadata">

**Author:** [@DawitCh](https://discuss.elastic.co/u/DawitCh)\
**Replies:** 0\
**Last updated:** [June 22, 2020, 6:54am UTC](https://discuss.elastic.co/t/elasticsearch-log-files/238015 "2020-06-22T06:54:33Z")

</div>

I have a custom path to store Elasticsearch log files (around 5 GB). It already full and I don't know how to clear it automatically. For the data, I already set ILM so it never reaches 60%. I don't know is it has log ret…

---

## [Very high CPU usage on one Elasticsearch Java.exe](https://discuss.elastic.co/t/very-high-cpu-usage-on-one-elasticsearch-java-exe/237072)

<div class="topic-metadata">

**Author:** [@Manikandan\_Selvaraj](https://discuss.elastic.co/u/Manikandan_Selvaraj)\
**Replies:** 21\
**Last updated:** [June 22, 2020, 6:16am UTC](https://discuss.elastic.co/t/very-high-cpu-usage-on-one-elasticsearch-java-exe/237072 "2020-06-22T06:16:20Z")

</div>

Hi Team, I have very limited data in Elastic search. I have hosted my elastic search in VM. Most of the time Java usage more CPU usage. So My site getting slow due to this. My elastic search version - 2.3.2 Why it hap…

---

## [When index rollover by ilm, the date can't be update](https://discuss.elastic.co/t/when-index-rollover-by-ilm-the-date-cant-be-update/236133)

<div class="topic-metadata">

**Author:** [@111258](https://discuss.elastic.co/u/111258)\
**Replies:** 2\
**Last updated:** [June 22, 2020, 3:40am UTC](https://discuss.elastic.co/t/when-index-rollover-by-ilm-the-date-cant-be-update/236133 "2020-06-22T03:40:24Z")

</div>

I can use ilm to rollover index by date on none prod env, like this: POST rehearsal-k8s-logs/\_rollover?dry\_run { "conditions" : { "max\_age": "1d", "max\_size": "20gb" } } --- { "acknowledged" : false, "…

---

## [Index text as keyword array leveraging tokenizers and filters](https://discuss.elastic.co/t/index-text-as-keyword-array-leveraging-tokenizers-and-filters/237976)

<div class="topic-metadata">

**Author:** [@rsinger86](https://discuss.elastic.co/u/rsinger86)\
**Replies:** 0\
**Last updated:** [June 21, 2020, 7:47pm UTC](https://discuss.elastic.co/t/index-text-as-keyword-array-leveraging-tokenizers-and-filters/237976 "2020-06-21T19:47:30Z")

</div>

Say I am indexing emails as documents into Elasticsearch, and I'd like to index the email body as an array of keywords, in addition to indexing it as an analyzed text field. My purpose is that I'd like to do term aggreg…

---

## [Date of the last snapshot?](https://discuss.elastic.co/t/date-of-the-last-snapshot/237969)

<div class="topic-metadata">

**Author:** [@granier](https://discuss.elastic.co/u/granier)\
**Replies:** 0\
**Last updated:** [June 21, 2020, 4:11pm UTC](https://discuss.elastic.co/t/date-of-the-last-snapshot/237969 "2020-06-21T16:11:06Z")

</div>

Hi, I am using Elasticsearch 6.8.3 and try to create a script which displays the date of the last successfull snapshot of a repository. I found how to get the date of one snapshot, the list of all snapshots, but how to…

---

## [Coordinating nodes in a cluster](https://discuss.elastic.co/t/coordinating-nodes-in-a-cluster/237001)

<div class="topic-metadata">

**Author:** [@smlbiobot](https://discuss.elastic.co/u/smlbiobot)\
**Replies:** 9\
**Last updated:** [June 21, 2020, 12:19pm UTC](https://discuss.elastic.co/t/coordinating-nodes-in-a-cluster/237001 "2020-06-21T12:19:34Z")

</div>

We don’t currently use a balancing node / coordinating nodes, and I have seen that sometimes if a particular node is under load, it slows down the entire server. This is very mysterious to me, as the indices that need to…

---

## [Elasticseach unable to start after "elasticsearch.yml file " configuration](https://discuss.elastic.co/t/elasticseach-unable-to-start-after-elasticsearch-yml-file-configuration/237950)

<div class="topic-metadata">

**Author:** [@georgeokey](https://discuss.elastic.co/u/georgeokey)\
**Replies:** 2\
**Last updated:** [June 21, 2020, 10:21am UTC](https://discuss.elastic.co/t/elasticseach-unable-to-start-after-elasticsearch-yml-file-configuration/237950 "2020-06-21T10:21:53Z")

</div>

I am have below error after configuring "elasticsearch.yml" file. Version 7.7.1 I have deleted the node file from data directory yet still encountering same error this is below logs.kindly advice \[elastic@elk1 elastic…

---

## [With the removal of doc types, must I reindex all the indices that use a named type?](https://discuss.elastic.co/t/with-the-removal-of-doc-types-must-i-reindex-all-the-indices-that-use-a-named-type/237947)

<div class="topic-metadata">

**Author:** [@smlbiobot](https://discuss.elastic.co/u/smlbiobot)\
**Replies:** 4\
**Last updated:** [June 21, 2020, 10:07am UTC](https://discuss.elastic.co/t/with-the-removal-of-doc-types-must-i-reindex-all-the-indices-that-use-a-named-type/237947 "2020-06-21T10:07:23Z")

</div>

I am getting conflicting instructions regarding the removal of doc types. If my indices only having one doc type (but not named \_doc), do I have to reindex all the indices before I upgrade, or will it upgrade and simply …

---

## [Result window is too large Error](https://discuss.elastic.co/t/result-window-is-too-large-error/237941)

<div class="topic-metadata">

**Author:** [@skv325](https://discuss.elastic.co/u/skv325)\
**Replies:** 2\
**Last updated:** [June 21, 2020, 6:18am UTC](https://discuss.elastic.co/t/result-window-is-too-large-error/237941 "2020-06-21T06:18:22Z")

</div>

Hello, I am getting an error message when doing paged search from kendo data grid on elasticsearch: "Result window is too large, from + size must be less than or equal to: \[10000\] but was \[44800\]..." The index has app…

---

## [ElasticSearch with mongo](https://discuss.elastic.co/t/elasticsearch-with-mongo/237838)

<div class="topic-metadata">

**Author:** [@Rodrigo\_Ceballos](https://discuss.elastic.co/u/Rodrigo_Ceballos)\
**Replies:** 2\
**Last updated:** [June 21, 2020, 2:15am UTC](https://discuss.elastic.co/t/elasticsearch-with-mongo/237838 "2020-06-21T02:15:07Z")

</div>

Hi. I hope you can help me or that someone has the experience already passed. It happens that I want to start working my mongo data in elastic, so I'm doing a process that synchronizes mongo with elastic, For that I am…

---

## [When synonym overlapped with another synonym](https://discuss.elastic.co/t/when-synonym-overlapped-with-another-synonym/237902)

<div class="topic-metadata">

**Author:** [@RUIS](https://discuss.elastic.co/u/RUIS)\
**Replies:** 1\
**Last updated:** [June 20, 2020, 8:08pm UTC](https://discuss.elastic.co/t/when-synonym-overlapped-with-another-synonym/237902 "2020-06-20T20:08:42Z")

</div>

Hi, I'm currently trying to setting up the synonyms and I noticed if a word overlapped with another word in the synonym dic, the token I got will only include one of them. For example, If I have an analyzer using the fo…

---

## [Error while sorting in bucket aggregation](https://discuss.elastic.co/t/error-while-sorting-in-bucket-aggregation/237912)

<div class="topic-metadata">

**Author:** [@Daud\_Ahmed](https://discuss.elastic.co/u/Daud_Ahmed)\
**Replies:** 0\
**Last updated:** [June 20, 2020, 11:37am UTC](https://discuss.elastic.co/t/error-while-sorting-in-bucket-aggregation/237912 "2020-06-20T11:37:28Z")

</div>

{ "error": { "root\_cause": \[ { "type": "aggregation\_execution\_exception", "reason": "Invalid aggregator order path \[data.hardware.ram\_usa…

---

## [Disable Source File Compression(Fdt File)](https://discuss.elastic.co/t/disable-source-file-compression-fdt-file/237905)

<div class="topic-metadata">

**Author:** [@Senkyy1](https://discuss.elastic.co/u/Senkyy1)\
**Replies:** 4\
**Last updated:** [June 20, 2020, 10:06am UTC](https://discuss.elastic.co/t/disable-source-file-compression-fdt-file/237905 "2020-06-20T10:06:09Z")

</div>

Is There Any Way to Disable Compression In Elasticsearch. by make some changes in compressingstoredfieldreader/writer file or anywhere..i m try this from last 48 hours. but not get it..please help regarding this.

---

## [Is the concept of payload in ES same as in Lucene](https://discuss.elastic.co/t/is-the-concept-of-payload-in-es-same-as-in-lucene/237906)

<div class="topic-metadata">

**Author:** [@Ziilozes](https://discuss.elastic.co/u/Ziilozes)\
**Replies:** 0\
**Last updated:** [June 20, 2020, 8:20am UTC](https://discuss.elastic.co/t/is-the-concept-of-payload-in-es-same-as-in-lucene/237906 "2020-06-20T08:20:19Z")

</div>

As far as i know, payload in Lucene is stored in inverted index, right after docid and term freq. But according to es reference on analysis-delimited-payload-tokenfilter, payload is stored in termVectors. So are these …

---

## [Shared went to unassigned state](https://discuss.elastic.co/t/shared-went-to-unassigned-state/237870)

<div class="topic-metadata">

**Author:** [@bhuvaneshdct](https://discuss.elastic.co/u/bhuvaneshdct)\
**Replies:** 2\
**Last updated:** [June 20, 2020, 7:36am UTC](https://discuss.elastic.co/t/shared-went-to-unassigned-state/237870 "2020-06-20T07:36:47Z")

</div>

I have 6 node data node cluster. I started an index restore with Replica 1. But after some time the status of the index is yellow then when I checked the health status it returned many shareds are unassigned. From the e…

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=883)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=885)
