# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=712

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 713

---

## [No\_shard\_available\_action\_exception in integration tests](https://discuss.elastic.co/t/no-shard-available-action-exception-in-integration-tests/262941)

<div class="topic-metadata">

**Author:** [@rdehuyss](https://discuss.elastic.co/u/rdehuyss)\
**Replies:** 4\
**Last updated:** [February 3, 2021, 11:49am UTC](https://discuss.elastic.co/t/no-shard-available-action-exception-in-integration-tests/262941 "2021-02-03T11:49:34Z")

</div>

Hi, I'm the author of JobRunr, a distributed job scheduling library that also supports ElasticSearch as a storage provider. For my integration tests, I use TestContainers and start an ElasticSearch. @Container pri…

---

## [Synonyms multi word search issue](https://discuss.elastic.co/t/synonyms-multi-word-search-issue/263110)

<div class="topic-metadata">

**Author:** [@smshabab11](https://discuss.elastic.co/u/smshabab11)\
**Replies:** 0\
**Last updated:** [February 3, 2021, 11:09am UTC](https://discuss.elastic.co/t/synonyms-multi-word-search-issue/263110 "2021-02-03T11:09:47Z")

</div>

I have created an index with synonyms.txt file in which there is a word GDM and corresponding synonym is General Data Manager and the expectation is If I want to search "GDM" it should show results which has "GDM" or "Ge…

---

## [Integrating Ingest Pipeline with the Indicies](https://discuss.elastic.co/t/integrating-ingest-pipeline-with-the-indicies/263106)

<div class="topic-metadata">

**Author:** [@shiv97](https://discuss.elastic.co/u/shiv97)\
**Replies:** 0\
**Last updated:** [February 3, 2021, 10:43am UTC](https://discuss.elastic.co/t/integrating-ingest-pipeline-with-the-indicies/263106 "2021-02-03T10:43:34Z")

</div>

Hi Everyone, I have created one ingest pipeline now I want to attach this pipeline with the index having the format "cwl-2021.02.02 " where indices from every date are created like "cwl-2021.02.03" and so on... So I tr…

---

## [Circuit\_breaking\_exception](https://discuss.elastic.co/t/circuit-breaking-exception/261503)

<div class="topic-metadata">

**Author:** [@zen.xen](https://discuss.elastic.co/u/zen.xen)\
**Replies:** 12\
**Last updated:** [February 3, 2021, 10:37am UTC](https://discuss.elastic.co/t/circuit-breaking-exception/261503 "2021-02-03T10:37:24Z")

</div>

@Marta\_Bondyra Hello, I need some help { "error": { "root\_cause": \[ { "type": "circuit\_breaking\_exception", "reason": "\[parent\] Data too large, data for \[\<transport\_r…

---

## [Rest API for last 30 days data from elasticsearch](https://discuss.elastic.co/t/rest-api-for-last-30-days-data-from-elasticsearch/262877)

<div class="topic-metadata">

**Author:** [@Gauti](https://discuss.elastic.co/u/Gauti)\
**Replies:** 5\
**Last updated:** [February 3, 2021, 10:10am UTC](https://discuss.elastic.co/t/rest-api-for-last-30-days-data-from-elasticsearch/262877 "2021-02-03T10:10:17Z")

</div>

Hi All, I am trying to export data from elasticsearch using rest api below is an example which got succeeded, but this will give complete data present in index URL : http://dashboard.iff.com:9200/inctable/\_search/ H…

---

## [Using esrally to measure painless script partial update performance](https://discuss.elastic.co/t/using-esrally-to-measure-painless-script-partial-update-performance/262263)

<div class="topic-metadata">

**Author:** [@dineshabbi](https://discuss.elastic.co/u/dineshabbi)\
**Replies:** 6\
**Last updated:** [February 3, 2021, 9:42am UTC](https://discuss.elastic.co/t/using-esrally-to-measure-painless-script-partial-update-performance/262263 "2021-02-03T09:42:02Z")

</div>

Hi team, I am trying to measure bulk partial update performance. I am wondering if its possible to do this via esrally at all. For eg, our application uses painless scripts for partial update and the target for these u…

---

## [Metricbeat dosen't collect CPU and Memory if Load is enabled in windows machines](https://discuss.elastic.co/t/metricbeat-dosent-collect-cpu-and-memory-if-load-is-enabled-in-windows-machines/262802)

<div class="topic-metadata">

**Author:** [@Sathish22](https://discuss.elastic.co/u/Sathish22)\
**Replies:** 1\
**Last updated:** [February 3, 2021, 8:58am UTC](https://discuss.elastic.co/t/metricbeat-dosent-collect-cpu-and-memory-if-load-is-enabled-in-windows-machines/262802 "2021-02-03T08:58:14Z")

</div>

Hi Team, I have installed metricbeat in windows machine If we disable Load from the system.yml file we can able to capture CPU and Memory metrics but after enabling load we didn't get data for CPU, Memory, and Load Bu…

---

## [7.10 RestHighLevelClient - Composable Index Template and Component Template APIs difficult to use](https://discuss.elastic.co/t/7-10-resthighlevelclient-composable-index-template-and-component-template-apis-difficult-to-use/263097)

<div class="topic-metadata">

**Author:** [@Rajath\_H\_G](https://discuss.elastic.co/u/Rajath_H_G)\
**Replies:** 0\
**Last updated:** [February 3, 2021, 8:41am UTC](https://discuss.elastic.co/t/7-10-resthighlevelclient-composable-index-template-and-component-template-apis-difficult-to-use/263097 "2021-02-03T08:41:47Z")

</div>

I am planning to migrate from legacy templates to Composable Templates introduced in 7.x. But with Composable Templates we don't have APIs to feed complete template request string directly or build one using XContentBui…

---

## [Header in csv while exporting](https://discuss.elastic.co/t/header-in-csv-while-exporting/262958)

<div class="topic-metadata">

**Author:** [@ritusingh](https://discuss.elastic.co/u/ritusingh)\
**Replies:** 2\
**Last updated:** [February 3, 2021, 8:06am UTC](https://discuss.elastic.co/t/header-in-csv-while-exporting/262958 "2021-02-03T08:06:41Z")

</div>

Hi, I want to know that is there any way through which we can add header in csv file while exporting from elasticsearch via logstash? Here is the flow: Elasticsearch -\> logstash -\> csv file

---

## [Help in securing communications between client and elasticsearch](https://discuss.elastic.co/t/help-in-securing-communications-between-client-and-elasticsearch/262955)

<div class="topic-metadata">

**Author:** [@Priya\_Vijay](https://discuss.elastic.co/u/Priya_Vijay)\
**Replies:** 3\
**Last updated:** [February 3, 2021, 5:41am UTC](https://discuss.elastic.co/t/help-in-securing-communications-between-client-and-elasticsearch/262955 "2021-02-03T05:41:11Z")

</div>

I have a question and appreciate any guidance. I have an elasticsearch instance without x-pack enabled but it is secure, mTLS is enabled. How can I connect to this elastic from another client like elastalert? How can I g…

---

## [Estimate RAM consumption per index](https://discuss.elastic.co/t/estimate-ram-consumption-per-index/262947)

<div class="topic-metadata">

**Author:** [@gorek](https://discuss.elastic.co/u/gorek)\
**Replies:** 1\
**Last updated:** [February 3, 2021, 4:00am UTC](https://discuss.elastic.co/t/estimate-ram-consumption-per-index/262947 "2021-02-03T04:00:44Z")

</div>

I would like to estimate RAM requirements for new node. I plan keep on this node about 88 indices with 2 shards every. Currently one index have about 63GB on disk and 240 millions documents. I know Elasticsearch relies …

---

## [Reindex issue](https://discuss.elastic.co/t/reindex-issue/263013)

<div class="topic-metadata">

**Author:** [@Yogesh\_Chandra](https://discuss.elastic.co/u/Yogesh_Chandra)\
**Replies:** 1\
**Last updated:** [February 3, 2021, 3:57am UTC](https://discuss.elastic.co/t/reindex-issue/263013 "2021-02-03T03:57:07Z")

</div>

Hi Team, We are getting the below error during reindexing. Document contains at least one immense term in field="ddm\_\_keyword\_\_28372\_\_body\_of\_text\_en\_US" (whose UTF8 encoding is longer than the max length 32766), all o…

---

## [Elasticsearch remote cluster authentication mapping](https://discuss.elastic.co/t/elasticsearch-remote-cluster-authentication-mapping/263057)

<div class="topic-metadata">

**Author:** [@xxlaila](https://discuss.elastic.co/u/xxlaila)\
**Replies:** 0\
**Last updated:** [February 3, 2021, 2:21am UTC](https://discuss.elastic.co/t/elasticsearch-remote-cluster-authentication-mapping/263057 "2021-02-03T02:21:08Z")

</div>

Elasticsearch did a cross-cluster mapping There is no problem in creating a new user to get cross-cluster data, but it prompts 404 when getting mapping Execute statement: curl -H "Content-Type: application/json" -XGET -…

---

## [Filter on a field containing multiple values](https://discuss.elastic.co/t/filter-on-a-field-containing-multiple-values/263044)

<div class="topic-metadata">

**Author:** [@aniaks](https://discuss.elastic.co/u/aniaks)\
**Replies:** 0\
**Last updated:** [February 2, 2021, 8:59pm UTC](https://discuss.elastic.co/t/filter-on-a-field-containing-multiple-values/263044 "2021-02-02T20:59:46Z")

</div>

{ customer: A, products: \[B, C\], price: \[123, 456\] } { customer: B, products: \[C, D, E\], price: \[123, 789, 987\] } In this example, how do i filter on product field with one value .... basically in the above exa…

---

## [Create a url field pyelasticsearch python](https://discuss.elastic.co/t/create-a-url-field-pyelasticsearch-python/263047)

<div class="topic-metadata">

**Author:** [@Tlm\_Konstantinos](https://discuss.elastic.co/u/Tlm_Konstantinos)\
**Replies:** 0\
**Last updated:** [February 2, 2021, 9:37pm UTC](https://discuss.elastic.co/t/create-a-url-field-pyelasticsearch-python/263047 "2021-02-02T21:37:45Z")

</div>

I am using in python the module pyelasticsearch v7.10.1 and I am trying to update a document in one index in the elasticsearch server. What should I do if I want to create a hyperlink field during the update? source\_to\_…

---

## [Elasticsearch cluster request timeout and slow response time](https://discuss.elastic.co/t/elasticsearch-cluster-request-timeout-and-slow-response-time/263023)

<div class="topic-metadata">

**Author:** [@LurenzZ](https://discuss.elastic.co/u/LurenzZ)\
**Replies:** 0\
**Last updated:** [February 2, 2021, 6:10pm UTC](https://discuss.elastic.co/t/elasticsearch-cluster-request-timeout-and-slow-response-time/263023 "2021-02-02T18:10:44Z")

</div>

Hi, we are having some problems with our Elasticsearch cluster. For the past few days the requests performed by the master node occassionally start to time out and, after that, every search query executed to elasticsear…

---

## [Reindex parse\_exception](https://discuss.elastic.co/t/reindex-parse-exception/262824)

<div class="topic-metadata">

**Author:** [@wajika](https://discuss.elastic.co/u/wajika)\
**Replies:** 5\
**Last updated:** [February 2, 2021, 4:11pm UTC](https://discuss.elastic.co/t/reindex-parse-exception/262824 "2021-02-02T16:11:28Z")

</div>

POST \_reindex?wait\_for\_completion=true { "source": { "index": "apm-7.8.1-transaction-000007", "query": { "match\_all": {} } }, "dest": { "index": "apm-7.8.1-transaction-new-000007", "pi…

---

## [Query DSL, Boolean query. Multiple conditions for must\_not](https://discuss.elastic.co/t/query-dsl-boolean-query-multiple-conditions-for-must-not/263004)

<div class="topic-metadata">

**Author:** [@gneves](https://discuss.elastic.co/u/gneves)\
**Replies:** 0\
**Last updated:** [February 2, 2021, 3:10pm UTC](https://discuss.elastic.co/t/query-dsl-boolean-query-multiple-conditions-for-must-not/263004 "2021-02-02T15:10:15Z")

</div>

Hello guys, hope you are doing well and healthy. Im having a little trouble using DSL querys. My objective is this: I want to trigger an event that, the action must be "UserLoggedIn", the country must NOT be Portuga…

---

## [ElasticSearch - Latest record per day per ID from elastic](https://discuss.elastic.co/t/elasticsearch-latest-record-per-day-per-id-from-elastic/262993)

<div class="topic-metadata">

**Author:** [@prashantmalik](https://discuss.elastic.co/u/prashantmalik)\
**Replies:** 1\
**Last updated:** [February 2, 2021, 2:03pm UTC](https://discuss.elastic.co/t/elasticsearch-latest-record-per-day-per-id-from-elastic/262993 "2021-02-02T14:03:39Z")

</div>

I have index in Elsaticsearch of records of form: Record{ Timestamp; Id; . .} It has multiple records for ID per day. I want to fetch latest record per Id per day. Can you please help me with such query? Exam…

---

## [Reindex failed: search\_context\_missing\_exception](https://discuss.elastic.co/t/reindex-failed-search-context-missing-exception/262992)

<div class="topic-metadata">

**Author:** [@wangxr1985](https://discuss.elastic.co/u/wangxr1985)\
**Replies:** 0\
**Last updated:** [February 2, 2021, 1:53pm UTC](https://discuss.elastic.co/t/reindex-failed-search-context-missing-exception/262992 "2021-02-02T13:53:53Z")

</div>

I want to migrate a index from es5 cluster to es7 cluster by using remote reindexing. The number of docs is 5,000,000. I use curl to call the \_reindex api like this: curl -uelastic:xxx -XPOST -H 'Content-Type: applica…

---

## [Best Practises to handle an index of of 1.2TiB](https://discuss.elastic.co/t/best-practises-to-handle-an-index-of-of-1-2tib/262839)

<div class="topic-metadata">

**Author:** [@carmine.fabrizio](https://discuss.elastic.co/u/carmine.fabrizio)\
**Replies:** 6\
**Last updated:** [February 2, 2021, 12:09pm UTC](https://discuss.elastic.co/t/best-practises-to-handle-an-index-of-of-1-2tib/262839 "2021-02-02T12:09:58Z")

</div>

Hi there, I have an index of 1.2TiB, split into 9 shards of 200GiB each, also I do have a lifecycle policy that will roll the shards in HOT/WARM/COLD phases. Are there any best practices that I can introduce in order t…

---

## [Pipeline workers configuration](https://discuss.elastic.co/t/pipeline-workers-configuration/262934)

<div class="topic-metadata">

**Author:** [@ritusingh](https://discuss.elastic.co/u/ritusingh)\
**Replies:** 8\
**Last updated:** [February 2, 2021, 11:21am UTC](https://discuss.elastic.co/t/pipeline-workers-configuration/262934 "2021-02-02T11:21:14Z")

</div>

Hi, I have reduced pipeline.workers to 1 because I need the output in correct order. Now the problem is when I am giving 10k request (100 per second) it is not reaching elasticsearch, only 9k reaching. Earlier it was no…

---

## [Minus timezone on date histogram aggregation shifts back buckets one day](https://discuss.elastic.co/t/minus-timezone-on-date-histogram-aggregation-shifts-back-buckets-one-day/262959)

<div class="topic-metadata">

**Author:** [@anas-hossam](https://discuss.elastic.co/u/anas-hossam)\
**Replies:** 0\
**Last updated:** [February 2, 2021, 10:28am UTC](https://discuss.elastic.co/t/minus-timezone-on-date-histogram-aggregation-shifts-back-buckets-one-day/262959 "2021-02-02T10:28:03Z")

</div>

this is my body request when search in elasticsearch version 1.5 { "body": { "size": 0, "query": { "filtered": { "filter": { "bool": { …

---

## [ILM: keep all indices on hot node](https://discuss.elastic.co/t/ilm-keep-all-indices-on-hot-node/262861)

<div class="topic-metadata">

**Author:** [@matejzero](https://discuss.elastic.co/u/matejzero)\
**Replies:** 3\
**Last updated:** [February 2, 2021, 10:14am UTC](https://discuss.elastic.co/t/ilm-keep-all-indices-on-hot-node/262861 "2021-02-02T10:14:16Z")

</div>

Hello, I'm transitioning to ILM and at the moment, I have hot and warm nodes. Warm nodes don't have any data as I have cluster.routing.allocation.exclude.\_ip set on the warm nodes. I want to create an ILM policy that w…

---

## [Replicas allocation failed](https://discuss.elastic.co/t/replicas-allocation-failed/261768)

<div class="topic-metadata">

**Author:** [@mcosta](https://discuss.elastic.co/u/mcosta)\
**Replies:** 8\
**Last updated:** [February 2, 2021, 10:07am UTC](https://discuss.elastic.co/t/replicas-allocation-failed/261768 "2021-02-02T10:07:48Z")

</div>

Hi, After adjusting "index lifecycle policies" several times for this index, some replicas can't be allocated: 1- Is there a way to reallocate those replicas? 2- Is it possible to force all indices to have the same …

---

## [ES node out of memory: Java heap space](https://discuss.elastic.co/t/es-node-out-of-memory-java-heap-space/262787)

<div class="topic-metadata">

**Author:** [@iammanmale](https://discuss.elastic.co/u/iammanmale)\
**Replies:** 15\
**Last updated:** [February 2, 2021, 9:56am UTC](https://discuss.elastic.co/t/es-node-out-of-memory-java-heap-space/262787 "2021-02-02T09:56:51Z")

</div>

I often find out of memory: Java heap space in some nodes in our ES cluster. I have already allocated half of the total memory of each node to heap size but I still get this error. And except heap size issue, I never fin…

---

## [Parser for LDAP logs - ECS format](https://discuss.elastic.co/t/parser-for-ldap-logs-ecs-format/262115)

<div class="topic-metadata">

**Author:** [@Logsman](https://discuss.elastic.co/u/Logsman)\
**Replies:** 1\
**Last updated:** [February 2, 2021, 9:22am UTC](https://discuss.elastic.co/t/parser-for-ldap-logs-ecs-format/262115 "2021-02-02T09:22:43Z")

</div>

Hi there ! I'm currently collecting LDAP logs (RHDS) with filebeat. As you know, there isn't any module for these type of logs. However, I would like to be able to create alert on Elastic security based on these logs. …

---

## [Using elasticsearch with SELinux](https://discuss.elastic.co/t/using-elasticsearch-with-selinux/262949)

<div class="topic-metadata">

**Author:** [@redplastic](https://discuss.elastic.co/u/redplastic)\
**Replies:** 0\
**Last updated:** [February 2, 2021, 9:14am UTC](https://discuss.elastic.co/t/using-elasticsearch-with-selinux/262949 "2021-02-02T09:14:26Z")

</div>

I'm attempting to use elasticsearch on a Centos machine with SELinux on enforced mode. However when running elasticsearch, it results in the java and controller service running as uncontrolled services. As having uncont…

---

## [Apply warm allocation after reconfigure ILM policy](https://discuss.elastic.co/t/apply-warm-allocation-after-reconfigure-ilm-policy/262250)

<div class="topic-metadata">

**Author:** [@Xavier\_Romero](https://discuss.elastic.co/u/Xavier_Romero)\
**Replies:** 1\
**Last updated:** [February 2, 2021, 8:46am UTC](https://discuss.elastic.co/t/apply-warm-allocation-after-reconfigure-ilm-policy/262250 "2021-02-02T08:46:01Z")

</div>

Hello, I've just added "highstorage" nodes to my Elastic Cloud deployment to store "warm" indexes. So, I've modified the ILM associated with my indexes to move indexes getting into warm phase to these new nodes. However…

---

## [Is the indices dir corresponded to indices I have in cluster?](https://discuss.elastic.co/t/is-the-indices-dir-corresponded-to-indices-i-have-in-cluster/262924)

<div class="topic-metadata">

**Author:** [@CHU\_XU](https://discuss.elastic.co/u/CHU_XU)\
**Replies:** 3\
**Last updated:** [February 2, 2021, 8:36am UTC](https://discuss.elastic.co/t/is-the-indices-dir-corresponded-to-indices-i-have-in-cluster/262924 "2021-02-02T08:36:26Z")

</div>

Hi experts, When I'm exploring the data dir of elasticsearch node, I found that there are some dirs in 'data/nodes/0/indices', say 'foo' and 'bar'. Are these dirs right my actual indices in cluster(foo and bar) correspo…

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=711)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=713)
