# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=906

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 907

---

## [ELK Stack - Hardware set-up](https://discuss.elastic.co/t/elk-stack-hardware-set-up/234875)

<div class="topic-metadata">

**Author:** [@fmquasi](https://discuss.elastic.co/u/fmquasi)\
**Replies:** 4\
**Last updated:** [May 29, 2020, 8:33am UTC](https://discuss.elastic.co/t/elk-stack-hardware-set-up/234875 "2020-05-29T08:33:32Z")

</div>

Im new to the ELK stack - and in now getting ready to set-up a cluster with a total of 4.5tb and then expand later. Can you please advise if this set-up works: 2xservers for elastic search 1server x logstach 1xserver…

---

## [Elasticsearch unable to build using Gradle](https://discuss.elastic.co/t/elasticsearch-unable-to-build-using-gradle/234715)

<div class="topic-metadata">

**Author:** [@Shubham\_Jha\_99](https://discuss.elastic.co/u/Shubham_Jha_99)\
**Replies:** 3\
**Last updated:** [May 29, 2020, 5:31am UTC](https://discuss.elastic.co/t/elasticsearch-unable-to-build-using-gradle/234715 "2020-05-29T05:31:29Z")

</div>

I am trying to setup Ealasticsearch on my windows 10 for intellij following this link but when i execute gradlew.bat idea I am getting this error. . I am using Gradle version 6.4 and java jdk 14.

---

## [Create-or-replace index programmatically](https://discuss.elastic.co/t/create-or-replace-index-programmatically/234344)

<div class="topic-metadata">

**Author:** [@mmu](https://discuss.elastic.co/u/mmu)\
**Replies:** 5\
**Last updated:** [May 29, 2020, 8:01am UTC](https://discuss.elastic.co/t/create-or-replace-index-programmatically/234344 "2020-05-29T08:01:25Z")

</div>

Hi, I have a JAVA web service that uses an ES index for caching. Sometimes the field/index definitions change so the ES index must be re-created. What I am looking for is a solution pattern (or API function) that: Cr…

---

## [How to send notification if filebeat on a machine not sending data for certain time](https://discuss.elastic.co/t/how-to-send-notification-if-filebeat-on-a-machine-not-sending-data-for-certain-time/234868)

<div class="topic-metadata">

**Author:** [@iammanmale](https://discuss.elastic.co/u/iammanmale)\
**Replies:** 2\
**Last updated:** [May 29, 2020, 8:01am UTC](https://discuss.elastic.co/t/how-to-send-notification-if-filebeat-on-a-machine-not-sending-data-for-certain-time/234868 "2020-05-29T08:01:02Z")

</div>

As caption, is it possible to do so?

---

## [Restrict access Manage Ingest Pipelines](https://discuss.elastic.co/t/restrict-access-manage-ingest-pipelines/234878)

<div class="topic-metadata">

**Author:** [@vladtepes](https://discuss.elastic.co/u/vladtepes)\
**Replies:** 0\
**Last updated:** [May 29, 2020, 7:46am UTC](https://discuss.elastic.co/t/restrict-access-manage-ingest-pipelines/234878 "2020-05-29T07:46:14Z")

</div>

Hi, Is it possible to restrict access to manage ingest pipelines, based on Space? I found only one permission and that is manage\_ingest\_pipelines. This is why I am looking at how to limit this.

---

## [Elasticsearch failed to execute bulk item (create) index](https://discuss.elastic.co/t/elasticsearch-failed-to-execute-bulk-item-create-index/234876)

<div class="topic-metadata">

**Author:** [@MichaelA](https://discuss.elastic.co/u/MichaelA)\
**Replies:** 0\
**Last updated:** [May 29, 2020, 7:34am UTC](https://discuss.elastic.co/t/elasticsearch-failed-to-execute-bulk-item-create-index/234876 "2020-05-29T07:34:44Z")

</div>

Hi, dear community! We are experiencing some difficulties in obtaining data on our cluster and found this error in the logs on several Elastic nodes. Could you help, please? \[2020-05-29T07:01:30,332\]\[DEBUG\]\[o.e.a.b.Tra…

---

## [Transform has failed; experienced: \[task encountered irrecoverable failure: field name cannot be null.\]](https://discuss.elastic.co/t/transform-has-failed-experienced-task-encountered-irrecoverable-failure-field-name-cannot-be-null/234780)

<div class="topic-metadata">

**Author:** [@simonlucalandi](https://discuss.elastic.co/u/simonlucalandi)\
**Replies:** 3\
**Last updated:** [May 29, 2020, 7:24am UTC](https://discuss.elastic.co/t/transform-has-failed-experienced-task-encountered-irrecoverable-failure-field-name-cannot-be-null/234780 "2020-05-29T07:24:39Z")

</div>

Hi all. I created a transform on ES 7.7.0 from Kibana gui, that uses some group\_by with script to handle any missing fields in the docs: "pivot": { "group\_by": { "acquisition.utm\_campaign.keyword": {…

---

## [Combine Two csv fileds using key column in logstash/Elasticsearch](https://discuss.elastic.co/t/combine-two-csv-fileds-using-key-column-in-logstash-elasticsearch/233677)

<div class="topic-metadata">

**Author:** [@renu\_jessi](https://discuss.elastic.co/u/renu_jessi)\
**Replies:** 1\
**Last updated:** [May 29, 2020, 5:32am UTC](https://discuss.elastic.co/t/combine-two-csv-fileds-using-key-column-in-logstash-elasticsearch/233677 "2020-05-29T05:32:19Z")

</div>

Hi, I have two csv files like below CSV1 : ID,Number,Name,Gender 100,CHG0032798,Thor,Male CSV2 : ID.Drop 100,drop1 ISSUE: I need to combine this csv fileds make it as one index like below ID Number Gender Drop …

---

## [ES audit security events for user management audit trails, etc](https://discuss.elastic.co/t/es-audit-security-events-for-user-management-audit-trails-etc/234856)

<div class="topic-metadata">

**Author:** [@hendry.lim](https://discuss.elastic.co/u/hendry.lim)\
**Replies:** 2\
**Last updated:** [May 29, 2020, 4:59am UTC](https://discuss.elastic.co/t/es-audit-security-events-for-user-management-audit-trails-etc/234856 "2020-05-29T04:59:59Z")

</div>

Hi, is there a way to audit user management events in ES currently? We need to audit creation/update/removal of users in ES. We also need to audit password changes. This may be a question for Kibana. Is there a way t…

---

## [How should I wrap and reuse the RestClient behind in a web service facade?](https://discuss.elastic.co/t/how-should-i-wrap-and-reuse-the-restclient-behind-in-a-web-service-facade/234806)

<div class="topic-metadata">

**Author:** [@mmu](https://discuss.elastic.co/u/mmu)\
**Replies:** 1\
**Last updated:** [May 29, 2020, 4:43am UTC](https://discuss.elastic.co/t/how-should-i-wrap-and-reuse-the-restclient-behind-in-a-web-service-facade/234806 "2020-05-29T04:43:03Z")

</div>

I have a JAVA service that wraps ES for specific queries behind an API. This means all requests are inspected by the facade and translated into ES queries via the JAVA API. Creating a fresh RestClient for each incoming …

---

## [Update field type to solve mapper\_parsing\_exception](https://discuss.elastic.co/t/update-field-type-to-solve-mapper-parsing-exception/234815)

<div class="topic-metadata">

**Author:** [@ahmad\_qasim](https://discuss.elastic.co/u/ahmad_qasim)\
**Replies:** 1\
**Last updated:** [May 29, 2020, 4:40am UTC](https://discuss.elastic.co/t/update-field-type-to-solve-mapper-parsing-exception/234815 "2020-05-29T04:40:50Z")

</div>

Hello, field 'status' stored in elasticsearch, based on different responses from vendors(200,0,'XSDDF',...etc), and the value may represent string or integers, the definition of status field in mapping is : "status" :…

---

## [When using UpdateByQuery it appears the return json for \_source is modified and fields are returned out of order](https://discuss.elastic.co/t/when-using-updatebyquery-it-appears-the-return-json-for-source-is-modified-and-fields-are-returned-out-of-order/234840)

<div class="topic-metadata">

**Author:** [@skv325](https://discuss.elastic.co/u/skv325)\
**Replies:** 1\
**Last updated:** [May 29, 2020, 4:26am UTC](https://discuss.elastic.co/t/when-using-updatebyquery-it-appears-the-return-json-for-source-is-modified-and-fields-are-returned-out-of-order/234840 "2020-05-29T04:26:40Z")

</div>

Hi, I have an issue with using C# NEST low level client UpdateByQuery method. When I update index documents with this method, properties in \_source get shuffled. Fields are returned out of order for the updated document…

---

## [Probleme x-pack elasticsearch-7.7.0](https://discuss.elastic.co/t/probleme-x-pack-elasticsearch-7-7-0/234830)

<div class="topic-metadata">

**Author:** [@daiana](https://discuss.elastic.co/u/daiana)\
**Replies:** 7\
**Last updated:** [May 28, 2020, 11:02pm UTC](https://discuss.elastic.co/t/probleme-x-pack-elasticsearch-7-7-0/234830 "2020-05-28T23:02:15Z")

</div>

Hi, I am new with elasticsearch . I installed elasticsearch-oss and when I try x-pack I have the following error : Thanks

---

## [How to cause queries to fail against an index when unmapped fields are referenced?](https://discuss.elastic.co/t/how-to-cause-queries-to-fail-against-an-index-when-unmapped-fields-are-referenced/234820)

<div class="topic-metadata">

**Author:** [@jheath](https://discuss.elastic.co/u/jheath)\
**Replies:** 0\
**Last updated:** [May 28, 2020, 8:53pm UTC](https://discuss.elastic.co/t/how-to-cause-queries-to-fail-against-an-index-when-unmapped-fields-are-referenced/234820 "2020-05-28T20:53:56Z")

</div>

Hi folks, Is there a method by which we can cause queries to fail against an index when unmapped fields are referenced? I have noticed that, in the past, there was an ignore\_unmapped option that worked, however suppo…

---

## [Turn off TF/IDF for searching human names](https://discuss.elastic.co/t/turn-off-tf-idf-for-searching-human-names/234609)

<div class="topic-metadata">

**Author:** [@gideongrossman](https://discuss.elastic.co/u/gideongrossman)\
**Replies:** 1\
**Last updated:** [May 28, 2020, 8:45pm UTC](https://discuss.elastic.co/t/turn-off-tf-idf-for-searching-human-names/234609 "2020-05-28T20:45:22Z")

</div>

I have a query that works fairly well for scoring matches in human name and address fields. However, some documents get an undesirably high score. For example, when I search for the string "CHR", DONALD MCCLURE at the …

---

## [Elasticsearch not able to build Using Gradle](https://discuss.elastic.co/t/elasticsearch-not-able-to-build-using-gradle/234757)

<div class="topic-metadata">

**Author:** [@Senkyy1](https://discuss.elastic.co/u/Senkyy1)\
**Replies:** 6\
**Last updated:** [May 28, 2020, 7:35pm UTC](https://discuss.elastic.co/t/elasticsearch-not-able-to-build-using-gradle/234757 "2020-05-28T19:35:15Z")

</div>

I am trying to setup Elasticsearch on my windows 10 for intellij following this link but when i execute gradlew.bat idea I am getting this error. Me using Gradle Version 6.4 and Jdk version 14 and windows 10

---

## [Elasticsearch.py with SSL and api key getting 401 unauthorized error](https://discuss.elastic.co/t/elasticsearch-py-with-ssl-and-api-key-getting-401-unauthorized-error/233808)

<div class="topic-metadata">

**Author:** [@TonyLuc](https://discuss.elastic.co/u/TonyLuc)\
**Replies:** 1\
**Last updated:** [May 28, 2020, 7:28pm UTC](https://discuss.elastic.co/t/elasticsearch-py-with-ssl-and-api-key-getting-401-unauthorized-error/233808 "2020-05-28T19:28:37Z")

</div>

Objectives: To perform search on ElasticSearch via Python. I have followed the example in https://elasticsearch-py.readthedocs.io/en/master/ section SSL and Authentication and I could not get it to work. I been staring…

---

## [Sort nested field with two conditions](https://discuss.elastic.co/t/sort-nested-field-with-two-conditions/234804)

<div class="topic-metadata">

**Author:** [@net](https://discuss.elastic.co/u/net)\
**Replies:** 0\
**Last updated:** [May 28, 2020, 7:28pm UTC](https://discuss.elastic.co/t/sort-nested-field-with-two-conditions/234804 "2020-05-28T19:28:17Z")

</div>

Here is what my mapping looks like: Elasticsearch version 5.5 { "myindex": { "mappings": { "mythings": { "properties": { "title": { "type": "text" }, "custo…

---

## [Combining Function Score query and filtering](https://discuss.elastic.co/t/combining-function-score-query-and-filtering/234802)

<div class="topic-metadata">

**Author:** [@chrisbag](https://discuss.elastic.co/u/chrisbag)\
**Replies:** 0\
**Last updated:** [May 28, 2020, 6:57pm UTC](https://discuss.elastic.co/t/combining-function-score-query-and-filtering/234802 "2020-05-28T18:57:24Z")

</div>

Hello everybody, I have been struggling all afternoon trying to combine a filter with my score function and script. I have been struggling just to implement a simple filter (I do not wish to impact the scoring function,…

---

## ["missing authentication credentials for REST request" error when attempting ApiKey authentication](https://discuss.elastic.co/t/missing-authentication-credentials-for-rest-request-error-when-attempting-apikey-authentication/234799)

<div class="topic-metadata">

**Author:** [@jrykowski-huron](https://discuss.elastic.co/u/jrykowski-huron)\
**Replies:** 1\
**Last updated:** [May 28, 2020, 6:53pm UTC](https://discuss.elastic.co/t/missing-authentication-credentials-for-rest-request-error-when-attempting-apikey-authentication/234799 "2020-05-28T18:53:21Z")

</div>

New implementation of elasticsearch (first timer). elasticsearch version: 7.6.1 Basic license I'm able to use username/password method of adding content to an index, however not able to get ApiKey method to work for a…

---

## [Complex nested query in elastic](https://discuss.elastic.co/t/complex-nested-query-in-elastic/234796)

<div class="topic-metadata">

**Author:** [@max\_chen](https://discuss.elastic.co/u/max_chen)\
**Replies:** 0\
**Last updated:** [May 28, 2020, 6:37pm UTC](https://discuss.elastic.co/t/complex-nested-query-in-elastic/234796 "2020-05-28T18:37:00Z")

</div>

I have a complex query requirement in elastic and I would like to know if this is possible in elastic. I have the following data structure in elastic index: { { "hostname" : "host1", "neighbors" : \["host2", host…

---

## [Elasticsearch randomly switched initial master node](https://discuss.elastic.co/t/elasticsearch-randomly-switched-initial-master-node/234790)

<div class="topic-metadata">

**Author:** [@jon-behnken](https://discuss.elastic.co/u/jon-behnken)\
**Replies:** 3\
**Last updated:** [May 28, 2020, 5:45pm UTC](https://discuss.elastic.co/t/elasticsearch-randomly-switched-initial-master-node/234790 "2020-05-28T17:45:20Z")

</div>

I'm rather inexperienced with the deeper workings of Elasticsearch, but I've been able to establish a two-node cluster with a small (~20gb) index of text files. I'm running Elasticsearch 7.6.2 on Windows Server 2012. Pri…

---

## [Elasticsearch crashes with - org.elasticsearch.cluster.block.ClusterBlockException](https://discuss.elastic.co/t/elasticsearch-crashes-with-org-elasticsearch-cluster-block-clusterblockexception/234631)

<div class="topic-metadata">

**Author:** [@Lisahtwy](https://discuss.elastic.co/u/Lisahtwy)\
**Replies:** 26\
**Last updated:** [May 28, 2020, 5:42pm UTC](https://discuss.elastic.co/t/elasticsearch-crashes-with-org-elasticsearch-cluster-block-clusterblockexception/234631 "2020-05-28T17:42:06Z")

</div>

Hi, When I am indexing few repositories files using fscrawler, elasticsearch is crashing. The exception i got from my program is : ConnectionError(\<urllib3.connection.HTTPConnection object at 0x7feaf2a65e10\>: Failed t…

---

## [Tesseract-OCR only returns new lines](https://discuss.elastic.co/t/tesseract-ocr-only-returns-new-lines/233960)

<div class="topic-metadata">

**Author:** [@morningkaren](https://discuss.elastic.co/u/morningkaren)\
**Replies:** 9\
**Last updated:** [May 28, 2020, 5:39pm UTC](https://discuss.elastic.co/t/tesseract-ocr-only-returns-new-lines/233960 "2020-05-28T17:39:28Z")

</div>

I am using Tesseract-OCR to extract text from pdfs with fscrawler. I have tried configuring \_settings.yaml with the path and data\_path for Tesseract and also tried it without the path and data\_path. However, when I use K…

---

## [Permission denied when docker run](https://discuss.elastic.co/t/permission-denied-when-docker-run/234789)

<div class="topic-metadata">

**Author:** [@sammaxwell](https://discuss.elastic.co/u/sammaxwell)\
**Replies:** 0\
**Last updated:** [May 28, 2020, 5:32pm UTC](https://discuss.elastic.co/t/permission-denied-when-docker-run/234789 "2020-05-28T17:32:36Z")

</div>

I docker pulled elasticsearch:7.7.0 successfully, but when I attempt to docker run it I get "/bin/bash: /usr/local/bin/docker-entrypoint.sh: Permission denied" the /usr/local/bin folder is empty! Any ideas what I am do…

---

## [Curator not working with istio - fail to reach ES sporadically](https://discuss.elastic.co/t/curator-not-working-with-istio-fail-to-reach-es-sporadically/234721)

<div class="topic-metadata">

**Author:** [@shivani\_aggarwal](https://discuss.elastic.co/u/shivani_aggarwal)\
**Replies:** 1\
**Last updated:** [May 28, 2020, 1:50pm UTC](https://discuss.elastic.co/t/curator-not-working-with-istio-fail-to-reach-es-sporadically/234721 "2020-05-28T13:50:58Z")

</div>

Hi, I am trying to run elasticsearch with istio in kubernetes environment. Elasticsearch-oss: 7.0.1 Istio 1.5.2 Istio sidecars are ingested into elasticsearch pods (master, data nodes) as well as into elasticsearch-c…

---

## [Bulk index slowing down as index size increases](https://discuss.elastic.co/t/bulk-index-slowing-down-as-index-size-increases/234288)

<div class="topic-metadata">

**Author:** [@Pyppe](https://discuss.elastic.co/u/Pyppe)\
**Replies:** 13\
**Last updated:** [May 28, 2020, 4:32pm UTC](https://discuss.elastic.co/t/bulk-index-slowing-down-as-index-size-increases/234288 "2020-05-28T16:32:52Z")

</div>

Any words of wisdom for bulk indexing starting to slow significantly down as amount of data increases? The index I'm creating (starting from zero documents) has about 122 million documents on total, spread on 12 shards (…

---

## [Custom aggregation plugin with multiple result reader](https://discuss.elastic.co/t/custom-aggregation-plugin-with-multiple-result-reader/234425)

<div class="topic-metadata">

**Author:** [@sylvain.mazet](https://discuss.elastic.co/u/sylvain.mazet)\
**Replies:** 1\
**Last updated:** [May 28, 2020, 4:03pm UTC](https://discuss.elastic.co/t/custom-aggregation-plugin-with-multiple-result-reader/234425 "2020-05-28T16:03:55Z")

</div>

Hi all. I am writing a specific aggregation plugin (not the first one I write...) for ES version 6.6. This plugin can compute various aggregations (intended for process mining) on the data, with only one aggregation …

---

## [Wait for completion option in delete query for es 2.3](https://discuss.elastic.co/t/wait-for-completion-option-in-delete-query-for-es-2-3/231402)

<div class="topic-metadata">

**Author:** [@nomanahmed](https://discuss.elastic.co/u/nomanahmed)\
**Replies:** 5\
**Last updated:** [May 28, 2020, 1:10pm UTC](https://discuss.elastic.co/t/wait-for-completion-option-in-delete-query-for-es-2-3/231402 "2020-05-28T13:10:01Z")

</div>

Do we have wait for completion option in delete query for es 2.3? I search but found nothing, can anyone confirm and point me to any alternative method of it? Command I m using curl --request DELETE "http://localhost:92…

---

## [Range query not giving relevant results](https://discuss.elastic.co/t/range-query-not-giving-relevant-results/234725)

<div class="topic-metadata">

**Author:** [@rishabh\_jain](https://discuss.elastic.co/u/rishabh_jain)\
**Replies:** 1\
**Last updated:** [May 28, 2020, 12:54pm UTC](https://discuss.elastic.co/t/range-query-not-giving-relevant-results/234725 "2020-05-28T12:54:33Z")

</div>

{ "query": { "bool": { "must": \[ { "range": { "age": { "gte": 10, "lte": 20 } } } \] } }, "\_source": \["age"\] } "Result":: With the results which fall in the range Also Getting result whose age is greater…

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=905)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=907)
