# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=864

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 865

---

## [AuthorizationException with python API to remote server](https://discuss.elastic.co/t/authorizationexception-with-python-api-to-remote-server/238514)

<div class="topic-metadata">

**Author:** [@yuv\_c](https://discuss.elastic.co/u/yuv_c)\
**Replies:** 5\
**Last updated:** [July 12, 2020, 10:16pm UTC](https://discuss.elastic.co/t/authorizationexception-with-python-api-to-remote-server/238514 "2020-07-12T22:16:07Z")

</div>

I am trying to use the elasticsearch python API but I get an AuthorizationException every time I run the query. Here is the code: host = "https:/foo.com/es" client = Elasticsearch(host, api\_key='...MY\_API\_KEY...) re…

---

## ['preserve\_existing' documentation update](https://discuss.elastic.co/t/preserve-existing-documentation-update/240836)

<div class="topic-metadata">

**Author:** [@tworogue](https://discuss.elastic.co/u/tworogue)\
**Replies:** 3\
**Last updated:** [July 12, 2020, 8:00pm UTC](https://discuss.elastic.co/t/preserve-existing-documentation-update/240836 "2020-07-12T20:00:31Z")

</div>

Hello. Topic: I have a proposal regarding one piece of documentation: Please check my PR: Update update-settings.asciidoc by tworogue · Pull Request #1 · tworogue/elasticsearch · GitHub Do you agree with it? Some m…

---

## [How to combine/pair multiple events into single event (consider as a single transaction) based on a rule](https://discuss.elastic.co/t/how-to-combine-pair-multiple-events-into-single-event-consider-as-a-single-transaction-based-on-a-rule/240862)

<div class="topic-metadata">

**Author:** [@kelk](https://discuss.elastic.co/u/kelk)\
**Replies:** 0\
**Last updated:** [July 12, 2020, 7:56pm UTC](https://discuss.elastic.co/t/how-to-combine-pair-multiple-events-into-single-event-consider-as-a-single-transaction-based-on-a-rule/240862 "2020-07-12T19:56:06Z")

</div>

Let's consider below sample events, \_index:windows\_security empId:12345 action:create time:0900 \_index:windows\_security empId:12345 action:delete time:0910 \_index:windows\_security empId:12345 action:created time:150…

---

## [Efficient document structure](https://discuss.elastic.co/t/efficient-document-structure/240760)

<div class="topic-metadata">

**Author:** [@maxheyer](https://discuss.elastic.co/u/maxheyer)\
**Replies:** 3\
**Last updated:** [July 12, 2020, 7:11pm UTC](https://discuss.elastic.co/t/efficient-document-structure/240760 "2020-07-12T19:11:19Z")

</div>

Hello, we want to use elastic search for e-commerce statistics. In our web view we have the possibility to filter products by sales, attributes like colors, categories, full text search etc. The result is a table of pr…

---

## [Painless script\_field returns just that field in query result?](https://discuss.elastic.co/t/painless-script-field-returns-just-that-field-in-query-result/240852)

<div class="topic-metadata">

**Author:** [@teebu](https://discuss.elastic.co/u/teebu)\
**Replies:** 1\
**Last updated:** [July 12, 2020, 7:07pm UTC](https://discuss.elastic.co/t/painless-script-field-returns-just-that-field-in-query-result/240852 "2020-07-12T19:07:08Z")

</div>

I don't see any mention in the docs about this. When using a script\_field, only that field is returned in the results, not with the rest of the document, I have to add includes to get the rest of the fields? GET data/…

---

## [Elasticsearch nodes are visible to each other in GCE, but won't form a cluster](https://discuss.elastic.co/t/elasticsearch-nodes-are-visible-to-each-other-in-gce-but-wont-form-a-cluster/240770)

<div class="topic-metadata">

**Author:** [@yagodorea](https://discuss.elastic.co/u/yagodorea)\
**Replies:** 6\
**Last updated:** [July 12, 2020, 7:00pm UTC](https://discuss.elastic.co/t/elasticsearch-nodes-are-visible-to-each-other-in-gce-but-wont-form-a-cluster/240770 "2020-07-12T19:00:58Z")

</div>

I'm trying to set up a simple cluster using 2 GCE VMs (test-elk1 and test-elk2) from inside docker containers. I've setup firewall rules so they are completely visible to each other, so performing: curl http://\<instanc…

---

## [Master election - got Failed To Commit Cluster State Exception](https://discuss.elastic.co/t/master-election-got-failed-to-commit-cluster-state-exception/240821)

<div class="topic-metadata">

**Author:** [@Alex\_Davidovich](https://discuss.elastic.co/u/Alex_Davidovich)\
**Replies:** 5\
**Last updated:** [July 12, 2020, 8:22am UTC](https://discuss.elastic.co/t/master-election-got-failed-to-commit-cluster-state-exception/240821 "2020-07-12T08:22:20Z")

</div>

We are working with Elastic 7.2.1. Elastic master (node-2) had a long GC pause. \[2020-06-30T07:30:11.778+0000\]\[3665\]\[gc \] GC(248) Pause Young (Allocation Failure) 222M-\>86M(494M) 32547.255ms \[2020-06-30T07:30:11.778+00…

---

## [Failed installing 'elasticsearch-service-x64' service on brand new installation](https://discuss.elastic.co/t/failed-installing-elasticsearch-service-x64-service-on-brand-new-installation/240679)

<div class="topic-metadata">

**Author:** [@defalt](https://discuss.elastic.co/u/defalt)\
**Replies:** 1\
**Last updated:** [July 12, 2020, 7:48am UTC](https://discuss.elastic.co/t/failed-installing-elasticsearch-service-x64-service-on-brand-new-installation/240679 "2020-07-12T07:48:04Z")

</div>

Hi, I am trying to install elastic as a service. Situation: 3 Nodes. 3 New installations of Elasticsearch 7.7.1. YMLcluster.name: ServiceTest node.name: node1 node.master: true network.host: IPofNode1 http.host: 0.0…

---

## [Unable to execute mtermvectors elasticsearch query from AWS EMR cluster using Spark](https://discuss.elastic.co/t/unable-to-execute-mtermvectors-elasticsearch-query-from-aws-emr-cluster-using-spark/240819)

<div class="topic-metadata">

**Author:** [@Salil\_Surendran](https://discuss.elastic.co/u/Salil_Surendran)\
**Replies:** 0\
**Last updated:** [July 12, 2020, 5:22am UTC](https://discuss.elastic.co/t/unable-to-execute-mtermvectors-elasticsearch-query-from-aws-emr-cluster-using-spark/240819 "2020-07-12T05:22:10Z")

</div>

Hello, I am trying to execute this elasticsearch query via spark: POST /aa6/\_mtermvectors { "ids": \[ "ABC", "XYA", "RTE" \], "parameters": { "fields": \[ …

---

## [S3 Repository plugin works on Mac/brew but not Ubuntu/apt-get](https://discuss.elastic.co/t/s3-repository-plugin-works-on-mac-brew-but-not-ubuntu-apt-get/240766)

<div class="topic-metadata">

**Author:** [@mooreniemi](https://discuss.elastic.co/u/mooreniemi)\
**Replies:** 3\
**Last updated:** [July 12, 2020, 2:12am UTC](https://discuss.elastic.co/t/s3-repository-plugin-works-on-mac-brew-but-not-ubuntu-apt-get/240766 "2020-07-12T02:12:41Z")

</div>

I'm using ES 6.8. I have a snapshot in an S3 bucket. On Mac, using brew installed ES, I was able to successfully restore the snapshot onto my local machine. But I am not able to do the same on Ubuntu. Additionally, the e…

---

## [In a 3 node Cluster, having 2 data nodes and 1 node without data but this node having much less CPU and RAM resources, will compromise my overall performance?](https://discuss.elastic.co/t/in-a-3-node-cluster-having-2-data-nodes-and-1-node-without-data-but-this-node-having-much-less-cpu-and-ram-resources-will-compromise-my-overall-performance/240775)

<div class="topic-metadata">

**Author:** [@spdoes](https://discuss.elastic.co/u/spdoes)\
**Replies:** 3\
**Last updated:** [July 11, 2020, 5:31pm UTC](https://discuss.elastic.co/t/in-a-3-node-cluster-having-2-data-nodes-and-1-node-without-data-but-this-node-having-much-less-cpu-and-ram-resources-will-compromise-my-overall-performance/240775 "2020-07-11T17:31:40Z")

</div>

In a 3 node Cluster, having 2 data nodes and 1 node without data but this node having much less CPU and RAM resources, will compromise my overall performance ?

---

## [Convert lat, , long coming as two attributes to geo point](https://discuss.elastic.co/t/convert-lat-long-coming-as-two-attributes-to-geo-point/239877)

<div class="topic-metadata">

**Author:** [@vsk1](https://discuss.elastic.co/u/vsk1)\
**Replies:** 12\
**Last updated:** [July 11, 2020, 8:53am UTC](https://discuss.elastic.co/t/convert-lat-long-coming-as-two-attributes-to-geo-point/239877 "2020-07-11T08:53:15Z")

</div>

Hi, The input data that I'm getting from my application is returning as below { "timestamp": 2020-07-02, "name" : "location", "latitude": 39.01289 "longtitude" -76.979 } how do i update the elasticsearch index t…

---

## [Getting below Error while executing elasticsearch.bat](https://discuss.elastic.co/t/getting-below-error-while-executing-elasticsearch-bat/240788)

<div class="topic-metadata">

**Author:** [@vedantmehra18](https://discuss.elastic.co/u/vedantmehra18)\
**Replies:** 0\
**Last updated:** [July 11, 2020, 7:23am UTC](https://discuss.elastic.co/t/getting-below-error-while-executing-elasticsearch-bat/240788 "2020-07-11T07:23:24Z")

</div>

C:\\Elastic\_Stack\\elasticsearch-7.8.0-windows-x86\_64\\elasticsearch-7.8.0\\bin\>elasticsearch.bat future versions of Elasticsearch will require Java 11; your Java version from \[C:\\Program Files\\Java\\jdk1.8.0\_144\\jre\] does n…

---

## [Send Data from Mobile application to ELK](https://discuss.elastic.co/t/send-data-from-mobile-application-to-elk/240157)

<div class="topic-metadata">

**Author:** [@nirav.gshah](https://discuss.elastic.co/u/nirav.gshah)\
**Replies:** 6\
**Last updated:** [July 11, 2020, 4:37am UTC](https://discuss.elastic.co/t/send-data-from-mobile-application-to-elk/240157 "2020-07-11T04:37:58Z")

</div>

Hi All, I am looking for a solution, how can we ingest data into my elastic search directly from user Mobile Phone using rest API, Any help or document or method is appreciated.

---

## [Docker, ES 7.8.0, and the localhost snapshot repository](https://discuss.elastic.co/t/docker-es-7-8-0-and-the-localhost-snapshot-repository/240619)

<div class="topic-metadata">

**Author:** [@Jasper\_Showers](https://discuss.elastic.co/u/Jasper_Showers)\
**Replies:** 5\
**Last updated:** [July 11, 2020, 3:49am UTC](https://discuss.elastic.co/t/docker-es-7-8-0-and-the-localhost-snapshot-repository/240619 "2020-07-11T03:49:20Z")

</div>

I'm trying to execute a Dockerfile from elasticsearch:7.8.0 that will: Add a backup.tar.gz file to the image and extract it to a backup location. Change ownership of that folder so that ES has permission to read it. Ac…

---

## [Applying ILM to existing time-series indices](https://discuss.elastic.co/t/applying-ilm-to-existing-time-series-indices/240069)

<div class="topic-metadata">

**Author:** [@vanessa](https://discuss.elastic.co/u/vanessa)\
**Replies:** 1\
**Last updated:** [July 10, 2020, 11:24pm UTC](https://discuss.elastic.co/t/applying-ilm-to-existing-time-series-indices/240069 "2020-07-10T23:24:24Z")

</div>

Hello! I feel as though I've been on a wild goose chase today. Would appreciate any guidance here. As context, when I originally set up ILM in my index templates, I missed the step where you have to specify a rollover\_al…

---

## [How to return the modified document with bulk update](https://discuss.elastic.co/t/how-to-return-the-modified-document-with-bulk-update/240758)

<div class="topic-metadata">

**Author:** [@Attila\_Nagy](https://discuss.elastic.co/u/Attila_Nagy)\
**Replies:** 0\
**Last updated:** [July 10, 2020, 8:09pm UTC](https://discuss.elastic.co/t/how-to-return-the-modified-document-with-bulk-update/240758 "2020-07-10T20:09:03Z")

</div>

Previously (not sure about the versions, but I can't see errors with 6.8) I could use the bulk API to update a doc and to get back the modified document with (snippet from actual code using the Python Elastic client): b…

---

## [Elasticsearch cluster error "client did not trust this server's certificate, closing connection"](https://discuss.elastic.co/t/elasticsearch-cluster-error-client-did-not-trust-this-servers-certificate-closing-connection/240750)

<div class="topic-metadata">

**Author:** [@null\_or\_void\_at\_work](https://discuss.elastic.co/u/null_or_void_at_work)\
**Replies:** 0\
**Last updated:** [July 10, 2020, 7:31pm UTC](https://discuss.elastic.co/t/elasticsearch-cluster-error-client-did-not-trust-this-servers-certificate-closing-connection/240750 "2020-07-10T19:31:30Z")

</div>

Hi everyone. It's the first time I'm setting up an Elasticsearch (7.8) cluster. The cluster is running in 3 RHEL 7.7 virtual machines in Azure. The cluster runs just fine when there's no security enabled, but I start t…

---

## [Cluster Red after scale down with allocation\_status = fetching\_shard\_data](https://discuss.elastic.co/t/cluster-red-after-scale-down-with-allocation-status-fetching-shard-data/240749)

<div class="topic-metadata">

**Author:** [@UDixit](https://discuss.elastic.co/u/UDixit)\
**Replies:** 0\
**Last updated:** [July 10, 2020, 7:24pm UTC](https://discuss.elastic.co/t/cluster-red-after-scale-down-with-allocation-status-fetching-shard-data/240749 "2020-07-10T19:24:24Z")

</div>

Each of my index is 12 shards. I was running a 6R6P cluster(2 shards per partition). I recently scaled it down to 1R1P configuration. During the scale down, I reduced the replicacount to 0. After this, the cluster rema…

---

## [Total Hits in collapse has an upperbound of 10,000](https://discuss.elastic.co/t/total-hits-in-collapse-has-an-upperbound-of-10-000/240743)

<div class="topic-metadata">

**Author:** [@apurvnerlekar](https://discuss.elastic.co/u/apurvnerlekar)\
**Replies:** 0\
**Last updated:** [July 10, 2020, 6:43pm UTC](https://discuss.elastic.co/t/total-hits-in-collapse-has-an-upperbound-of-10-000/240743 "2020-07-10T18:43:16Z")

</div>

Hello, I am observing that the total\_hits in collapse field has an upperbound of 10,000. We have certain use-cases when we do use collapse and retrieve the total number of hits in it. If the inner\_hits are more than 10,…

---

## [ILM is not Working properly for ECK](https://discuss.elastic.co/t/ilm-is-not-working-properly-for-eck/240207)

<div class="topic-metadata">

**Author:** [@Melvin\_Ramos](https://discuss.elastic.co/u/Melvin_Ramos)\
**Replies:** 1\
**Last updated:** [July 10, 2020, 6:06pm UTC](https://discuss.elastic.co/t/ilm-is-not-working-properly-for-eck/240207 "2020-07-10T18:06:31Z")

</div>

Hello all, We've been running a ECK last May, 2020 and there are some weird issues we are seeing ES 7.6.2 Context: ECK 1.1.0 Hot-Warm Architecture 4 HotNodes = 64G Ram - 5TB Storage Fast SSD 8 warm Nodes = 28G ram…

---

## [Elasticsearch installation failed for some reason](https://discuss.elastic.co/t/elasticsearch-installation-failed-for-some-reason/240612)

<div class="topic-metadata">

**Author:** [@Splunk](https://discuss.elastic.co/u/Splunk)\
**Replies:** 3\
**Last updated:** [July 10, 2020, 5:47pm UTC](https://discuss.elastic.co/t/elasticsearch-installation-failed-for-some-reason/240612 "2020-07-10T17:47:20Z")

</div>

Hi Guys, this is the issue I am facing while I'm trying to install ES on my EC2 instance. OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 OpenJDK 64-Bit Server VM warning: INF…

---

## [How to enrich query using external lookup or DB table?](https://discuss.elastic.co/t/how-to-enrich-query-using-external-lookup-or-db-table/240699)

<div class="topic-metadata">

**Author:** [@kelk](https://discuss.elastic.co/u/kelk)\
**Replies:** 7\
**Last updated:** [July 10, 2020, 5:33pm UTC](https://discuss.elastic.co/t/how-to-enrich-query-using-external-lookup-or-db-table/240699 "2020-07-10T17:33:59Z")

</div>

hi I couldn't find a proper example of enriching outcome of a search query using external lookup/DB-table I'm looking for something like.. \<my search\> | lookup ip within {external lookup file or DB table} | if ip is p…

---

## [Unexpected results on transpositions](https://discuss.elastic.co/t/unexpected-results-on-transpositions/240734)

<div class="topic-metadata">

**Author:** [@Diego\_Solis](https://discuss.elastic.co/u/Diego_Solis)\
**Replies:** 0\
**Last updated:** [July 10, 2020, 5:33pm UTC](https://discuss.elastic.co/t/unexpected-results-on-transpositions/240734 "2020-07-10T17:33:38Z")

</div>

Hello folks, Is there a way to calculate/analyze how many expansions I would like to use in my query. I was playing with the query below, and the default 50 max\_expansions was not enough to get "John" out of "Jhon". I d…

---

## [Large Clusters - 35 nodes - ILM Issues](https://discuss.elastic.co/t/large-clusters-35-nodes-ilm-issues/240615)

<div class="topic-metadata">

**Author:** [@fvegaucr](https://discuss.elastic.co/u/fvegaucr)\
**Replies:** 2\
**Last updated:** [July 10, 2020, 4:15pm UTC](https://discuss.elastic.co/t/large-clusters-35-nodes-ilm-issues/240615 "2020-07-10T16:15:33Z")

</div>

Hi Im struggling a little bit with elastic ILM configuration. Version 7.4.2 I have a total of 35nodes 3 - master 2- coordinator 8 - hot nodes 20 - warm nodes 2 - cold nodes Warm Nodes have: 8 x 1.8TB of storage …

---

## [No errors but nothing gets indexed when using the Bulk API](https://discuss.elastic.co/t/no-errors-but-nothing-gets-indexed-when-using-the-bulk-api/240200)

<div class="topic-metadata">

**Author:** [@Rosho](https://discuss.elastic.co/u/Rosho)\
**Replies:** 13\
**Last updated:** [July 10, 2020, 3:48pm UTC](https://discuss.elastic.co/t/no-errors-but-nothing-gets-indexed-when-using-the-bulk-api/240200 "2020-07-10T15:48:23Z")

</div>

Hi I have written a script to read a list ("dummy") and index it into Elasticsearch. I converted the list into a list of dictionaries and used the "Bulk" API to index it into Elasticsearch. There are no errors but noth…

---

## [\[nested\] failed to find nested object under path \[orders\]](https://discuss.elastic.co/t/nested-failed-to-find-nested-object-under-path-orders/237603)

<div class="topic-metadata">

**Author:** [@ravivarmakola](https://discuss.elastic.co/u/ravivarmakola)\
**Replies:** 1\
**Last updated:** [July 10, 2020, 2:58pm UTC](https://discuss.elastic.co/t/nested-failed-to-find-nested-object-under-path-orders/237603 "2020-07-10T14:58:40Z")

</div>

I am getting "\[nested\] failed to find nested object under path" when searching on single index and field has "type": "nested" in mappings: PS: I am getting response, but exception is seen on elasticsearch console. If …

---

## [Elasticsearch Ingest Pipeline to Logstash](https://discuss.elastic.co/t/elasticsearch-ingest-pipeline-to-logstash/240700)

<div class="topic-metadata">

**Author:** [@BenB196](https://discuss.elastic.co/u/BenB196)\
**Replies:** 2\
**Last updated:** [July 10, 2020, 12:59pm UTC](https://discuss.elastic.co/t/elasticsearch-ingest-pipeline-to-logstash/240700 "2020-07-10T12:59:43Z")

</div>

Hi All, I have kind of a weird question. Does anyone know if it is possible to go from an Elasticsearch Ingest Pipeline to Logstash? The use case for this is that I want to use some of the pre-built Filebeat modules tha…

---

## [Elasticsearch does not score all matched docs?](https://discuss.elastic.co/t/elasticsearch-does-not-score-all-matched-docs/240281)

<div class="topic-metadata">

**Author:** [@kamils468](https://discuss.elastic.co/u/kamils468)\
**Replies:** 3\
**Last updated:** [July 10, 2020, 12:17pm UTC](https://discuss.elastic.co/t/elasticsearch-does-not-score-all-matched-docs/240281 "2020-07-10T12:17:48Z")

</div>

I have 500k docs in the index. The query I run is (with profile set to true): { "query": { "bool": { "should": \[ { "match" : { "name" : "Foo Bar" …

---

## [Root mapping definition has unsupported parameters when creating custom index](https://discuss.elastic.co/t/root-mapping-definition-has-unsupported-parameters-when-creating-custom-index/240690)

<div class="topic-metadata">

**Author:** [@vinci](https://discuss.elastic.co/u/vinci)\
**Replies:** 1\
**Last updated:** [July 10, 2020, 12:09pm UTC](https://discuss.elastic.co/t/root-mapping-definition-has-unsupported-parameters-when-creating-custom-index/240690 "2020-07-10T12:09:02Z")

</div>

Hello, I'm following an elasticsearch course on linux academy where the instruction creates a custom index in the dev tools of kibana. He's using version 6, but I'm using version 7, so I'm not sure if the problem is re…

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=863)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=865)
