# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=995

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 996

---

## [Elk highlight synonym problem](https://discuss.elastic.co/t/elk-highlight-synonym-problem/222399)

<div class="topic-metadata">

**Author:** [@Ye\_Zetao](https://discuss.elastic.co/u/Ye_Zetao)\
**Replies:** 0\
**Last updated:** [March 6, 2020, 3:04am UTC](https://discuss.elastic.co/t/elk-highlight-synonym-problem/222399 "2020-03-06T03:04:24Z")

</div>

Hi, I am using elasticsearch 6.x version and I have problem when gettiing highlight result with synonym. PUT /my\_test\_index/ { "settings": { "analysis": { "filter": { "native\_syno…

---

## [How to to change string to object when re-indexing?](https://discuss.elastic.co/t/how-to-to-change-string-to-object-when-re-indexing/222355)

<div class="topic-metadata">

**Author:** [@javadevmtl](https://discuss.elastic.co/u/javadevmtl)\
**Replies:** 1\
**Last updated:** [March 6, 2020, 2:54am UTC](https://discuss.elastic.co/t/how-to-to-change-string-to-object-when-re-indexing/222355 "2020-03-06T02:54:05Z")

</div>

Hi, using Elastic 6.4.2 I have a document like so... { "host": "foo.bar.com" } I would like to re-index it to... { "host": { "name": "foo.bar.com" } } I'm guessing I need to use re-index api with…

---

## [Reading elasticsearch data using spark SQL is too slow](https://discuss.elastic.co/t/reading-elasticsearch-data-using-spark-sql-is-too-slow/222393)

<div class="topic-metadata">

**Author:** [@hyungsun\_lim](https://discuss.elastic.co/u/hyungsun_lim)\
**Replies:** 0\
**Last updated:** [March 6, 2020, 2:24am UTC](https://discuss.elastic.co/t/reading-elasticsearch-data-using-spark-sql-is-too-slow/222393 "2020-03-06T02:24:24Z")

</div>

Hello, i have a question about spark - es. I write code like below # Initializing PySpark from pyspark import SparkContext, SparkConf, SQLContext # Spark Config conf = SparkConf().setAppName("es\_app") sc = SparkContex…

---

## [NodeJS client not respecting URL option](https://discuss.elastic.co/t/nodejs-client-not-respecting-url-option/222387)

<div class="topic-metadata">

**Author:** [@rbaindourov](https://discuss.elastic.co/u/rbaindourov)\
**Replies:** 0\
**Last updated:** [March 6, 2020, 12:05am UTC](https://discuss.elastic.co/t/nodejs-client-not-respecting-url-option/222387 "2020-03-06T00:05:07Z")

</div>

So I am instantiating the esclient with const esclient = new require('elasticsearch').Client({ node: "http://10.164.204.92:9200/" , sniffOnStart: false }); But when it decides to run, it's totally ignoring the setting …

---

## [Grouping similar results in aggs search](https://discuss.elastic.co/t/grouping-similar-results-in-aggs-search/222385)

<div class="topic-metadata">

**Author:** [@puks1978](https://discuss.elastic.co/u/puks1978)\
**Replies:** 0\
**Last updated:** [March 5, 2020, 11:53pm UTC](https://discuss.elastic.co/t/grouping-similar-results-in-aggs-search/222385 "2020-03-05T23:53:45Z")

</div>

Hi community, I am hoping someone can help. I have ES 7.5.2 running and indexed a whole bunch of documents. When a user performs a search I store this in another index so I can later recall the previous searches. This i…

---

## [Connectivity Issue with Curator taking on ElasticCloud in Windows 10](https://discuss.elastic.co/t/connectivity-issue-with-curator-taking-on-elasticcloud-in-windows-10/222378)

<div class="topic-metadata">

**Author:** [@bmbrit](https://discuss.elastic.co/u/bmbrit)\
**Replies:** 2\
**Last updated:** [March 5, 2020, 10:11pm UTC](https://discuss.elastic.co/t/connectivity-issue-with-curator-taking-on-elasticcloud-in-windows-10/222378 "2020-03-05T22:11:38Z")

</div>

Hi, We have the elk setup on Elastic Cloud and I have a requirement to delete the indices from a curator. The following code is the curator config: /\*--- client: hosts: \[ "asd321asdsa.ap-northeast-1.aws.found.io" \] …

---

## [How many scripts can be stored in elasticsearch?](https://discuss.elastic.co/t/how-many-scripts-can-be-stored-in-elasticsearch/222226)

<div class="topic-metadata">

**Author:** [@smogami](https://discuss.elastic.co/u/smogami)\
**Replies:** 1\
**Last updated:** [March 5, 2020, 7:30pm UTC](https://discuss.elastic.co/t/how-many-scripts-can-be-stored-in-elasticsearch/222226 "2020-03-05T19:30:15Z")

</div>

I would like to know how many scripts can be stored in single elasticsearch cluster. Is it limitless, or is there any hard limit ? I found the limit of script size, but could not find the limit of number of scripts. H…

---

## [Agregar documentos con python](https://discuss.elastic.co/t/agregar-documentos-con-python/222356)

<div class="topic-metadata">

**Author:** [@Oscar\_Benitez](https://discuss.elastic.co/u/Oscar_Benitez)\
**Replies:** 0\
**Last updated:** [March 5, 2020, 6:54pm UTC](https://discuss.elastic.co/t/agregar-documentos-con-python/222356 "2020-03-05T18:54:11Z")

</div>

buenas, mi pregunta es si se puede agregar documentos json usando un script de python, y como podria hacerlo ?

---

## [Inline script to loop through unknown field names](https://discuss.elastic.co/t/inline-script-to-loop-through-unknown-field-names/221915)

<div class="topic-metadata">

**Author:** [@marb](https://discuss.elastic.co/u/marb)\
**Replies:** 1\
**Last updated:** [March 5, 2020, 5:37pm UTC](https://discuss.elastic.co/t/inline-script-to-loop-through-unknown-field-names/221915 "2020-03-05T17:37:02Z")

</div>

Hi, I have in my document this construct "data": { "group\_randomId1": { "date1": "ISO8601", "date2": "ISO8601" }, "group\_randomId2": { "date1": "ISO8601", "date2": "ISO8601" }, "group\_randomIdN": { "date1": "…

---

## [Writes with offline primary and no replicas](https://discuss.elastic.co/t/writes-with-offline-primary-and-no-replicas/222346)

<div class="topic-metadata">

**Author:** [@reighnman](https://discuss.elastic.co/u/reighnman)\
**Replies:** 2\
**Last updated:** [March 5, 2020, 5:12pm UTC](https://discuss.elastic.co/t/writes-with-offline-primary-and-no-replicas/222346 "2020-03-05T17:12:39Z")

</div>

I had a ticket open with support on this but they could not explain what would happen so trying here. Single index, multiple primaries spread across multiple nodes, 0 replicas. Do writes continue if 1 of the primaries …

---

## [Signed CLA. Yet PR shows as not signed](https://discuss.elastic.co/t/signed-cla-yet-pr-shows-as-not-signed/221715)

<div class="topic-metadata">

**Author:** [@jibsonline](https://discuss.elastic.co/u/jibsonline)\
**Replies:** 14\
**Last updated:** [March 5, 2020, 5:02pm UTC](https://discuss.elastic.co/t/signed-cla-yet-pr-shows-as-not-signed/221715 "2020-03-05T17:02:06Z")

</div>

Hi, I was trying to raise a PR to fix a documentation issue. The PR didn't pass as I didn't sign the CLA. I signed the CLA and raise the PR again. It still shows the same. I didn't receive the copy also via mail. Is the…

---

## [Field "level" only returns Null in Watcher](https://discuss.elastic.co/t/field-level-only-returns-null-in-watcher/221704)

<div class="topic-metadata">

**Author:** [@EricJohnson](https://discuss.elastic.co/u/EricJohnson)\
**Replies:** 1\
**Last updated:** [March 5, 2020, 4:08pm UTC](https://discuss.elastic.co/t/field-level-only-returns-null-in-watcher/221704 "2020-03-05T16:08:26Z")

</div>

Greetings I'm trying to write a watcher to look at a string field called "level." If level is LOG, I need to alert on it. The watcher is running but the value appears to always be null. I've tried various things but …

---

## [I need to calculate diffrence of the same field with diffrent date but it's not working (elasticsearch , kibana)](https://discuss.elastic.co/t/i-need-to-calculate-diffrence-of-the-same-field-with-diffrent-date-but-its-not-working-elasticsearch-kibana/222334)

<div class="topic-metadata">

**Author:** [@samargh](https://discuss.elastic.co/u/samargh)\
**Replies:** 0\
**Last updated:** [March 5, 2020, 3:46pm UTC](https://discuss.elastic.co/t/i-need-to-calculate-diffrence-of-the-same-field-with-diffrent-date-but-its-not-working-elasticsearch-kibana/222334 "2020-03-05T15:46:54Z")

</div>

well i have the same field in 2 indexes , i managed to join them in 1 index , but the problem is that i need to calculate the diffrence between activation date in day1 and activation date in day2 (day2 - day 1 shows n…

---

## [Issue with getting data back when using Docker](https://discuss.elastic.co/t/issue-with-getting-data-back-when-using-docker/221949)

<div class="topic-metadata">

**Author:** [@Taiv13](https://discuss.elastic.co/u/Taiv13)\
**Replies:** 1\
**Last updated:** [March 5, 2020, 3:43pm UTC](https://discuss.elastic.co/t/issue-with-getting-data-back-when-using-docker/221949 "2020-03-05T15:43:21Z")

</div>

Hello, I have come across a problem where I am not getting any data back when I try to \_search an index. I previously followed along with this tutorial. Everything went fine when following along and using the online "…

---

## [RemoteTransportException caused by NullPointerException when trying to create snapshot through Kibana UI](https://discuss.elastic.co/t/remotetransportexception-caused-by-nullpointerexception-when-trying-to-create-snapshot-through-kibana-ui/222287)

<div class="topic-metadata">

**Author:** [@bcbrockway](https://discuss.elastic.co/u/bcbrockway)\
**Replies:** 1\
**Last updated:** [March 5, 2020, 3:28pm UTC](https://discuss.elastic.co/t/remotetransportexception-caused-by-nullpointerexception-when-trying-to-create-snapshot-through-kibana-ui/222287 "2020-03-05T15:28:08Z")

</div>

We're running an ES cluster using cloud-on-k8s and when I try and create a snapshot using the Kibana UI I get the following errors from elasticsearch and kibana: portal-elastic-es-main-0 elasticsearch {"type": "server",…

---

## [termFreq vs phraseFreq in Explanation](https://discuss.elastic.co/t/termfreq-vs-phrasefreq-in-explanation/222320)

<div class="topic-metadata">

**Author:** [@LJA](https://discuss.elastic.co/u/LJA)\
**Replies:** 0\
**Last updated:** [March 5, 2020, 2:43pm UTC](https://discuss.elastic.co/t/termfreq-vs-phrasefreq-in-explanation/222320 "2020-03-05T14:43:29Z")

</div>

Hi. According to https://www.elastic.co/guide/en/elasticsearch/guide/current/relevance-intro.html when I want to see an explanation of the score I can use "explain":true and I should se something like: "\_explanation": …

---

## [Support for multipolygon query](https://discuss.elastic.co/t/support-for-multipolygon-query/222316)

<div class="topic-metadata">

**Author:** [@tamil5ag](https://discuss.elastic.co/u/tamil5ag)\
**Replies:** 0\
**Last updated:** [March 5, 2020, 2:31pm UTC](https://discuss.elastic.co/t/support-for-multipolygon-query/222316 "2020-03-05T14:31:50Z")

</div>

Hi, I need to get the geo-coordinates under 2 different polygon(An array of separate polygons) whether need to use geo-polygon query or multipolygon query? Can you help with the example query which ever is supported E…

---

## [How to provide custom Java path without JAVA\_HOME or bundled JDK for service installation](https://discuss.elastic.co/t/how-to-provide-custom-java-path-without-java-home-or-bundled-jdk-for-service-installation/222309)

<div class="topic-metadata">

**Author:** [@antimatter](https://discuss.elastic.co/u/antimatter)\
**Replies:** 0\
**Last updated:** [March 5, 2020, 2:17pm UTC](https://discuss.elastic.co/t/how-to-provide-custom-java-path-without-java-home-or-bundled-jdk-for-service-installation/222309 "2020-03-05T14:17:29Z")

</div>

Hello, I could not find answers regarding my issue by searching. As far as I understand, Elasticsearch will look at JAVA\_HOME environment variable to get the location of the JVM. If JAVA\_HOME is not set, it will use th…

---

## [Incorrect Doc Count vs index total returns in ES](https://discuss.elastic.co/t/incorrect-doc-count-vs-index-total-returns-in-es/222182)

<div class="topic-metadata">

**Author:** [@Wayne\_Taylor](https://discuss.elastic.co/u/Wayne_Taylor)\
**Replies:** 4\
**Last updated:** [March 5, 2020, 2:13pm UTC](https://discuss.elastic.co/t/incorrect-doc-count-vs-index-total-returns-in-es/222182 "2020-03-05T14:13:59Z")

</div>

Hi team, Using ES 7.1.1 and noticing a weird count of documents shown in Kibana vs the reporting totals from ES APIs and Elastic HQ. Specifically, I have an index pattern created daily for Jaeger spans. This is showing…

---

## [Index not getting created in elasticsearch hot node](https://discuss.elastic.co/t/index-not-getting-created-in-elasticsearch-hot-node/222281)

<div class="topic-metadata">

**Author:** [@Vishnu\_mk](https://discuss.elastic.co/u/Vishnu_mk)\
**Replies:** 4\
**Last updated:** [March 5, 2020, 1:49pm UTC](https://discuss.elastic.co/t/index-not-getting-created-in-elasticsearch-hot-node/222281 "2020-03-05T13:49:14Z")

</div>

Below is the elasticsearch output plugin in logstash output { elasticsearch { hosts =\> \["https://10.5.36.5:9200"\] index =\> "test-axiom" # ilm\_r…

---

## [Problems with terminateAfter Java API](https://discuss.elastic.co/t/problems-with-terminateafter-java-api/222288)

<div class="topic-metadata">

**Author:** [@marlonfa](https://discuss.elastic.co/u/marlonfa)\
**Replies:** 0\
**Last updated:** [March 5, 2020, 12:41pm UTC](https://discuss.elastic.co/t/problems-with-terminateafter-java-api/222288 "2020-03-05T12:41:47Z")

</div>

Hello guys, I'm using the java API with RestHighLevelClient currently I have more than 100.000 documents and using the scroll I'm getting the results perfectly applying a date order, returning this way: 154238, 154237, 1…

---

## [Ingest array of JSON objects](https://discuss.elastic.co/t/ingest-array-of-json-objects/222216)

<div class="topic-metadata">

**Author:** [@abregman](https://discuss.elastic.co/u/abregman)\
**Replies:** 4\
**Last updated:** [March 5, 2020, 12:35pm UTC](https://discuss.elastic.co/t/ingest-array-of-json-objects/222216 "2020-03-05T12:35:20Z")

</div>

Is it possible to import into elasticsearch an array of JSON objects? Something like this: \[{'a': 1}, {'b': 2}, ...\] Right now I get this error when trying to do so: "Malformed action/metadata line \[1\], expected START\_…

---

## [\_source.excludes/includes makes query 2 times slower](https://discuss.elastic.co/t/source-excludes-includes-makes-query-2-times-slower/222227)

<div class="topic-metadata">

**Author:** [@backend](https://discuss.elastic.co/u/backend)\
**Replies:** 2\
**Last updated:** [March 5, 2020, 11:46am UTC](https://discuss.elastic.co/t/source-excludes-includes-makes-query-2-times-slower/222227 "2020-03-05T11:46:29Z")

</div>

ES: 7.4.1 I have a tiny little index (~100MB). The mapping is simple and naive - with no nested objects whatsoever. There's one field (an array of objects) which is kind of big, and sometimes I'd like to exclude that fr…

---

## [Elastic best practise - architecture](https://discuss.elastic.co/t/elastic-best-practise-architecture/222269)

<div class="topic-metadata">

**Author:** [@carmine.fabrizio](https://discuss.elastic.co/u/carmine.fabrizio)\
**Replies:** 0\
**Last updated:** [March 5, 2020, 11:12am UTC](https://discuss.elastic.co/t/elastic-best-practise-architecture/222269 "2020-03-05T11:12:28Z")

</div>

Hi everyone, need to understand what is the best configuration to implement, like number of nodes lifecycle policies timing shards I have more or less 15 indexes and an average between 300GB each per day, totally I h…

---

## [Huge Performance impact when indexing large payloads](https://discuss.elastic.co/t/huge-performance-impact-when-indexing-large-payloads/222205)

<div class="topic-metadata">

**Author:** [@sreekanth](https://discuss.elastic.co/u/sreekanth)\
**Replies:** 7\
**Last updated:** [March 5, 2020, 11:00am UTC](https://discuss.elastic.co/t/huge-performance-impact-when-indexing-large-payloads/222205 "2020-03-05T11:00:41Z")

</div>

We are doing few performance run to measure the product performance. We were trying ~100 single ingests/sec and ~300 search/sec. the data we are ingesting is of size ~1KB (i mean a record size which we insert). Every thi…

---

## [S3 Repository plugin PKIX failed](https://discuss.elastic.co/t/s3-repository-plugin-pkix-failed/222183)

<div class="topic-metadata">

**Author:** [@ivanavi](https://discuss.elastic.co/u/ivanavi)\
**Replies:** 1\
**Last updated:** [March 5, 2020, 10:59am UTC](https://discuss.elastic.co/t/s3-repository-plugin-pkix-failed/222183 "2020-03-05T10:59:36Z")

</div>

Hi all, I have 1 cluster (Ubuntu 18.04) with 3 ES 7.4.2 nodes with Offline install 7.4.2 S3 Repository plugin. I installed plugin than I did restart of every node. I added keys on every node and did restart bin/elast…

---

## [In which elastic stack version the watcher is introduced?](https://discuss.elastic.co/t/in-which-elastic-stack-version-the-watcher-is-introduced/222267)

<div class="topic-metadata">

**Author:** [@Pradeep\_Sanjeewa](https://discuss.elastic.co/u/Pradeep_Sanjeewa)\
**Replies:** 1\
**Last updated:** [March 5, 2020, 10:53am UTC](https://discuss.elastic.co/t/in-which-elastic-stack-version-the-watcher-is-introduced/222267 "2020-03-05T10:53:31Z")

</div>

I have Elastic stack (6.8.0) free version. But I cannot use watcher features there as mentioned in the following link. https://www.elastic.co/guide/en/kibana/7.6/watcher-ui.html Simply I don't have a section " Manageme…

---

## [Snapshot backup](https://discuss.elastic.co/t/snapshot-backup/218775)

<div class="topic-metadata">

**Author:** [@vijay\_kaali](https://discuss.elastic.co/u/vijay_kaali)\
**Replies:** 6\
**Last updated:** [March 5, 2020, 10:46am UTC](https://discuss.elastic.co/t/snapshot-backup/218775 "2020-03-05T10:46:37Z")

</div>

is there any option to backup elasticsearch direct to tape as shared file system will require equal to all index size ?

---

## [How to convert binary field's value to string with Painless?](https://discuss.elastic.co/t/how-to-convert-binary-fields-value-to-string-with-painless/222262)

<div class="topic-metadata">

**Author:** [@michalak](https://discuss.elastic.co/u/michalak)\
**Replies:** 0\
**Last updated:** [March 5, 2020, 10:14am UTC](https://discuss.elastic.co/t/how-to-convert-binary-fields-value-to-string-with-painless/222262 "2020-03-05T10:14:20Z")

</div>

I have a binary field, the values are JSON strings, just stored as bytes. I need to look inside and query for specific substring. The values as you query them are base64 strings, so I thought I'd decode them, make string…

---

## [Update vs Index](https://discuss.elastic.co/t/update-vs-index/222243)

<div class="topic-metadata">

**Author:** [@Samyak\_Jain](https://discuss.elastic.co/u/Samyak_Jain)\
**Replies:** 1\
**Last updated:** [March 5, 2020, 9:33am UTC](https://discuss.elastic.co/t/update-vs-index/222243 "2020-03-05T09:33:12Z")

</div>

Hi, I wanted to know that what is the performance difference between using update api and Index api. Currently in our existing implementation we fetch the document from elasticsearch and update the fields using Reflecti…

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=994)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=996)
