# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1931

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1932

---

## [Possible to combine/flatten arrays using Painless?](https://discuss.elastic.co/t/possible-to-combine-flatten-arrays-using-painless/102494)

<div class="topic-metadata">

**Author:** [@loren](https://discuss.elastic.co/u/loren)\
**Replies:** 3\
**Last updated:** [October 4, 2017, 2:31pm UTC](https://discuss.elastic.co/t/possible-to-combine-flatten-arrays-using-painless/102494 "2017-10-04T14:31:31Z")

</div>

Is it possible to flatten an array using Painless? I'm essentially looking for this Groovy flatten method in Painless.

---

## [Java High Level REST Client: result casting](https://discuss.elastic.co/t/java-high-level-rest-client-result-casting/98960)

<div class="topic-metadata">

**Author:** [@sqshq](https://discuss.elastic.co/u/sqshq)\
**Replies:** 2\
**Last updated:** [October 4, 2017, 2:29pm UTC](https://discuss.elastic.co/t/java-high-level-rest-client-result-casting/98960 "2017-10-04T14:29:17Z")

</div>

Hi, I’m looking into Java High Level REST Client API and as far as I can see, there is to convinent ways to retrieve search result entity As json string: getSourceAsString() As map: getSourceAsMap() However in Jest…

---

## [Machine learning \_getting alert while creating a new job](https://discuss.elastic.co/t/machine-learning-getting-alert-while-creating-a-new-job/102665)

<div class="topic-metadata">

**Author:** [@Raj\_Kumar](https://discuss.elastic.co/u/Raj_Kumar)\
**Replies:** 3\
**Last updated:** [October 4, 2017, 2:00pm UTC](https://discuss.elastic.co/t/machine-learning-getting-alert-while-creating-a-new-job/102665 "2017-10-04T14:00:18Z")

</div>

Hi All, Iam trying to create a job and am getting this message,am not sure why am getting this message \[image\] Please let me know what should I do this. Thanks, Raj

---

## [Is it possible to send the data to multiple indices using Ingest Pipeline?](https://discuss.elastic.co/t/is-it-possible-to-send-the-data-to-multiple-indices-using-ingest-pipeline/102670)

<div class="topic-metadata">

**Author:** [@RohanKumbhar](https://discuss.elastic.co/u/RohanKumbhar)\
**Replies:** 1\
**Last updated:** [October 4, 2017, 1:59pm UTC](https://discuss.elastic.co/t/is-it-possible-to-send-the-data-to-multiple-indices-using-ingest-pipeline/102670 "2017-10-04T13:59:50Z")

</div>

Hello Team, I'm using only filebeat--\>ingest pipeline--\>elasticsearch Is it possible to send the data to multiple indices using Ingest Pipeline? (just like using multiple elasticsearch output plugin in logstash) Thank…

---

## [Cluster Checkup errors](https://discuss.elastic.co/t/cluster-checkup-errors/101159)

<div class="topic-metadata">

**Author:** [@cutch69](https://discuss.elastic.co/u/cutch69)\
**Replies:** 2\
**Last updated:** [October 4, 2017, 1:22pm UTC](https://discuss.elastic.co/t/cluster-checkup-errors/101159 "2017-10-04T13:22:04Z")

</div>

I just upgraded to 5.6.1 and ran the cluster update. i ran into this error but when checking my nodes they are using the the new path method as described. Another thing i notice when my master node changes to a new nod…

---

## [HDFS snapshot java access denied](https://discuss.elastic.co/t/hdfs-snapshot-java-access-denied/100397)

<div class="topic-metadata">

**Author:** [@tarp](https://discuss.elastic.co/u/tarp)\
**Replies:** 3\
**Last updated:** [October 4, 2017, 1:19pm UTC](https://discuss.elastic.co/t/hdfs-snapshot-java-access-denied/100397 "2017-10-04T13:19:40Z")

</div>

Hi, I'm trying to setup HDFS as a snapshot respository. I'm able to create the repo. But upon creating the first snapshot, I'm getting these errors. "shards": { "0": { "stage": "FAILURE", "stats": { "number\_of\_fi…

---

## [Aggregate request, need help](https://discuss.elastic.co/t/aggregate-request-need-help/102615)

<div class="topic-metadata">

**Author:** [@Mher\_Arsh](https://discuss.elastic.co/u/Mher_Arsh)\
**Replies:** 0\
**Last updated:** [October 3, 2017, 9:00pm UTC](https://discuss.elastic.co/t/aggregate-request-need-help/102615 "2017-10-03T21:00:43Z")

</div>

How I make Order by analog in elastic by multy fildes. Thanks.

---

## [Excel File with SSIS](https://discuss.elastic.co/t/excel-file-with-ssis/102379)

<div class="topic-metadata">

**Author:** [@stim2981](https://discuss.elastic.co/u/stim2981)\
**Replies:** 4\
**Last updated:** [October 4, 2017, 12:25pm UTC](https://discuss.elastic.co/t/excel-file-with-ssis/102379 "2017-10-04T12:25:50Z")

</div>

I am trying to import data from excel file(2007/.XLSX ) into SQL Server using SSIS. But I failed to do this so I request to experts please guide me what is the procedure for doing this.From START TO END Thank a lot in …

---

## [Calling elastic-search url from react using axios](https://discuss.elastic.co/t/calling-elastic-search-url-from-react-using-axios/102680)

<div class="topic-metadata">

**Author:** [@hamza\_moummid](https://discuss.elastic.co/u/hamza_moummid)\
**Replies:** 0\
**Last updated:** [October 4, 2017, 10:28am UTC](https://discuss.elastic.co/t/calling-elastic-search-url-from-react-using-axios/102680 "2017-10-04T10:28:33Z")

</div>

I have an Elasticsearch Node running and I can successfully recieve a Json response from the url: localhost:8882/rest/search/all using chrome. However when I call it from react like this: var config = { headers: {'Acc…

---

## [ES 5.X - Primary and replica shards not in sync](https://discuss.elastic.co/t/es-5-x-primary-and-replica-shards-not-in-sync/101561)

<div class="topic-metadata">

**Author:** [@dimalini](https://discuss.elastic.co/u/dimalini)\
**Replies:** 7\
**Last updated:** [October 4, 2017, 10:17am UTC](https://discuss.elastic.co/t/es-5-x-primary-and-replica-shards-not-in-sync/101561 "2017-10-04T10:17:19Z")

</div>

Hi, Recently we upgraded our Production clusters to ES 5.x We are observing in several cases where the number of documents in primary and secondary are out of sync. Especially, primary shards in this case had lesser do…

---

## [How do I find these anomalies?](https://discuss.elastic.co/t/how-do-i-find-these-anomalies/102167)

<div class="topic-metadata">

**Author:** [@Badger](https://discuss.elastic.co/u/Badger)\
**Replies:** 7\
**Last updated:** [October 4, 2017, 9:46am UTC](https://discuss.elastic.co/t/how-do-i-find-these-anomalies/102167 "2017-10-04T09:46:59Z")

</div>

I have an index that contains the response time of a web service. I am unable to build an ML job that finds the anomalies I am interested in. The service slowed down. Actually it slows down quite often, so when I try to …

---

## [After upgrading 2.4.2.2 to 2.4.2.3 15% shards are unassigned](https://discuss.elastic.co/t/after-upgrading-2-4-2-2-to-2-4-2-3-15-shards-are-unassigned/102671)

<div class="topic-metadata">

**Author:** [@ghanshyam](https://discuss.elastic.co/u/ghanshyam)\
**Replies:** 0\
**Last updated:** [October 4, 2017, 9:43am UTC](https://discuss.elastic.co/t/after-upgrading-2-4-2-2-to-2-4-2-3-15-shards-are-unassigned/102671 "2017-10-04T09:43:55Z")

</div>

After I upgrade 405 shards are assigned: GET \_cluster/health?pretty' { "cluster\_name": "es-WLN-TypeAhead-Lab", "status": "red", "timed\_out": false, "number\_of\_nodes": 13, "number\_of\_data\_nodes": 10, "active\_prima…

---

## [Reindex vs Snapshot and restore](https://discuss.elastic.co/t/reindex-vs-snapshot-and-restore/102653)

<div class="topic-metadata">

**Author:** [@vivek7mehta](https://discuss.elastic.co/u/vivek7mehta)\
**Replies:** 2\
**Last updated:** [October 4, 2017, 9:08am UTC](https://discuss.elastic.co/t/reindex-vs-snapshot-and-restore/102653 "2017-10-04T09:08:39Z")

</div>

I have around 500 GB of data on one cluster and I want to migrate all of my data from this cluster to another cluster which is hosted on different server. So I can think of two options either snapshot and restore \[crea…

---

## [Request cache, hit\_count and miss\_count](https://discuss.elastic.co/t/request-cache-hit-count-and-miss-count/102667)

<div class="topic-metadata">

**Author:** [@Abhilash\_Bolla](https://discuss.elastic.co/u/Abhilash_Bolla)\
**Replies:** 0\
**Last updated:** [October 4, 2017, 9:05am UTC](https://discuss.elastic.co/t/request-cache-hit-count-and-miss-count/102667 "2017-10-04T09:05:01Z")

</div>

When I fired curl 'localhost:9200/\_stats/request\_cache?pretty&human', I get this response "publications\_v1": { "primaries": { "request\_cache": { "memory\_size\_in\_bytes": 59235358, "evic…

---

## [ML with elasticsearch 5.5.2](https://discuss.elastic.co/t/ml-with-elasticsearch-5-5-2/100866)

<div class="topic-metadata">

**Author:** [@Sarah](https://discuss.elastic.co/u/Sarah)\
**Replies:** 4\
**Last updated:** [October 4, 2017, 8:24am UTC](https://discuss.elastic.co/t/ml-with-elasticsearch-5-5-2/100866 "2017-10-04T08:24:30Z")

</div>

Hi, We are trying to install x-pack for versions 5.5.1, 5.5.2 and 5.6.0 of Elasticsearch. But the same problem occurred: org.elasticsearch.bootstrap.StartupException: ElasticsearchException\[Failed to create native pro…

---

## [Failed to create native process factories for Machine Learning](https://discuss.elastic.co/t/failed-to-create-native-process-factories-for-machine-learning/98798)

<div class="topic-metadata">

**Author:** [@tempname](https://discuss.elastic.co/u/tempname)\
**Replies:** 7\
**Last updated:** [October 4, 2017, 8:24am UTC](https://discuss.elastic.co/t/failed-to-create-native-process-factories-for-machine-learning/98798 "2017-10-04T08:24:24Z")

</div>

Windows 10 x64, elastic search 5.5.2, kibana 5.5.2, java 1.8u144 what is this error? i want to use the machine learning feature... this is my log \[log\]

---

## [Java API - Passing a List of Query for a prepared Search](https://discuss.elastic.co/t/java-api-passing-a-list-of-query-for-a-prepared-search/102659)

<div class="topic-metadata">

**Author:** [@kgl](https://discuss.elastic.co/u/kgl)\
**Replies:** 0\
**Last updated:** [October 4, 2017, 8:19am UTC](https://discuss.elastic.co/t/java-api-passing-a-list-of-query-for-a-prepared-search/102659 "2017-10-04T08:19:32Z")

</div>

Hey there! I would like to write a function in Java to pass the index along with the desired queries. What I had in mind was the following: public SearchResponse fetchResultSetForIndex(String index, List\<AbstractQuery…

---

## [Using multiple shards causes incorrect results to be generated](https://discuss.elastic.co/t/using-multiple-shards-causes-incorrect-results-to-be-generated/101895)

<div class="topic-metadata">

**Author:** [@pranav0091](https://discuss.elastic.co/u/pranav0091)\
**Replies:** 3\
**Last updated:** [October 4, 2017, 7:43am UTC](https://discuss.elastic.co/t/using-multiple-shards-causes-incorrect-results-to-be-generated/101895 "2017-10-04T07:43:02Z")

</div>

Reference: \[BUG?\] Wrong aggregated values shown in visualization Currently the aggregate data returned from ES is un-reliable when plotting a few terms on the X axis and having multiple shards Lee pointed out (and I ve…

---

## [Schema error: extra keys not allowed @ data\['actions'\]](https://discuss.elastic.co/t/schema-error-extra-keys-not-allowed-data-actions/102583)

<div class="topic-metadata">

**Author:** [@wgnc](https://discuss.elastic.co/u/wgnc)\
**Replies:** 1\
**Last updated:** [October 4, 2017, 7:37am UTC](https://discuss.elastic.co/t/schema-error-extra-keys-not-allowed-data-actions/102583 "2017-10-04T07:37:03Z")

</div>

Hello, I have problem with basic curator configuration. I'm trying to run delete\_indices example: with no success. I run exactly the same code from example mentioned above (saved in .curator/curator.yml) $ curator…

---

## [Regarding Unexplained Index Growth](https://discuss.elastic.co/t/regarding-unexplained-index-growth/102530)

<div class="topic-metadata">

**Author:** [@dawiro](https://discuss.elastic.co/u/dawiro)\
**Replies:** 5\
**Last updated:** [October 4, 2017, 7:02am UTC](https://discuss.elastic.co/t/regarding-unexplained-index-growth/102530 "2017-10-04T07:02:45Z")

</div>

Hi, I have a week old log index which is growing in size while the document count remains the same. Can someone explain how this can be? Regards, D

---

## [Elasticsearch upgrade 1.x to 2.x mapping error](https://discuss.elastic.co/t/elasticsearch-upgrade-1-x-to-2-x-mapping-error/102652)

<div class="topic-metadata">

**Author:** [@HilalB](https://discuss.elastic.co/u/HilalB)\
**Replies:** 1\
**Last updated:** [October 4, 2017, 6:59am UTC](https://discuss.elastic.co/t/elasticsearch-upgrade-1-x-to-2-x-mapping-error/102652 "2017-10-04T06:59:46Z")

</div>

I have indices that have "name.exact" or "album.album". I want to ugrade 1.7 to 2.4. I took snapsot and when I restore it : unable to upgrade the mappings for the index \[metadatav4\], reason: \[Field name \[album.album\] can…

---

## [Xpack price](https://discuss.elastic.co/t/xpack-price/102645)

<div class="topic-metadata">

**Author:** [@seighalani](https://discuss.elastic.co/u/seighalani)\
**Replies:** 2\
**Last updated:** [October 4, 2017, 6:33am UTC](https://discuss.elastic.co/t/xpack-price/102645 "2017-10-04T06:33:04Z")

</div>

hi everyone i want to buy xpack for my company. but there isnt any price list in elastic.co website. would you guide me?thanks inadvance

---

## [Upgrading to ES5 and Java TransporClient](https://discuss.elastic.co/t/upgrading-to-es5-and-java-transporclient/102463)

<div class="topic-metadata">

**Author:** [@ibailak1](https://discuss.elastic.co/u/ibailak1)\
**Replies:** 7\
**Last updated:** [October 4, 2017, 5:57am UTC](https://discuss.elastic.co/t/upgrading-to-es5-and-java-transporclient/102463 "2017-10-04T05:57:56Z")

</div>

Hi, I had a cluster in ES2 for a while, now finally we are ready to upgrade it to ES5 but I have some concerns, many applications are querying this cluster using the Java Client all the time, since many applications rel…

---

## [Problems with displaying data](https://discuss.elastic.co/t/problems-with-displaying-data/102374)

<div class="topic-metadata">

**Author:** [@BarakFreiman](https://discuss.elastic.co/u/BarakFreiman)\
**Replies:** 1\
**Last updated:** [October 4, 2017, 3:48am UTC](https://discuss.elastic.co/t/problems-with-displaying-data/102374 "2017-10-04T03:48:04Z")

</div>

After writing to elasticsearch using the elasticsearch-hadoop plugin the data can’t be displayed in kibana and the following errors persist: “Saved field parameter is now invalid. Please select a new field” “Discover: …

---

## [ElasticSearch Hadoop Repository issue](https://discuss.elastic.co/t/elasticsearch-hadoop-repository-issue/98505)

<div class="topic-metadata">

**Author:** [@karthiga\_sivaraman](https://discuss.elastic.co/u/karthiga_sivaraman)\
**Replies:** 3\
**Last updated:** [October 4, 2017, 3:40am UTC](https://discuss.elastic.co/t/elasticsearch-hadoop-repository-issue/98505 "2017-10-04T03:40:15Z")

</div>

In out production environment we are having Cloudera distributed Hadoop version 2.6.0-cdh5.11.0 and our Elastic search version is 2.4.1. If I install repository-hdfs plugin , I’m getting hadoop-2.7.1 And it ends in h…

---

## [Hive - es.update.script property value more than 4000 Chars](https://discuss.elastic.co/t/hive-es-update-script-property-value-more-than-4000-chars/101240)

<div class="topic-metadata">

**Author:** [@sachinjose](https://discuss.elastic.co/u/sachinjose)\
**Replies:** 1\
**Last updated:** [October 4, 2017, 3:32am UTC](https://discuss.elastic.co/t/hive-es-update-script-property-value-more-than-4000-chars/101240 "2017-10-04T03:32:11Z")

</div>

In one of the use cases, Length of Hive TBLPROPERTIES - es.update.script property value is more than 4000 characters, so hive query is failing with the below error message in the initial table creation step. As a workar…

---

## [Elastic Cluster](https://discuss.elastic.co/t/elastic-cluster/101774)

<div class="topic-metadata">

**Author:** [@Natalia\_Queiroz](https://discuss.elastic.co/u/Natalia_Queiroz)\
**Replies:** 3\
**Last updated:** [September 26, 2017, 6:34am UTC](https://discuss.elastic.co/t/elastic-cluster/101774 "2017-09-26T06:34:34Z")

</div>

Hi group, I have the follow cenario: 1 node master, 2 data nodes and 1 client node (kibana+logstash) and a few questions. Regarding the elasticsearch.yml configuration, should I need to configure an initial list of nod…

---

## [Spark EsRDDWriter intermittent failure](https://discuss.elastic.co/t/spark-esrddwriter-intermittent-failure/100581)

<div class="topic-metadata">

**Author:** [@Anusha\_Dharmalingam](https://discuss.elastic.co/u/Anusha_Dharmalingam)\
**Replies:** 1\
**Last updated:** [October 4, 2017, 3:28am UTC](https://discuss.elastic.co/t/spark-esrddwriter-intermittent-failure/100581 "2017-10-04T03:28:47Z")

</div>

Hi, Seeing intermittent errors trying to write to Elasticsearch 5.3 based cluster using Spark EsRDDWriter (which internally uses elasticsearch-hadoop project 5.2.2) Is there any way to configure client.transport.ping\_t…

---

## [Composite key for creating elastic search Index](https://discuss.elastic.co/t/composite-key-for-creating-elastic-search-index/100221)

<div class="topic-metadata">

**Author:** [@Sachin111us](https://discuss.elastic.co/u/Sachin111us)\
**Replies:** 1\
**Last updated:** [October 4, 2017, 3:23am UTC](https://discuss.elastic.co/t/composite-key-for-creating-elastic-search-index/100221 "2017-10-04T03:23:56Z")

</div>

Hi, I am working on HDFS to Elastic search integration via SparkSQL. I could able to read the csv data from HDFS and create the elastic search index. To create Elastic search Index ID I am using one of the unique column…

---

## [Pyspark es.query not working. only default "match\_all" works](https://discuss.elastic.co/t/pyspark-es-query-not-working-only-default-match-all-works/100408)

<div class="topic-metadata">

**Author:** [@buster](https://discuss.elastic.co/u/buster)\
**Replies:** 1\
**Last updated:** [October 4, 2017, 3:21am UTC](https://discuss.elastic.co/t/pyspark-es-query-not-working-only-default-match-all-works/100408 "2017-10-04T03:21:46Z")

</div>

In pypspark the only way I can get data returned from ES is by leaving es.query default. Why is this? es\_query = {"match" : {"key" : "value"}} es\_conf = {"es.nodes" : "localhost", "es.resource" : "index/type", "es.que…

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1930)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1932)
