# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1823

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1824

---

## [The current index was generated by Lucene 7 while one of the directories contains an index that was generated with Lucene 6](https://discuss.elastic.co/t/the-current-index-was-generated-by-lucene-7-while-one-of-the-directories-contains-an-index-that-was-generated-with-lucene-6/115142)

<div class="topic-metadata">

**Author:** [@kabali12345](https://discuss.elastic.co/u/kabali12345)\
**Replies:** 5\
**Last updated:** [January 18, 2018, 6:32pm UTC](https://discuss.elastic.co/t/the-current-index-was-generated-by-lucene-7-while-one-of-the-directories-contains-an-index-that-was-generated-with-lucene-6/115142 "2018-01-18T18:32:07Z")

</div>

Hi all.... i have updated my ES cluster from 5.4 to 6.0.0 version recently, Now i am trying to shrink the index with curator scripts but i am getting following error \[2018-01-10T20:26:13,358\]\[INFO \]\[o.e.c.m.MetaDataC…

---

## [Create snapshot repository without making the API request](https://discuss.elastic.co/t/create-snapshot-repository-without-making-the-api-request/116111)

<div class="topic-metadata">

**Author:** [@xortiz](https://discuss.elastic.co/u/xortiz)\
**Replies:** 1\
**Last updated:** [January 18, 2018, 6:13pm UTC](https://discuss.elastic.co/t/create-snapshot-repository-without-making-the-api-request/116111 "2018-01-18T18:13:15Z")

</div>

Hi, I would like to know if there's any other way to create a snapshot s3 repository besides making the PUT \_snapshot/my\_s3\_repository request. Maybe some config file? The reason I want to know this is because when I s…

---

## [Is there a way to specify \_routing=all or similar for GET requests](https://discuss.elastic.co/t/is-there-a-way-to-specify-routing-all-or-similar-for-get-requests/115439)

<div class="topic-metadata">

**Author:** [@yehosef](https://discuss.elastic.co/u/yehosef)\
**Replies:** 5\
**Last updated:** [January 18, 2018, 5:13pm UTC](https://discuss.elastic.co/t/is-there-a-way-to-specify-routing-all-or-similar-for-get-requests/115439 "2018-01-18T17:13:58Z")

</div>

I opened an issue about this at https://github.com/elastic/elasticsearch/issues/28120 but I haven't heard anything. Basically I know when accessing the documents I can specific a \_routing param and I know that I can spe…

---

## [High-level rest client ElasticsearchStatusException instead of VersionConflictEngineException](https://discuss.elastic.co/t/high-level-rest-client-elasticsearchstatusexception-instead-of-versionconflictengineexception/115871)

<div class="topic-metadata">

**Author:** [@vaughnd](https://discuss.elastic.co/u/vaughnd)\
**Replies:** 1\
**Last updated:** [January 18, 2018, 5:02pm UTC](https://discuss.elastic.co/t/high-level-rest-client-elasticsearchstatusexception-instead-of-versionconflictengineexception/115871 "2018-01-18T17:02:14Z")

</div>

Hi, I used to catch DocumentAlreadyExistsException from the java TransportClient, but I'm busy migrating to ES 6 and the docs say it's now VersionConflictEngineException. My problem is that I only get ElasticsearchStatu…

---

## [Kibana graphing average of nested data](https://discuss.elastic.co/t/kibana-graphing-average-of-nested-data/115944)

<div class="topic-metadata">

**Author:** [@David\_Tomasheski](https://discuss.elastic.co/u/David_Tomasheski)\
**Replies:** 1\
**Last updated:** [January 18, 2018, 4:52pm UTC](https://discuss.elastic.co/t/kibana-graphing-average-of-nested-data/115944 "2018-01-18T16:52:09Z")

</div>

So i have timestamped data coming in with some nested data attached to it. which looks like this: sessionID: 1 timestamp 01/17/2018 12:00:00 tests(nested data type): { testid: 1 result: 75 } { testId: 2 result:…

---

## [Cross Account (AWS) cluster](https://discuss.elastic.co/t/cross-account-aws-cluster/115890)

<div class="topic-metadata">

**Author:** [@chaib](https://discuss.elastic.co/u/chaib)\
**Replies:** 1\
**Last updated:** [January 18, 2018, 4:32pm UTC](https://discuss.elastic.co/t/cross-account-aws-cluster/115890 "2018-01-18T16:32:24Z")

</div>

Is it possible to have an ES cluster with nodes in two different accounts (AWS)? Scenario: Account A with VPC peering to Account B. Account B nodes find master in Account A but return a message that failed to send a r…

---

## [Configuring a cluster for a large number of indexes](https://discuss.elastic.co/t/configuring-a-cluster-for-a-large-number-of-indexes/115731)

<div class="topic-metadata">

**Author:** [@Aharon\_Levine](https://discuss.elastic.co/u/Aharon_Levine)\
**Replies:** 8\
**Last updated:** [January 18, 2018, 4:32pm UTC](https://discuss.elastic.co/t/configuring-a-cluster-for-a-large-number-of-indexes/115731 "2018-01-18T16:32:15Z")

</div>

We're running an ES cluster which keeps daily indexes per customer for a 1 year period. Seeing that we have around 100 customers and replica shards enabled this puts us in the ballpark of 50k shards. The behavior we're …

---

## [Pre-compute aggregate metrics](https://discuss.elastic.co/t/pre-compute-aggregate-metrics/116100)

<div class="topic-metadata">

**Author:** [@akshayb](https://discuss.elastic.co/u/akshayb)\
**Replies:** 0\
**Last updated:** [January 18, 2018, 4:18pm UTC](https://discuss.elastic.co/t/pre-compute-aggregate-metrics/116100 "2018-01-18T16:18:06Z")

</div>

Hi, I have documents representing orders with following format: { time: Date seller: String product : String price : Double }. These documents are generated all along the day. I have to create monthly reports sho…

---

## [Cross cluster search comprehension](https://discuss.elastic.co/t/cross-cluster-search-comprehension/115959)

<div class="topic-metadata">

**Author:** [@Arnaud\_Gaillard](https://discuss.elastic.co/u/Arnaud_Gaillard)\
**Replies:** 2\
**Last updated:** [January 18, 2018, 3:55pm UTC](https://discuss.elastic.co/t/cross-cluster-search-comprehension/115959 "2018-01-18T15:55:24Z")

</div>

Hello everyone, I have been using Elasticsearch for a few months now, but I am only now embracing more and more of its features. One feature in particular, "Cross Cluster Search", is causing me some troubles. I am tryi…

---

## [Count of docs after \_reindex'ing higher than before](https://discuss.elastic.co/t/count-of-docs-after-reindexing-higher-than-before/116015)

<div class="topic-metadata">

**Author:** [@Kornelia\_Watson](https://discuss.elastic.co/u/Kornelia_Watson)\
**Replies:** 40\
**Last updated:** [January 18, 2018, 3:20pm UTC](https://discuss.elastic.co/t/count-of-docs-after-reindexing-higher-than-before/116015 "2018-01-18T15:20:07Z")

</div>

Hello, I've recently had to reindex all docs due multi type mappings being deprecated. There is one observation that I can't explain... After reindexing (via \_reindex API) I found that new index has more documents tha…

---

## [Is reindex'ing to a pipeline broken between 6.0 & 6.1?](https://discuss.elastic.co/t/is-reindexing-to-a-pipeline-broken-between-6-0-6-1/116080)

<div class="topic-metadata">

**Author:** [@Dan\_Gardner](https://discuss.elastic.co/u/Dan_Gardner)\
**Replies:** 1\
**Last updated:** [January 18, 2018, 3:19pm UTC](https://discuss.elastic.co/t/is-reindexing-to-a-pipeline-broken-between-6-0-6-1/116080 "2018-01-18T15:19:13Z")

</div>

We may be overlooking something here, but are running out of avenues of investigation. In 6.0 we could reindex to a pipeline whereby the pipeline dynamically routed the docs to a number of different indexes. The defi…

---

## [\_msearch capability](https://discuss.elastic.co/t/msearch-capability/110702)

<div class="topic-metadata">

**Author:** [@AndyDev2017](https://discuss.elastic.co/u/AndyDev2017)\
**Replies:** 13\
**Last updated:** [January 18, 2018, 2:20pm UTC](https://discuss.elastic.co/t/msearch-capability/110702 "2018-01-18T14:20:29Z")

</div>

I would like to know if /\_msearch operation will be supported in the near future or is available in the latest release? I have already implemented a custom parameter source using random terms from a file for queries usi…

---

## [Keeping track of index contents over time](https://discuss.elastic.co/t/keeping-track-of-index-contents-over-time/115679)

<div class="topic-metadata">

**Author:** [@Guy\_Bowden](https://discuss.elastic.co/u/Guy_Bowden)\
**Replies:** 2\
**Last updated:** [January 18, 2018, 1:54pm UTC](https://discuss.elastic.co/t/keeping-track-of-index-contents-over-time/115679 "2018-01-18T13:54:48Z")

</div>

I need a way to monitor a search index over time - for example knowing how many documents are indexed over time grouped by some field/attribute (e.g. how many products of type X, Y and Z are in our index and how has that…

---

## [Not able to use scripting\_field to show distance: ES\_6.1](https://discuss.elastic.co/t/not-able-to-use-scripting-field-to-show-distance-es-6-1/116033)

<div class="topic-metadata">

**Author:** [@neha\_sharma](https://discuss.elastic.co/u/neha_sharma)\
**Replies:** 1\
**Last updated:** [January 18, 2018, 1:54pm UTC](https://discuss.elastic.co/t/not-able-to-use-scripting-field-to-show-distance-es-6-1/116033 "2018-01-18T13:54:43Z")

</div>

Hi I am new to Elastic search. I want to show distance in result while using "\_search" where "location" field is of type : geopoint; I found we can use script\_fields but this is not working. To mention : I am using 6.1 …

---

## [SearchAfter and possible duplicates?](https://discuss.elastic.co/t/searchafter-and-possible-duplicates/116058)

<div class="topic-metadata">

**Author:** [@Ryan\_M](https://discuss.elastic.co/u/Ryan_M)\
**Replies:** 1\
**Last updated:** [January 18, 2018, 1:50pm UTC](https://discuss.elastic.co/t/searchafter-and-possible-duplicates/116058 "2018-01-18T13:50:40Z")

</div>

I've been looking at the docs for Search After and I have a question regarding the last paragraph (emphasis mine): search\_after is not a solution to jump freely to a random page but rather to scroll many queries in par…

---

## [Stored Procedures](https://discuss.elastic.co/t/stored-procedures/115050)

<div class="topic-metadata">

**Author:** [@devil\_srj7](https://discuss.elastic.co/u/devil_srj7)\
**Replies:** 16\
**Last updated:** [January 18, 2018, 1:46pm UTC](https://discuss.elastic.co/t/stored-procedures/115050 "2018-01-18T13:46:08Z")

</div>

Can we have stored procedures in Elasticsearch as we have in MySql?? So that we can call the procedure from Java application just by its name.

---

## [Elasticsearch-repository-hdfs plugin installation](https://discuss.elastic.co/t/elasticsearch-repository-hdfs-plugin-installation/116016)

<div class="topic-metadata">

**Author:** [@saijana](https://discuss.elastic.co/u/saijana)\
**Replies:** 2\
**Last updated:** [January 18, 2018, 1:33pm UTC](https://discuss.elastic.co/t/elasticsearch-repository-hdfs-plugin-installation/116016 "2018-01-18T13:33:25Z")

</div>

Hi, Can someone suggest me where to download the plugin for elasticsearch-repository-hdfs plugin I need to take a backup of elasticsearch index in hdfs. I am using Elasticsearch 2.3.5. I tried to install ES-Hadoop p…

---

## [Aggregation on terms with Nested Property](https://discuss.elastic.co/t/aggregation-on-terms-with-nested-property/116063)

<div class="topic-metadata">

**Author:** [@mongesh\_madhavan](https://discuss.elastic.co/u/mongesh_madhavan)\
**Replies:** 0\
**Last updated:** [January 18, 2018, 1:30pm UTC](https://discuss.elastic.co/t/aggregation-on-terms-with-nested-property/116063 "2018-01-18T13:30:32Z")

</div>

i have below json attrib is nested property { attrib{ color:blue, categoryId: 1 }, attrib{ color:red, categoryid: 2} } When querying around categoryId : 1 or 2 and get correct result but while Aggregating on …

---

## [Creating an index with mappings and analysis doesn't work](https://discuss.elastic.co/t/creating-an-index-with-mappings-and-analysis-doesnt-work/116048)

<div class="topic-metadata">

**Author:** [@Hayk\_Hovhanisyan](https://discuss.elastic.co/u/Hayk_Hovhanisyan)\
**Replies:** 4\
**Last updated:** [January 18, 2018, 1:01pm UTC](https://discuss.elastic.co/t/creating-an-index-with-mappings-and-analysis-doesnt-work/116048 "2018-01-18T13:01:10Z")

</div>

ElasticSearch "2.4.4" Java "1.8.0\_151" Hi folks, The first example fails with MapperParsingException\[Analyzer \[bigrams\] not found for field \[displayName\]\];. here is https://github.com/elastic/elasticsearch/issues/767 …

---

## [FunctionScoreQueryBuilder](https://discuss.elastic.co/t/functionscorequerybuilder/116042)

<div class="topic-metadata">

**Author:** [@Panagiota\_Papagianni](https://discuss.elastic.co/u/Panagiota_Papagianni)\
**Replies:** 0\
**Last updated:** [January 18, 2018, 12:12pm UTC](https://discuss.elastic.co/t/functionscorequerybuilder/116042 "2018-01-18T12:12:02Z")

</div>

Hi, I want to upgrade from ES 1.7 to 6.0. I made all necessary changes and now I have a problem with FunctionScoreQueryBuilder. I create a BoolQueryBuilder filter and works fine. Now I want to add score to my results b…

---

## [Comparing timestamps in painless](https://discuss.elastic.co/t/comparing-timestamps-in-painless/115858)

<div class="topic-metadata">

**Author:** [@Steve\_Stevens](https://discuss.elastic.co/u/Steve_Stevens)\
**Replies:** 4\
**Last updated:** [January 18, 2018, 12:11pm UTC](https://discuss.elastic.co/t/comparing-timestamps-in-painless/115858 "2018-01-18T12:11:52Z")

</div>

How do I check if a payload timestamp (\_source\['@timestamp'\]) to scheduled time plus 5 minutes? def schedTimestamp=Instant.ofEpochMilli(ctx.trigger.scheduled\_time.getMillis()).plus(Duration.ofMinutes(+5); def payloadTim…

---

## [Snapshot create Acess Denied](https://discuss.elastic.co/t/snapshot-create-acess-denied/116008)

<div class="topic-metadata">

**Author:** [@odao1987](https://discuss.elastic.co/u/odao1987)\
**Replies:** 1\
**Last updated:** [January 18, 2018, 11:54am UTC](https://discuss.elastic.co/t/snapshot-create-acess-denied/116008 "2018-01-18T11:54:45Z")

</div>

i need help with this issue "error": { "root\_cause": \[ { "type": "repository\_verification\_exception", "reason": "\[ene18\] \[\[\_NNX5\_3TQ8aP7K9ZCgolPQ, 'RemoteTransportException\[\[NAME\]\[IPADRESS9326\]\[internal:admin/reposi…

---

## [Indexing a large pdf file (around 90MB) gives an exception](https://discuss.elastic.co/t/indexing-a-large-pdf-file-around-90mb-gives-an-exception/116014)

<div class="topic-metadata">

**Author:** [@Abhilash\_Bolla](https://discuss.elastic.co/u/Abhilash_Bolla)\
**Replies:** 3\
**Last updated:** [January 18, 2018, 10:45am UTC](https://discuss.elastic.co/t/indexing-a-large-pdf-file-around-90mb-gives-an-exception/116014 "2018-01-18T10:45:30Z")

</div>

Hi, Elasticsearch version: 5.4.3 Heap allocated: 4GB Java version: Java 8 I am trying to index a large pdf file of 90 MB using the ingest-attachments plugin. I encode the pdf file into base64 format and then index it…

---

## [Illegal\_argument\_exception when extract a random subset of an index](https://discuss.elastic.co/t/illegal-argument-exception-when-extract-a-random-subset-of-an-index/115995)

<div class="topic-metadata">

**Author:** [@Mike\_Hung](https://discuss.elastic.co/u/Mike_Hung)\
**Replies:** 1\
**Last updated:** [January 18, 2018, 9:39am UTC](https://discuss.elastic.co/t/illegal-argument-exception-when-extract-a-random-subset-of-an-index/115995 "2018-01-18T09:39:12Z")

</div>

Hello, According to the Elasticsearch 5.6 Reindex API document. I have encountered the problem when running \_reindex API as following command: curl -XPOST 'localhost:9200/\_reindex?pretty' -H 'Content-Type: application…

---

## [Elasticsearch adaptor](https://discuss.elastic.co/t/elasticsearch-adaptor/115738)

<div class="topic-metadata">

**Author:** [@vigneshD](https://discuss.elastic.co/u/vigneshD)\
**Replies:** 4\
**Last updated:** [January 18, 2018, 9:17am UTC](https://discuss.elastic.co/t/elasticsearch-adaptor/115738 "2018-01-18T09:17:50Z")

</div>

what is an elasticsearch adaptor and for what is it used for?

---

## [A es node recovery](https://discuss.elastic.co/t/a-es-node-recovery/115466)

<div class="topic-metadata">

**Author:** [@piingluo](https://discuss.elastic.co/u/piingluo)\
**Replies:** 2\
**Last updated:** [January 16, 2018, 12:26pm UTC](https://discuss.elastic.co/t/a-es-node-recovery/115466 "2018-01-16T12:26:41Z")

</div>

hi guys， i have a question. when a es node recovery, the disk IO of this server is so high which seriously affected this node's performance . so how can i configure this.

---

## [Search perfomance using many indices with one alias](https://discuss.elastic.co/t/search-perfomance-using-many-indices-with-one-alias/115665)

<div class="topic-metadata">

**Author:** [@Jul](https://discuss.elastic.co/u/Jul)\
**Replies:** 6\
**Last updated:** [January 18, 2018, 8:55am UTC](https://discuss.elastic.co/t/search-perfomance-using-many-indices-with-one-alias/115665 "2018-01-18T08:55:41Z")

</div>

Hey there, we run into following problem, maybe you can give us some adivce or best practice: We use many indices (80) and for search we use one alias to query all of them at the same time as search results can be in f…

---

## [Search performance: IndicesQuery (deprecated) vs. query on field \_index](https://discuss.elastic.co/t/search-performance-indicesquery-deprecated-vs-query-on-field-index/115999)

<div class="topic-metadata">

**Author:** [@Jul](https://discuss.elastic.co/u/Jul)\
**Replies:** 0\
**Last updated:** [January 18, 2018, 8:47am UTC](https://discuss.elastic.co/t/search-performance-indicesquery-deprecated-vs-query-on-field-index/115999 "2018-01-18T08:47:09Z")

</div>

Hey there, I want to search across multiple indices with different fields on each index. The deprecated IndicesQuery (https://www.elastic.co/guide/en/elasticsearch/reference/5.5/query-dsl-indices-query.html) performs re…

---

## [How to append dynamic field without affecting original payload?](https://discuss.elastic.co/t/how-to-append-dynamic-field-without-affecting-original-payload/115992)

<div class="topic-metadata">

**Author:** [@YuWatanabe](https://discuss.elastic.co/u/YuWatanabe)\
**Replies:** 2\
**Last updated:** [January 18, 2018, 8:42am UTC](https://discuss.elastic.co/t/how-to-append-dynamic-field-without-affecting-original-payload/115992 "2018-01-18T08:42:00Z")

</div>

Hello I would like to get help with Alerting in x-pack. I want to create a dynamic field which calculates search start time using ctx.trigger.scheduled\_time . I thought this can be achieved by using transform but since…

---

## [Aggregation and Mapping Types](https://discuss.elastic.co/t/aggregation-and-mapping-types/115989)

<div class="topic-metadata">

**Author:** [@Sivaprakash\_Shanmuga](https://discuss.elastic.co/u/Sivaprakash_Shanmuga)\
**Replies:** 0\
**Last updated:** [January 18, 2018, 8:01am UTC](https://discuss.elastic.co/t/aggregation-and-mapping-types/115989 "2018-01-18T08:01:04Z")

</div>

Hi, Im storing Device Status data into Elastic to generate reports out of it. Following are list of fields and sample data DeviceId DeviceType Status Updated\_At 10001 50001 ON 2017-12-12 17:04:26 10002 50002 …

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1822)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1824)
