# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1662

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1663

---

## [Aggregate old indices](https://discuss.elastic.co/t/aggregate-old-indices/134626)

<div class="topic-metadata">

**Author:** [@Lacho](https://discuss.elastic.co/u/Lacho)\
**Replies:** 1\
**Last updated:** [June 6, 2018, 7:08pm UTC](https://discuss.elastic.co/t/aggregate-old-indices/134626 "2018-06-06T19:08:14Z")

</div>

Hi all, I would really appreciate some advice on how the following could be achieved: For each day I am creating new indices to hold the data collected Logstash from that day and each index contains the date in its nam…

---

## [Removal of duplicate based on some condition](https://discuss.elastic.co/t/removal-of-duplicate-based-on-some-condition/134862)

<div class="topic-metadata">

**Author:** [@ssenthil416](https://discuss.elastic.co/u/ssenthil416)\
**Replies:** 0\
**Last updated:** [June 6, 2018, 7:04pm UTC](https://discuss.elastic.co/t/removal-of-duplicate-based-on-some-condition/134862 "2018-06-06T19:04:07Z")

</div>

We have millions of rows as part of elastic, in that we found many duplicate IDs, we want to clean it up We use Go Elastic library https://github.com/olivere/elastic We have query to first 10000 record to return dupli…

---

## [Can I group by a field and ignore the buckets?](https://discuss.elastic.co/t/can-i-group-by-a-field-and-ignore-the-buckets/134860)

<div class="topic-metadata">

**Author:** [@jong](https://discuss.elastic.co/u/jong)\
**Replies:** 0\
**Last updated:** [June 6, 2018, 6:38pm UTC](https://discuss.elastic.co/t/can-i-group-by-a-field-and-ignore-the-buckets/134860 "2018-06-06T18:38:52Z")

</div>

I am using elastic 1.5. Here are my mappings: config = { "mappings": { my\_doc\_type: { "dynamic": False, "properties": { "timestamp\_start": { "type…

---

## [Multi-tenancy in Elasticsearch (development environment)](https://discuss.elastic.co/t/multi-tenancy-in-elasticsearch-development-environment/134855)

<div class="topic-metadata">

**Author:** [@ashok.gadiraju](https://discuss.elastic.co/u/ashok.gadiraju)\
**Replies:** 3\
**Last updated:** [June 6, 2018, 6:27pm UTC](https://discuss.elastic.co/t/multi-tenancy-in-elasticsearch-development-environment/134855 "2018-06-06T18:27:41Z")

</div>

My use case for multi tenancy with elastic search is to have indexes with same name and type across different development environments (dev, test, stage) Is it possible to have this set up of multi tenancy in same clust…

---

## [Elasticsearch: Transaction Storage for Mobile Ads](https://discuss.elastic.co/t/elasticsearch-transaction-storage-for-mobile-ads/134840)

<div class="topic-metadata">

**Author:** [@kaveh](https://discuss.elastic.co/u/kaveh)\
**Replies:** 1\
**Last updated:** [June 6, 2018, 4:43pm UTC](https://discuss.elastic.co/t/elasticsearch-transaction-storage-for-mobile-ads/134840 "2018-06-06T16:43:11Z")

</div>

I am working on an M.V.P. for a Mobile Ads end-to-end system, where ad interaction events, e.g., display, play, pause, close, etc., are to be sent to a database for storage. Moreover, I am considering to build a dashboar…

---

## [Search docs with (term = "val" OR not\_exists)](https://discuss.elastic.co/t/search-docs-with-term-val-or-not-exists/134687)

<div class="topic-metadata">

**Author:** [@chief06](https://discuss.elastic.co/u/chief06)\
**Replies:** 6\
**Last updated:** [June 6, 2018, 4:27pm UTC](https://discuss.elastic.co/t/search-docs-with-term-val-or-not-exists/134687 "2018-06-06T16:27:39Z")

</div>

I have a \_search query running that checks certain properties and aggregates values based on the search. One of the search criteria is: { "term": { "Status": 0} } "Status" was a property added after documents were alre…

---

## [Shards allocation monitoring](https://discuss.elastic.co/t/shards-allocation-monitoring/134308)

<div class="topic-metadata">

**Author:** [@SebScoFr](https://discuss.elastic.co/u/SebScoFr)\
**Replies:** 6\
**Last updated:** [June 6, 2018, 4:13pm UTC](https://discuss.elastic.co/t/shards-allocation-monitoring/134308 "2018-06-06T16:13:59Z")

</div>

This is a query to get the number of shards for an index called products. We can see that it has 10 shards / 1 replica \[07\] And this is what I see in xpack monitoring for that same index, each shard and replica appears…

---

## [Broken link to elasticsearch-sql-odbc repository](https://discuss.elastic.co/t/broken-link-to-elasticsearch-sql-odbc-repository/134818)

<div class="topic-metadata">

**Author:** [@Denis\_Lamanov](https://discuss.elastic.co/u/Denis_Lamanov)\
**Replies:** 1\
**Last updated:** [June 6, 2018, 4:09pm UTC](https://discuss.elastic.co/t/broken-link-to-elasticsearch-sql-odbc-repository/134818 "2018-06-06T16:09:20Z")

</div>

Hi guys, According to https://www.elastic.co/blog/this-week-in-elasticsearch-and-apache-lucene-2018-06-01 we can track progress ODBC driver here https://github.com/elastic/elasticsearch-sql-odbc/ but there is no elast…

---

## [Help needed with using ESTestCase](https://discuss.elastic.co/t/help-needed-with-using-estestcase/134817)

<div class="topic-metadata">

**Author:** [@bacem.hagui](https://discuss.elastic.co/u/bacem.hagui)\
**Replies:** 1\
**Last updated:** [June 6, 2018, 3:53pm UTC](https://discuss.elastic.co/t/help-needed-with-using-estestcase/134817 "2018-06-06T15:53:59Z")

</div>

I am trying to perform unit tests on ElasticSearch methods written in Java. My methods are composed of a query builder and then a parser for the json reply received from the server after the query is received. I would l…

---

## [Type of Keyword can support and maintain type e.g boolean, number](https://discuss.elastic.co/t/type-of-keyword-can-support-and-maintain-type-e-g-boolean-number/134806)

<div class="topic-metadata">

**Author:** [@delk13](https://discuss.elastic.co/u/delk13)\
**Replies:** 5\
**Last updated:** [June 6, 2018, 3:48pm UTC](https://discuss.elastic.co/t/type-of-keyword-can-support-and-maintain-type-e-g-boolean-number/134806 "2018-06-06T15:48:54Z")

</div>

Hello, I have an field (name of field "value") type of text I noticed that when I put (insert) into that indexer a boolean type e.g {"value" : true} or {"value" : 17} then the indexer keeps the type and returns me the…

---

## [Attach path and timestamp of log found, in the e-mail notification](https://discuss.elastic.co/t/attach-path-and-timestamp-of-log-found-in-the-e-mail-notification/134738)

<div class="topic-metadata">

**Author:** [@varun48](https://discuss.elastic.co/u/varun48)\
**Replies:** 4\
**Last updated:** [June 6, 2018, 3:44pm UTC](https://discuss.elastic.co/t/attach-path-and-timestamp-of-log-found-in-the-e-mail-notification/134738 "2018-06-06T15:44:52Z")

</div>

I have created a watcher. When I put the query in Discover search box, I get the following output: \[image\] We are searching for a functionality to provide values of path and @timestamp in e-mail notification as shown …

---

## [ElasticSearch with Java Bulk API Problem with indexation](https://discuss.elastic.co/t/elasticsearch-with-java-bulk-api-problem-with-indexation/134833)

<div class="topic-metadata">

**Author:** [@michal.zawadzki90](https://discuss.elastic.co/u/michal.zawadzki90)\
**Replies:** 0\
**Last updated:** [June 6, 2018, 2:53pm UTC](https://discuss.elastic.co/t/elasticsearch-with-java-bulk-api-problem-with-indexation/134833 "2018-06-06T14:53:43Z")

</div>

Hi, I'm using ElasticSearch 5.2.2 with Java 8. I'm running Elastic locally with default settings on Windows 10. In my mapping I had defined two types: vod and episode which are connected with the parent-child relation: …

---

## [Score\_mode sum don't return expected results](https://discuss.elastic.co/t/score-mode-sum-dont-return-expected-results/134788)

<div class="topic-metadata">

**Author:** [@dennis87](https://discuss.elastic.co/u/dennis87)\
**Replies:** 1\
**Last updated:** [June 6, 2018, 2:42pm UTC](https://discuss.elastic.co/t/score-mode-sum-dont-return-expected-results/134788 "2018-06-06T14:42:50Z")

</div>

original question: https://stackoverflow.com/questions/50717204/elasticsearch-score-mode-sum-dont-return-expected-resutls I have a query with two decay functions ( ES 2.4.4 ), I am using "score\_mode" : "sum" to sum the …

---

## [ElasticSearch Unstable](https://discuss.elastic.co/t/elasticsearch-unstable/133566)

<div class="topic-metadata">

**Author:** [@joshsmoore](https://discuss.elastic.co/u/joshsmoore)\
**Replies:** 12\
**Last updated:** [June 6, 2018, 2:08pm UTC](https://discuss.elastic.co/t/elasticsearch-unstable/133566 "2018-06-06T14:08:53Z")

</div>

Hi I have ELK stack setup running on docker swarm. I have 3 VM with 16GB of memory and each one has a ES instance running with 10GB of heap space (version 6.2.3). The problem is that it is unstable. I have turn off swa…

---

## [Elastic search snap shot and backup of data of particular time interval](https://discuss.elastic.co/t/elastic-search-snap-shot-and-backup-of-data-of-particular-time-interval/134822)

<div class="topic-metadata">

**Author:** [@Siddaram\_Jamagav](https://discuss.elastic.co/u/Siddaram_Jamagav)\
**Replies:** 0\
**Last updated:** [June 6, 2018, 2:05pm UTC](https://discuss.elastic.co/t/elastic-search-snap-shot-and-backup-of-data-of-particular-time-interval/134822 "2018-06-06T14:05:31Z")

</div>

i have elastic search index where in i have i will get the data continuous data from some tools. i want to take a snapshot of the data which is older than a month and delete that from the index , so that i can have less…

---

## [Remote Reindex Performance](https://discuss.elastic.co/t/remote-reindex-performance/134401)

<div class="topic-metadata">

**Author:** [@dawiro](https://discuss.elastic.co/u/dawiro)\
**Replies:** 5\
**Last updated:** [June 6, 2018, 1:23pm UTC](https://discuss.elastic.co/t/remote-reindex-performance/134401 "2018-06-06T13:23:38Z")

</div>

Hi, I need to migrate data between clusters and am looking to do via remindex from remote using curator. However, I'm seeing that the rate of reindexing is very slow. So, how can I up the reindexing rate? The curator c…

---

## [Information/Help : JDBC importer parameters](https://discuss.elastic.co/t/information-help-jdbc-importer-parameters/134804)

<div class="topic-metadata">

**Author:** [@Geetha](https://discuss.elastic.co/u/Geetha)\
**Replies:** 0\
**Last updated:** [June 6, 2018, 12:39pm UTC](https://discuss.elastic.co/t/information-help-jdbc-importer-parameters/134804 "2018-06-06T12:39:40Z")

</div>

Hi, I would like to use elastic jdbc importer for pulling data from our traditional rdbms to elastic and search on it. I was able to do that successfully but have some questions regarding the database locks that happen…

---

## [Custom Elastic Cloud Plugin](https://discuss.elastic.co/t/custom-elastic-cloud-plugin/134785)

<div class="topic-metadata">

**Author:** [@Jasonespo](https://discuss.elastic.co/u/Jasonespo)\
**Replies:** 2\
**Last updated:** [June 6, 2018, 12:06pm UTC](https://discuss.elastic.co/t/custom-elastic-cloud-plugin/134785 "2018-06-06T12:06:33Z")

</div>

When Installing plugins to the elastic cloud do I need to use the custom plugin section? I want to install the elasticsearch plugin repository-s3. Jason

---

## [Elasticsearch data folder size](https://discuss.elastic.co/t/elasticsearch-data-folder-size/134793)

<div class="topic-metadata">

**Author:** [@soumya1](https://discuss.elastic.co/u/soumya1)\
**Replies:** 0\
**Last updated:** [June 6, 2018, 11:36am UTC](https://discuss.elastic.co/t/elasticsearch-data-folder-size/134793 "2018-06-06T11:36:45Z")

</div>

am running elasticsearch cluster for elk with 1master 1client and 1 data node (5shards and 1 replica) mounted the volumes under /data directory in the es containers. i allocated 20 gb volume for each but when the cl…

---

## [Partial Updates on index using Spark Streaming](https://discuss.elastic.co/t/partial-updates-on-index-using-spark-streaming/134792)

<div class="topic-metadata">

**Author:** [@Darshan\_Shah](https://discuss.elastic.co/u/Darshan_Shah)\
**Replies:** 0\
**Last updated:** [June 6, 2018, 11:32am UTC](https://discuss.elastic.co/t/partial-updates-on-index-using-spark-streaming/134792 "2018-06-06T11:32:45Z")

</div>

0 down vote favorite I am using following command to persist data in elastic search using spark streaming. EsSparkSQL.saveToEs(DataFrame, indexname, ES\_CONFIG) With this, I am overwriting entire document, which I do…

---

## [Elasticsearch 'search' not returning all data](https://discuss.elastic.co/t/elasticsearch-search-not-returning-all-data/134745)

<div class="topic-metadata">

**Author:** [@roshni](https://discuss.elastic.co/u/roshni)\
**Replies:** 6\
**Last updated:** [June 6, 2018, 10:51am UTC](https://discuss.elastic.co/t/elasticsearch-search-not-returning-all-data/134745 "2018-06-06T10:51:08Z")

</div>

Hi , I have inserted some 1000 documents using a script i=1 while \[ $i -le 998 \] do curl 'localhost:9200/test\_index1/test\_type1/'$i'' -d'{"name":"Hi , This is XYZ from location 10.0.4.135"}' i=expr $i + 1done Prior t…

---

## [Mixed content issue while using coordinate map visulaisation](https://discuss.elastic.co/t/mixed-content-issue-while-using-coordinate-map-visulaisation/134756)

<div class="topic-metadata">

**Author:** [@eladlato](https://discuss.elastic.co/u/eladlato)\
**Replies:** 2\
**Last updated:** [June 6, 2018, 10:33am UTC](https://discuss.elastic.co/t/mixed-content-issue-while-using-coordinate-map-visulaisation/134756 "2018-06-06T10:33:58Z")

</div>

Hi, i'm using elasticsearch cloud solution, and presenting geo location data with coordinate map visualisation. Once i'm zoom-in to level 10-18 i get mixed content error from openstreetmap provider due to http request …

---

## [Exact phrase match with special characters '.' and ':'](https://discuss.elastic.co/t/exact-phrase-match-with-special-characters-and/134402)

<div class="topic-metadata">

**Author:** [@Santhosh\_ic](https://discuss.elastic.co/u/Santhosh_ic)\
**Replies:** 2\
**Last updated:** [June 6, 2018, 9:37am UTC](https://discuss.elastic.co/t/exact-phrase-match-with-special-characters-and/134402 "2018-06-06T09:37:08Z")

</div>

Hi, I want to match "command. Id:", exactly in 'Message'. I have tried this, { "query": { "match\_phrase": { "Message": { "query": "command. id:", "slop": 0 } } } } However, this matches "Command ID" and "com…

---

## [Completion suggester from multiple indices](https://discuss.elastic.co/t/completion-suggester-from-multiple-indices/134737)

<div class="topic-metadata">

**Author:** [@rs123](https://discuss.elastic.co/u/rs123)\
**Replies:** 0\
**Last updated:** [June 6, 2018, 6:53am UTC](https://discuss.elastic.co/t/completion-suggester-from-multiple-indices/134737 "2018-06-06T06:53:55Z")

</div>

So I want use completion suggester with multiple indices. For example I have three indices name, location, pdt. Suppose some first type name and than location so throughout their should be suggestion for name when name i…

---

## [Does ElasticSearch support Java 10?](https://discuss.elastic.co/t/does-elasticsearch-support-java-10/134763)

<div class="topic-metadata">

**Author:** [@Denis\_Lamanov](https://discuss.elastic.co/u/Denis_Lamanov)\
**Replies:** 1\
**Last updated:** [June 6, 2018, 9:23am UTC](https://discuss.elastic.co/t/does-elasticsearch-support-java-10/134763 "2018-06-06T09:23:07Z")

</div>

Hi guys, Since Oracle already closed Java 9 and recommend instead use Java 10 can you please update Matrix page? https://www.elastic.co/support/matrix#matrix\_jvm Thanks

---

## [Separate query for excluded words](https://discuss.elastic.co/t/separate-query-for-excluded-words/134768)

<div class="topic-metadata">

**Author:** [@newnewb](https://discuss.elastic.co/u/newnewb)\
**Replies:** 0\
**Last updated:** [June 6, 2018, 9:23am UTC](https://discuss.elastic.co/t/separate-query-for-excluded-words/134768 "2018-06-06T09:23:00Z")

</div>

In the query below I'll exclude all the words that contain "vegetable". Is there a way to create a separate query to get all of the excluded words? { "query": { "match\_phrase": {"words": "get"} }, "aggs": {…

---

## [Post Filter Scripted Field based on certain condition](https://discuss.elastic.co/t/post-filter-scripted-field-based-on-certain-condition/134766)

<div class="topic-metadata">

**Author:** [@sushantMoon](https://discuss.elastic.co/u/sushantMoon)\
**Replies:** 0\
**Last updated:** [June 6, 2018, 9:18am UTC](https://discuss.elastic.co/t/post-filter-scripted-field-based-on-certain-condition/134766 "2018-06-06T09:18:30Z")

</div>

Is there a way for having a field similar to scripted field whose value would be True or False or something custom based on certain condition on the query result that we have obtained.

---

## [Java High level Rest Client(5.6), getting succesful shard info count](https://discuss.elastic.co/t/java-high-level-rest-client-5-6-getting-succesful-shard-info-count/134045)

<div class="topic-metadata">

**Author:** [@Neha\_goswami](https://discuss.elastic.co/u/Neha_goswami)\
**Replies:** 6\
**Last updated:** [June 6, 2018, 9:14am UTC](https://discuss.elastic.co/t/java-high-level-rest-client-5-6-getting-succesful-shard-info-count/134045 "2018-06-06T09:14:27Z")

</div>

Hi i am working on migration from Transport client to restClient: M stuck here: using transport client this was done as: XContentBuilder builder = jsonBuilder().startObject().field("ProcessName", processName).field(St…

---

## [Why elasticsearch still check the length of a keyword field, even if it's not indexed?](https://discuss.elastic.co/t/why-elasticsearch-still-check-the-length-of-a-keyword-field-even-if-its-not-indexed/134604)

<div class="topic-metadata">

**Author:** [@esnewbie](https://discuss.elastic.co/u/esnewbie)\
**Replies:** 6\
**Last updated:** [June 6, 2018, 7:45am UTC](https://discuss.elastic.co/t/why-elasticsearch-still-check-the-length-of-a-keyword-field-even-if-its-not-indexed/134604 "2018-06-06T07:45:44Z")

</div>

Hi all, I'm new to Elasticsearch, using version 5.3. As i understand, the length of keyword field is limited to about 32K due to the limitation of Lucene's term byte-length limit of 32766. But, the thing I don't unde…

---

## [NFS: high getattr IOPS at idle](https://discuss.elastic.co/t/nfs-high-getattr-iops-at-idle/134764)

<div class="topic-metadata">

**Author:** [@imehl](https://discuss.elastic.co/u/imehl)\
**Replies:** 0\
**Last updated:** [June 6, 2018, 9:00am UTC](https://discuss.elastic.co/t/nfs-high-getattr-iops-at-idle/134764 "2018-06-06T09:00:30Z")

</div>

Hi, we have an ES cluster with hot-warm architecture. Hot nodes have local attached SSDs (indexing, current data) Warm nodes use a NFS storage (archived data) The performance for NFS related queries are good and ther…

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1661)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1663)
