# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1551

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1552

---

## [Records missing during ES updates with over 250 requests](https://discuss.elastic.co/t/records-missing-during-es-updates-with-over-250-requests/148029)

<div class="topic-metadata">

**Author:** [@mikesparr](https://discuss.elastic.co/u/mikesparr)\
**Replies:** 20\
**Last updated:** [September 11, 2018, 7:32pm UTC](https://discuss.elastic.co/t/records-missing-during-es-updates-with-over-250-requests/148029 "2018-09-11T19:32:25Z")

</div>

Building a small service to archive contact records from Hubspot into ES index and records are consistently not making it into the index, but varying counts each attempt. Using the latest ES Node SDK client and ES is hos…

---

## [Mapping error in QA no issue in Prod](https://discuss.elastic.co/t/mapping-error-in-qa-no-issue-in-prod/148207)

<div class="topic-metadata">

**Author:** [@Ryan\_Downey](https://discuss.elastic.co/u/Ryan_Downey)\
**Replies:** 0\
**Last updated:** [September 11, 2018, 7:31pm UTC](https://discuss.elastic.co/t/mapping-error-in-qa-no-issue-in-prod/148207 "2018-09-11T19:31:54Z")

</div>

Running 6.3.2 uberAgent is a listed indices in our QA and Prod environment I'm running into a mapping issue. Have read the new mapping standards, still puzzled. Background: I previously posted that we had installed ub…

---

## [Converting a SQL query to Elastic Query](https://discuss.elastic.co/t/converting-a-sql-query-to-elastic-query/148202)

<div class="topic-metadata">

**Author:** [@premieredigital](https://discuss.elastic.co/u/premieredigital)\
**Replies:** 0\
**Last updated:** [September 11, 2018, 6:50pm UTC](https://discuss.elastic.co/t/converting-a-sql-query-to-elastic-query/148202 "2018-09-11T18:50:36Z")

</div>

I have the following SQL query that I'm looking to convert to ES: UPDATE \_index SET is\_hidden = False WHERE transaction\_guid='XXX' Is the following the closest equivalent? body = { "script": { "lang": "painless…

---

## [404 on successful delete](https://discuss.elastic.co/t/404-on-successful-delete/148201)

<div class="topic-metadata">

**Author:** [@skatenerd](https://discuss.elastic.co/u/skatenerd)\
**Replies:** 0\
**Last updated:** [September 11, 2018, 6:47pm UTC](https://discuss.elastic.co/t/404-on-successful-delete/148201 "2018-09-11T18:47:04Z")

</div>

Elasticsearch version (bin/elasticsearch --version): 6.2 Plugins installed: None JVM version (java -version): Unknown (AWS-hosted Elasticsearch) OS version (uname -a if on a Unix-like system): Unknown (AWS-hosted Elas…

---

## [Slower query performance after upgrade to 6.2.0 ES](https://discuss.elastic.co/t/slower-query-performance-after-upgrade-to-6-2-0-es/147318)

<div class="topic-metadata">

**Author:** [@Tosh](https://discuss.elastic.co/u/Tosh)\
**Replies:** 2\
**Last updated:** [September 11, 2018, 4:58pm UTC](https://discuss.elastic.co/t/slower-query-performance-after-upgrade-to-6-2-0-es/147318 "2018-09-11T16:58:42Z")

</div>

Hi , We recently upgraded from elastic 2.3 to 6.2 . The search queries seem to be taking more response time than before for the same number of requests . The difference from the config perspective that we saw was that …

---

## [Product Compare feature using Elastic](https://discuss.elastic.co/t/product-compare-feature-using-elastic/148181)

<div class="topic-metadata">

**Author:** [@formeofme](https://discuss.elastic.co/u/formeofme)\
**Replies:** 0\
**Last updated:** [September 11, 2018, 4:58pm UTC](https://discuss.elastic.co/t/product-compare-feature-using-elastic/148181 "2018-09-11T16:58:41Z")

</div>

hi all, I am trying to implement a Product compare feature (similar to the one in gsmarena website comparing mobile specs ) What i like achieve is - Between 2 or more documents i would like to know which all field…

---

## [Store directory tree of files in ES](https://discuss.elastic.co/t/store-directory-tree-of-files-in-es/148164)

<div class="topic-metadata">

**Author:** [@TimWard](https://discuss.elastic.co/u/TimWard)\
**Replies:** 2\
**Last updated:** [September 11, 2018, 3:59pm UTC](https://discuss.elastic.co/t/store-directory-tree-of-files-in-es/148164 "2018-09-11T15:59:08Z")

</div>

Suppose I have a directory tree of a modest number of small text files (where "modest" is currently hundreds, won't ever be more than tens of thousands) and "small" is hundreds of bytes, won't ever be more than thousands…

---

## [Set subtraction from original index to other index](https://discuss.elastic.co/t/set-subtraction-from-original-index-to-other-index/148158)

<div class="topic-metadata">

**Author:** [@nuketro0p3r](https://discuss.elastic.co/u/nuketro0p3r)\
**Replies:** 0\
**Last updated:** [September 11, 2018, 2:36pm UTC](https://discuss.elastic.co/t/set-subtraction-from-original-index-to-other-index/148158 "2018-09-11T14:36:29Z")

</div>

Is it possible to write a query like: SELECT \* FROM ORIGINAL as O where O.\_id NOT IN ( SELECT \_id FROM OTHER\_1 ); I've tried looking on Google, the best that I could do is: GET OTHER\_1/\_search { "query": { "match…

---

## [Elastic Search Distinct, order by and limit](https://discuss.elastic.co/t/elastic-search-distinct-order-by-and-limit/148146)

<div class="topic-metadata">

**Author:** [@rajesh.ramadoss](https://discuss.elastic.co/u/rajesh.ramadoss)\
**Replies:** 0\
**Last updated:** [September 11, 2018, 1:43pm UTC](https://discuss.elastic.co/t/elastic-search-distinct-order-by-and-limit/148146 "2018-09-11T13:43:42Z")

</div>

Hi , Can someone please let me know the elastic search equivalent query of below mysql query select distinct(field\_name\_1) from table order by field\_name\_2 limit 0,100 Thanks !

---

## [Bucket sorting](https://discuss.elastic.co/t/bucket-sorting/148144)

<div class="topic-metadata">

**Author:** [@bert\_vervaele](https://discuss.elastic.co/u/bert_vervaele)\
**Replies:** 0\
**Last updated:** [September 11, 2018, 1:42pm UTC](https://discuss.elastic.co/t/bucket-sorting/148144 "2018-09-11T13:42:20Z")

</div>

Hi, I was wondring if a new feature of Elastic 6 could help me. But before I upgrade everything from 5.2.2 I would like to check it first. My problem: I want an aggregation to be sorted based on the sum of all it's s…

---

## [Configuration Informations](https://discuss.elastic.co/t/configuration-informations/148125)

<div class="topic-metadata">

**Author:** [@sup3race](https://discuss.elastic.co/u/sup3race)\
**Replies:** 1\
**Last updated:** [September 11, 2018, 1:32pm UTC](https://discuss.elastic.co/t/configuration-informations/148125 "2018-09-11T13:32:25Z")

</div>

Hello guys, I have an application that collects twits / reddit posts and other kind of informations. let's say 1000 documents are around 1mb of size. I recently bought 2 servers with the following specs: CPU: Intel® Xe…

---

## [Elasticsearch error not enough master nodes discovered during pinging (Although I am able to ping its IP)](https://discuss.elastic.co/t/elasticsearch-error-not-enough-master-nodes-discovered-during-pinging-although-i-am-able-to-ping-its-ip/148065)

<div class="topic-metadata">

**Author:** [@shashankdesai23](https://discuss.elastic.co/u/shashankdesai23)\
**Replies:** 4\
**Last updated:** [September 11, 2018, 1:06pm UTC](https://discuss.elastic.co/t/elasticsearch-error-not-enough-master-nodes-discovered-during-pinging-although-i-am-able-to-ping-its-ip/148065 "2018-09-11T13:06:55Z")

</div>

I am trying to set up Elastic Search cluster with two nodes but I keep getting this error. \[o.e.d.z.ZenDiscovery \] \[master-node\] not enough master nodes discovered ?during pinging (found \[\[Candidate{node={master-nod…

---

## [Indexing PDF's and Perform Text Analytics with ES](https://discuss.elastic.co/t/indexing-pdfs-and-perform-text-analytics-with-es/146803)

<div class="topic-metadata">

**Author:** [@rahulnama](https://discuss.elastic.co/u/rahulnama)\
**Replies:** 11\
**Last updated:** [September 11, 2018, 12:46pm UTC](https://discuss.elastic.co/t/indexing-pdfs-and-perform-text-analytics-with-es/146803 "2018-09-11T12:46:05Z")

</div>

Hello All I've Indexed PDF into ES. Now I want to try out text analytics on the same pdf. Here is sample pdf after indexing in kibana Now I want to run elastic's cool analysers(something related to NLP: like removin…

---

## [Cannot search special characters in values](https://discuss.elastic.co/t/cannot-search-special-characters-in-values/148114)

<div class="topic-metadata">

**Author:** [@agrawal](https://discuss.elastic.co/u/agrawal)\
**Replies:** 0\
**Last updated:** [September 11, 2018, 12:01pm UTC](https://discuss.elastic.co/t/cannot-search-special-characters-in-values/148114 "2018-09-11T12:01:30Z")

</div>

Hi, I have indexed some data in elastic search(version - 6.2.4), in that I have two field- TestcaseName and testSuiteName. Their values have special characters like "-" ,"\_" "\[" etc. when trying to search the data b…

---

## [Search.max\_buckets per query?](https://discuss.elastic.co/t/search-max-buckets-per-query/148104)

<div class="topic-metadata">

**Author:** [@Matt\_W](https://discuss.elastic.co/u/Matt_W)\
**Replies:** 1\
**Last updated:** [September 11, 2018, 11:38am UTC](https://discuss.elastic.co/t/search-max-buckets-per-query/148104 "2018-09-11T11:38:53Z")

</div>

Any thoughts on making this a per-query value? We have a situation where in general, end-users of our app shouldn't hit 10000 (or whatever) buckets, but when trouble-shooting expert-users might, and understand the conse…

---

## [Improvements](https://discuss.elastic.co/t/improvements/147970)

<div class="topic-metadata">

**Author:** [@Fram\_Souza](https://discuss.elastic.co/u/Fram_Souza)\
**Replies:** 1\
**Last updated:** [September 11, 2018, 11:08am UTC](https://discuss.elastic.co/t/improvements/147970 "2018-09-11T11:08:57Z")

</div>

Hi guys!! I've a ideia about improvements on x-pack, but I don't know programming to send a patches, Is there any other way that can I to do this ? I've been see on github (master) and don't exist any issue open about…

---

## [Case insensitive sort doesn't work](https://discuss.elastic.co/t/case-insensitive-sort-doesnt-work/143192)

<div class="topic-metadata">

**Author:** [@shwetaskatdare](https://discuss.elastic.co/u/shwetaskatdare)\
**Replies:** 8\
**Last updated:** [September 11, 2018, 11:08am UTC](https://discuss.elastic.co/t/case-insensitive-sort-doesnt-work/143192 "2018-09-11T11:08:30Z")

</div>

Elasticsearch version (bin/elasticsearch --version): 5.3 JVM version (java -version): java 10.0.1 2018-04-17 Description of the problem including expected versus actual behavior: Hello, I am trying to achieve case in…

---

## [Geo searching part of intro webinar is now broken](https://discuss.elastic.co/t/geo-searching-part-of-intro-webinar-is-now-broken/145964)

<div class="topic-metadata">

**Author:** [@tombusby](https://discuss.elastic.co/u/tombusby)\
**Replies:** 2\
**Last updated:** [September 11, 2018, 11:03am UTC](https://discuss.elastic.co/t/geo-searching-part-of-intro-webinar-is-now-broken/145964 "2018-09-11T11:03:30Z")

</div>

In the introductory webinar at https://www.elastic.co/webinars/getting-started-elasticsearch?storm=start-page&iesrc=ctr, the part where he explains how to do geo based search no longer works. (The commands he uses are h…

---

## [Elasticsearch: Best Approach to Index files:](https://discuss.elastic.co/t/elasticsearch-best-approach-to-index-files/148050)

<div class="topic-metadata">

**Author:** [@rahulnama](https://discuss.elastic.co/u/rahulnama)\
**Replies:** 0\
**Last updated:** [September 11, 2018, 5:58am UTC](https://discuss.elastic.co/t/elasticsearch-best-approach-to-index-files/148050 "2018-09-11T05:58:22Z")

</div>

Hello Team I've few files(pdf, and docx) which has question and answers(think of faq's) . size of all the files will be around 500mb. Expected output: when we search something, it searches in all the docs and gives the…

---

## [Retrieving distinct values of a field](https://discuss.elastic.co/t/retrieving-distinct-values-of-a-field/147675)

<div class="topic-metadata">

**Author:** [@chetansk](https://discuss.elastic.co/u/chetansk)\
**Replies:** 1\
**Last updated:** [September 11, 2018, 10:26am UTC](https://discuss.elastic.co/t/retrieving-distinct-values-of-a-field/147675 "2018-09-11T10:26:46Z")

</div>

Hi, I would like to retrieve only the distinct values of a particular field in elasticsearch query. For instance, my search term is resulting into same user multiple times.I would like to have a particular user's info o…

---

## [Failed to load java.lang.IllegalStateException: failed to load plugin class \[org.elasticsearch.xpack.core.XPackPlugin\] and elastic serach certification](https://discuss.elastic.co/t/failed-to-load-java-lang-illegalstateexception-failed-to-load-plugin-class-org-elasticsearch-xpack-core-xpackplugin-and-elastic-serach-certification/148076)

<div class="topic-metadata">

**Author:** [@jyothi\_ca](https://discuss.elastic.co/u/jyothi_ca)\
**Replies:** 3\
**Last updated:** [September 11, 2018, 9:46am UTC](https://discuss.elastic.co/t/failed-to-load-java-lang-illegalstateexception-failed-to-load-plugin-class-org-elasticsearch-xpack-core-xpackplugin-and-elastic-serach-certification/148076 "2018-09-11T09:46:02Z")

</div>

Hello Everyone, Could you please guide me w.r.t to below error message :slight\_smile: , -Dlog4j2.disable.jmx=true, -Djava.io.tmpdir=/tmp/elasticsearch.AY33SMYc, -XX:+HeapDumpOnOutOfMemoryError, -XX:HeapDumpPath=/var/li…

---

## [Elasticsearch failing to start on centos](https://discuss.elastic.co/t/elasticsearch-failing-to-start-on-centos/148075)

<div class="topic-metadata">

**Author:** [@Nikesh](https://discuss.elastic.co/u/Nikesh)\
**Replies:** 2\
**Last updated:** [September 11, 2018, 8:24am UTC](https://discuss.elastic.co/t/elasticsearch-failing-to-start-on-centos/148075 "2018-09-11T08:24:19Z")

</div>

Sep 11 07:35:17 blrsearch.ultria.com systemd\[1\]: elasticsearch.service: main process exited, code=exited, status=1/FAILURE Sep 11 07:35:17 blrsearch.ultria.com systemd\[1\]: Unit elasticsearch.service entered failed state…

---

## [Number of Replicas is always 1 by default](https://discuss.elastic.co/t/number-of-replicas-is-always-1-by-default/148064)

<div class="topic-metadata">

**Author:** [@cawoodm](https://discuss.elastic.co/u/cawoodm)\
**Replies:** 6\
**Last updated:** [September 11, 2018, 8:21am UTC](https://discuss.elastic.co/t/number-of-replicas-is-always-1-by-default/148064 "2018-09-11T08:21:32Z")

</div>

All our indices were "yellow" and we discovered it's because the number of replicas was set to 1. When we update the number of replicas to 0 the indexes are green. Because we periodically re-create our indices and re-in…

---

## [ELK Deployment; CPU,Memory,Disk](https://discuss.elastic.co/t/elk-deployment-cpu-memory-disk/147991)

<div class="topic-metadata">

**Author:** [@saisimo02](https://discuss.elastic.co/u/saisimo02)\
**Replies:** 1\
**Last updated:** [September 11, 2018, 7:50am UTC](https://discuss.elastic.co/t/elk-deployment-cpu-memory-disk/147991 "2018-09-11T07:50:47Z")

</div>

Hello, I would like to deploy Elasticsearch, logstash and kibana in 3 different flavors, the characteristics of each one: o 32vCPU, 384Go RAM et 900Go HDD I would like to supervise 100 servers so approximately 33 serv…

---

## [Delete documents of an index older than 7 days](https://discuss.elastic.co/t/delete-documents-of-an-index-older-than-7-days/148056)

<div class="topic-metadata">

**Author:** [@Divit\_Sharma](https://discuss.elastic.co/u/Divit_Sharma)\
**Replies:** 3\
**Last updated:** [September 11, 2018, 7:30am UTC](https://discuss.elastic.co/t/delete-documents-of-an-index-older-than-7-days/148056 "2018-09-11T07:30:23Z")

</div>

I want to delete documents from my index ''index\_name" which are older than 7 days. The field I want to use is not @timestamp and is another field "date" in that index. I am not sure of the DELETE QUERY. Please help

---

## [How to do Lookup from one index to another index of elasticsearch?](https://discuss.elastic.co/t/how-to-do-lookup-from-one-index-to-another-index-of-elasticsearch/148066)

<div class="topic-metadata">

**Author:** [@yash\_mangla](https://discuss.elastic.co/u/yash_mangla)\
**Replies:** 0\
**Last updated:** [September 11, 2018, 6:59am UTC](https://discuss.elastic.co/t/how-to-do-lookup-from-one-index-to-another-index-of-elasticsearch/148066 "2018-09-11T06:59:55Z")

</div>

Hi Guyz, What is the best way to perform lookup from one elasticsearch index to another elasticsearch index using python script ? How we can do it ? Basically, we have some set of values in a one elasticsearch index an…

---

## [Elasticsearch service keeps failing](https://discuss.elastic.co/t/elasticsearch-service-keeps-failing/148048)

<div class="topic-metadata">

**Author:** [@manuelasticsearch](https://discuss.elastic.co/u/manuelasticsearch)\
**Replies:** 2\
**Last updated:** [September 11, 2018, 6:40am UTC](https://discuss.elastic.co/t/elasticsearch-service-keeps-failing/148048 "2018-09-11T06:40:26Z")

</div>

Hi All, I have implemented EFK in my environment. Kibana and Elasticsearch are installed on a separate instance and Fluentd is configured on my kubernetes cluster. Everything was working perfect. But sometimes my Elast…

---

## [Composite aggs need bucket count](https://discuss.elastic.co/t/composite-aggs-need-bucket-count/148049)

<div class="topic-metadata">

**Author:** [@Dilip\_Kumar](https://discuss.elastic.co/u/Dilip_Kumar)\
**Replies:** 0\
**Last updated:** [September 11, 2018, 5:33am UTC](https://discuss.elastic.co/t/composite-aggs-need-bucket-count/148049 "2018-09-11T05:33:02Z")

</div>

Hi , I have composite query and doing pagination for that need total bucket count, please help=\> my query =\> "size": 0, "aggs": { "campoverview": { "composite": { "sources": \[ { "date": { "date\_histogram": { "…

---

## [Elastic Search Ruby Client](https://discuss.elastic.co/t/elastic-search-ruby-client/148047)

<div class="topic-metadata">

**Author:** [@paul1243](https://discuss.elastic.co/u/paul1243)\
**Replies:** 0\
**Last updated:** [September 11, 2018, 5:28am UTC](https://discuss.elastic.co/t/elastic-search-ruby-client/148047 "2018-09-11T05:28:52Z")

</div>

Hi - We have a cluster with 3 Master/Data nodes, and we have added a client node (with node.master=false,node.data=false). We mostly inject the data using Ruby Client. So we got to use the IP of the elasticsearch to ini…

---

## [Aggregation Sum is very slow](https://discuss.elastic.co/t/aggregation-sum-is-very-slow/148045)

<div class="topic-metadata">

**Author:** [@bruce88](https://discuss.elastic.co/u/bruce88)\
**Replies:** 0\
**Last updated:** [September 11, 2018, 5:17am UTC](https://discuss.elastic.co/t/aggregation-sum-is-very-slow/148045 "2018-09-11T05:17:09Z")

</div>

I have a search on our ES cluster, which has 4 TB, 43 billion docs. { "query": { "bool": { "filter": \[ { "term": { "CustomerID": { "val…

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1550)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1552)
