# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1645

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1646

---

## [Elasticsearch version conflict](https://discuss.elastic.co/t/elasticsearch-version-conflict/136787)

<div class="topic-metadata">

**Author:** [@surajdalvi](https://discuss.elastic.co/u/surajdalvi)\
**Replies:** 0\
**Last updated:** [June 21, 2018, 5:41am UTC](https://discuss.elastic.co/t/elasticsearch-version-conflict/136787 "2018-06-21T05:41:26Z")

</div>

I have updated document in the Elasticsearch. after update using, I am fetching the same document by using their ID. It is giving me following response: { "\_index": "b123456", "\_type": "documents", "\_id": "bltde56dd…

---

## [Elasticsearch Ingest Opennlp](https://discuss.elastic.co/t/elasticsearch-ingest-opennlp/136459)

<div class="topic-metadata">

**Author:** [@bptec009](https://discuss.elastic.co/u/bptec009)\
**Replies:** 2\
**Last updated:** [June 21, 2018, 5:34am UTC](https://discuss.elastic.co/t/elasticsearch-ingest-opennlp/136459 "2018-06-21T05:34:02Z")

</div>

Hi All, Do we have elasticsearch-ingest-opennlp plugin for Elastic Search Version 5.5.2? This is available for 5.2.0 then 6.2.2 . these both are not supporting for 5.5.2 I have searched but no luck. For Ref . https:/…

---

## [Secure\_Password in ES Keystore for HTTP Exporters](https://discuss.elastic.co/t/secure-password-in-es-keystore-for-http-exporters/136489)

<div class="topic-metadata">

**Author:** [@Dietmar](https://discuss.elastic.co/u/Dietmar)\
**Replies:** 6\
**Last updated:** [June 21, 2018, 5:32am UTC](https://discuss.elastic.co/t/secure-password-in-es-keystore-for-http-exporters/136489 "2018-06-21T05:32:13Z")

</div>

When I set the passphrase for the parameter xpack.monitoring.exporters.admincluster.ssl.keystore.secure\_password in ES-Keestore, an error occurs when starting ES: java.lang.IllegalStateException: password has been cleare…

---

## [INDEX Performance](https://discuss.elastic.co/t/index-performance/136728)

<div class="topic-metadata">

**Author:** [@snigdharao](https://discuss.elastic.co/u/snigdharao)\
**Replies:** 14\
**Last updated:** [June 21, 2018, 5:18am UTC](https://discuss.elastic.co/t/index-performance/136728 "2018-06-21T05:18:47Z")

</div>

We have been trying to move from solr to elastic search and want to compare the performance for indexing 100M records from database. Currently it takes 4 hours to index 52 Million records Current confiuguration: defau…

---

## [Curator Delete indices based on environment variable](https://discuss.elastic.co/t/curator-delete-indices-based-on-environment-variable/136633)

<div class="topic-metadata">

**Author:** [@tweety](https://discuss.elastic.co/u/tweety)\
**Replies:** 4\
**Last updated:** [June 21, 2018, 4:59am UTC](https://discuss.elastic.co/t/curator-delete-indices-based-on-environment-variable/136633 "2018-06-21T04:59:45Z")

</div>

Hi I am trying to delete indices and want to pass unit\_count as a parameter so that we can dynamically decide the unit\_count. {filtertype: age, source: name, direction: older, timestring: '%Y\_%m\_%d', unit: days, unit\_c…

---

## [Map Object in scripted metric aggregation](https://discuss.elastic.co/t/map-object-in-scripted-metric-aggregation/136780)

<div class="topic-metadata">

**Author:** [@Varun\_Somani](https://discuss.elastic.co/u/Varun_Somani)\
**Replies:** 0\
**Last updated:** [June 21, 2018, 2:28am UTC](https://discuss.elastic.co/t/map-object-in-scripted-metric-aggregation/136780 "2018-06-21T02:28:57Z")

</div>

I have the following Reduce Script, which is working fine when I do the query. When I am trying to call the same via Java I get am not able to call "getScriptedMetricAggregation", which is giving me Error when it is tryi…

---

## [Not able to post unicode characters to ES, they show up as question marks](https://discuss.elastic.co/t/not-able-to-post-unicode-characters-to-es-they-show-up-as-question-marks/136769)

<div class="topic-metadata">

**Author:** [@racovarr](https://discuss.elastic.co/u/racovarr)\
**Replies:** 0\
**Last updated:** [June 20, 2018, 10:32pm UTC](https://discuss.elastic.co/t/not-able-to-post-unicode-characters-to-es-they-show-up-as-question-marks/136769 "2018-06-20T22:32:37Z")

</div>

I am storing emails to ES but whenever they have a character not from iso latin like "コニカミノルタ", they get changed to ? in ES: "content": """ ??????? ?? ? ????????????????? I am using the following code to…

---

## [Graylog-web-Interface down problem](https://discuss.elastic.co/t/graylog-web-interface-down-problem/136764)

<div class="topic-metadata">

**Author:** [@Tafsir\_Alam](https://discuss.elastic.co/u/Tafsir_Alam)\
**Replies:** 1\
**Last updated:** [June 20, 2018, 9:42pm UTC](https://discuss.elastic.co/t/graylog-web-interface-down-problem/136764 "2018-06-20T21:42:27Z")

</div>

Hi All, Approx from 10-15 days, I am continuously facing graylog web-interface down problem. First it's slow down and then after it finally went down by throwing 503 error. Here are the logs that I am getting: 2018-06…

---

## [Repeating key impact on disk usage](https://discuss.elastic.co/t/repeating-key-impact-on-disk-usage/135763)

<div class="topic-metadata">

**Author:** [@aurimas](https://discuss.elastic.co/u/aurimas)\
**Replies:** 6\
**Last updated:** [June 20, 2018, 9:33pm UTC](https://discuss.elastic.co/t/repeating-key-impact-on-disk-usage/135763 "2018-06-20T21:33:29Z")

</div>

Hi, I am writing to Elasticsearch network devices performance data. Index size per 24 hours is 250227929 documents which sums up to 32 Gb of disk space. I am looking into possibilities to reduce disco usage. Document…

---

## [How to wait for asynch requests to finish](https://discuss.elastic.co/t/how-to-wait-for-asynch-requests-to-finish/136569)

<div class="topic-metadata">

**Author:** [@Roman\_G](https://discuss.elastic.co/u/Roman_G)\
**Replies:** 5\
**Last updated:** [June 20, 2018, 7:42pm UTC](https://discuss.elastic.co/t/how-to-wait-for-asynch-requests-to-finish/136569 "2018-06-20T19:42:25Z")

</div>

I am using bulk request to insert/update data in Elastic, I send a bunch of asynch requests with 10k documents in each one. What I want to do is at the end of the process to wait for each request to finish to make sure …

---

## [Elastic search Cluster auto fail over](https://discuss.elastic.co/t/elastic-search-cluster-auto-fail-over/136678)

<div class="topic-metadata">

**Author:** [@aneesh](https://discuss.elastic.co/u/aneesh)\
**Replies:** 1\
**Last updated:** [June 20, 2018, 7:08pm UTC](https://discuss.elastic.co/t/elastic-search-cluster-auto-fail-over/136678 "2018-06-20T19:08:44Z")

</div>

we have configured cluster of 2 boxes where both nodes will be master-eligible and data nodes and only one node will be playing the role of master node. But we can still query getting them processed on any of nodes. if…

---

## [No\_match\_size does not work](https://discuss.elastic.co/t/no-match-size-does-not-work/136749)

<div class="topic-metadata">

**Author:** [@totessusan](https://discuss.elastic.co/u/totessusan)\
**Replies:** 0\
**Last updated:** [June 20, 2018, 6:23pm UTC](https://discuss.elastic.co/t/no-match-size-does-not-work/136749 "2018-06-20T18:23:44Z")

</div>

I want to return the first n characters of the field if nothing returns from the highlight query - this should technically be covered by the no\_match\_size functionality, but it doesn't seem to be working. no\_match\_size …

---

## [Multipe keystores on the same machine](https://discuss.elastic.co/t/multipe-keystores-on-the-same-machine/136578)

<div class="topic-metadata">

**Author:** [@Thomas\_Doman](https://discuss.elastic.co/u/Thomas_Doman)\
**Replies:** 2\
**Last updated:** [June 20, 2018, 6:05pm UTC](https://discuss.elastic.co/t/multipe-keystores-on-the-same-machine/136578 "2018-06-20T18:05:09Z")

</div>

ES: 6.1.1 OS: Microsoft Windows Server 2016 Datacenter I'm running two different clusters on 3 VMs where the two clusters share only the computing space and the C: drive where the executables are located. Each node in…

---

## [Performance Windows x Linux](https://discuss.elastic.co/t/performance-windows-x-linux/136685)

<div class="topic-metadata">

**Author:** [@Marcos\_Felix](https://discuss.elastic.co/u/Marcos_Felix)\
**Replies:** 2\
**Last updated:** [June 20, 2018, 5:57pm UTC](https://discuss.elastic.co/t/performance-windows-x-linux/136685 "2018-06-20T17:57:23Z")

</div>

Is there any performance differences between Windows and Linux? Will ELK operate the same across different OS? Also.... I saw that ELK is free of cost, are we given a certain amount of memory? what do we do if we want t…

---

## [Force merge on read\_only index yields error](https://discuss.elastic.co/t/force-merge-on-read-only-index-yields-error/136528)

<div class="topic-metadata">

**Author:** [@reswob](https://discuss.elastic.co/u/reswob)\
**Replies:** 1\
**Last updated:** [June 20, 2018, 5:46pm UTC](https://discuss.elastic.co/t/force-merge-on-read-only-index-yields-error/136528 "2018-06-20T17:46:28Z")

</div>

I'm looking to manage some of our old indices by making them read only and force merging them down to one segment. According to https://www.elastic.co/guide/en/elasticsearch/reference/current/indices-forcemerge.html I…

---

## [Unable to create PreBuiltXPackTransportClient client x-pack](https://discuss.elastic.co/t/unable-to-create-prebuiltxpacktransportclient-client-x-pack/135384)

<div class="topic-metadata">

**Author:** [@ksuthar](https://discuss.elastic.co/u/ksuthar)\
**Replies:** 1\
**Last updated:** [June 20, 2018, 5:43pm UTC](https://discuss.elastic.co/t/unable-to-create-prebuiltxpacktransportclient-client-x-pack/135384 "2018-06-20T17:43:56Z")

</div>

I am working on x-pack watcher. I have added dependency of x-pack. org.elasticsearch.client x-pack-transport 5.3.3 org.apache.logging.log4j log4j-api 2.7 org.apache.logging.log4j lo…

---

## [Many indexes vs many shards](https://discuss.elastic.co/t/many-indexes-vs-many-shards/136581)

<div class="topic-metadata">

**Author:** [@brazabr](https://discuss.elastic.co/u/brazabr)\
**Replies:** 3\
**Last updated:** [June 20, 2018, 5:42pm UTC](https://discuss.elastic.co/t/many-indexes-vs-many-shards/136581 "2018-06-20T17:42:18Z")

</div>

Hi everyone, I've been using Elasticsearch as a transactional data search engine and it's working well. But now I am designing the next iteration of our platform and I could use some help of more expert users. Our sear…

---

## [Looking for something similar to Elasticsearch slop](https://discuss.elastic.co/t/looking-for-something-similar-to-elasticsearch-slop/136742)

<div class="topic-metadata">

**Author:** [@gabygoldberg](https://discuss.elastic.co/u/gabygoldberg)\
**Replies:** 0\
**Last updated:** [June 20, 2018, 5:11pm UTC](https://discuss.elastic.co/t/looking-for-something-similar-to-elasticsearch-slop/136742 "2018-06-20T17:11:32Z")

</div>

I'm new to Elasticsearch and just learned about the "slop" feature. Are there similar features like slop in other languages (ideally PHP but open to learning about anything)? Essentially, I'm looking for something that …

---

## [X-Pack Watcher -- adding additional fields](https://discuss.elastic.co/t/x-pack-watcher-adding-additional-fields/135068)

<div class="topic-metadata">

**Author:** [@anhlon](https://discuss.elastic.co/u/anhlon)\
**Replies:** 1\
**Last updated:** [June 20, 2018, 5:07pm UTC](https://discuss.elastic.co/t/x-pack-watcher-adding-additional-fields/135068 "2018-06-20T17:07:35Z")

</div>

Hi, I am trying to setup a Watcher to send alerts to Slack when a service is down for the last minute. What I currently have is heartbeat collecting http ping data and sending it to Elasticsearch and all is well. I ha…

---

## [Query boost issues](https://discuss.elastic.co/t/query-boost-issues/136704)

<div class="topic-metadata">

**Author:** [@Realz](https://discuss.elastic.co/u/Realz)\
**Replies:** 1\
**Last updated:** [June 20, 2018, 3:55pm UTC](https://discuss.elastic.co/t/query-boost-issues/136704 "2018-06-20T15:55:35Z")

</div>

Hello, i have some issues with query boosting, here is my search request in PHP: $params = \[ 'index' =\> 'formations', 'type' =\> 'all', "from" =\> 0, "size" =\> 40, "body" =\> \[ …

---

## [REST SearchSourceBuilder-Unknowed Named Object](https://discuss.elastic.co/t/rest-searchsourcebuilder-unknowed-named-object/136726)

<div class="topic-metadata">

**Author:** [@questar](https://discuss.elastic.co/u/questar)\
**Replies:** 0\
**Last updated:** [June 20, 2018, 3:49pm UTC](https://discuss.elastic.co/t/rest-searchsourcebuilder-unknowed-named-object/136726 "2018-06-20T15:49:00Z")

</div>

Working with query constrained aggs via SearchSourceBuilder as documented at: \[Java high level rest client: how to deal with aggregations?\] This works within Java, but generates the following error when executed via CU…

---

## [Nginx setup for xpack enabled elastic cluster](https://discuss.elastic.co/t/nginx-setup-for-xpack-enabled-elastic-cluster/135661)

<div class="topic-metadata">

**Author:** [@Muj33b](https://discuss.elastic.co/u/Muj33b)\
**Replies:** 2\
**Last updated:** [June 20, 2018, 3:16pm UTC](https://discuss.elastic.co/t/nginx-setup-for-xpack-enabled-elastic-cluster/135661 "2018-06-20T15:16:53Z")

</div>

Hi, We've got an ES cluster on GCP, it is 5-3-2 (Data-Master-Client) nodes running on docker containers with X-pack enabled. We want to add nginx load balancer in front of it. It is similar to Connect Kibana to Nginx l…

---

## [How to Monitor List of Host not reporting logs to elasticsearch?](https://discuss.elastic.co/t/how-to-monitor-list-of-host-not-reporting-logs-to-elasticsearch/136717)

<div class="topic-metadata">

**Author:** [@addanuj](https://discuss.elastic.co/u/addanuj)\
**Replies:** 2\
**Last updated:** [June 20, 2018, 2:58pm UTC](https://discuss.elastic.co/t/how-to-monitor-list-of-host-not-reporting-logs-to-elasticsearch/136717 "2018-06-20T14:58:12Z")

</div>

I need to monitor a List of Host \[IP Address List\] those are not reporting logs to elasticsearch, please suggest a better way to achieve it. i just want to get an alert if any of the host "In a List" not sending logs to…

---

## [Elasticsearch 6.3: elasticsearch-keystore add not accepting stdin](https://discuss.elastic.co/t/elasticsearch-6-3-elasticsearch-keystore-add-not-accepting-stdin/136577)

<div class="topic-metadata">

**Author:** [@Justin\_Wells](https://discuss.elastic.co/u/Justin_Wells)\
**Replies:** 2\
**Last updated:** [June 20, 2018, 2:36pm UTC](https://discuss.elastic.co/t/elasticsearch-6-3-elasticsearch-keystore-add-not-accepting-stdin/136577 "2018-06-20T14:36:49Z")

</div>

We had some Ansible automation break when going to Elasticsearch 6.3. The ./elasticsearch-keystore add command now prompts before overwriting a value. I've attempted to suppress this using the --stdin and --silent flags …

---

## [Indexing on SSD vs HDD hardisk](https://discuss.elastic.co/t/indexing-on-ssd-vs-hdd-hardisk/136620)

<div class="topic-metadata">

**Author:** [@Tahir\_Ahmad](https://discuss.elastic.co/u/Tahir_Ahmad)\
**Replies:** 7\
**Last updated:** [June 20, 2018, 2:20pm UTC](https://discuss.elastic.co/t/indexing-on-ssd-vs-hdd-hardisk/136620 "2018-06-20T14:20:02Z")

</div>

I am indexing a csv file on a Dell system(Ubuntu 16) with HDD hardisk and it takes 3 hours to index it. However I also indexed the same csv file on Macpro with SSD hardisk and it took 15 minutes to index the same. Is thi…

---

## [Calculate time difference between two different record timestamps](https://discuss.elastic.co/t/calculate-time-difference-between-two-different-record-timestamps/136545)

<div class="topic-metadata">

**Author:** [@harish\_c](https://discuss.elastic.co/u/harish_c)\
**Replies:** 2\
**Last updated:** [June 20, 2018, 2:02pm UTC](https://discuss.elastic.co/t/calculate-time-difference-between-two-different-record-timestamps/136545 "2018-06-20T14:02:15Z")

</div>

So I am logging a bunch of logs of a big and mediumly complex workflow. This workflow is a graph and can take different paths based on the inputs or a particular workflow step's output. When the workflow is created a wor…

---

## [Elasticsearch + Kibana: Copy value of scripted field to real field?](https://discuss.elastic.co/t/elasticsearch-kibana-copy-value-of-scripted-field-to-real-field/136306)

<div class="topic-metadata">

**Author:** [@atom](https://discuss.elastic.co/u/atom)\
**Replies:** 1\
**Last updated:** [June 20, 2018, 1:47pm UTC](https://discuss.elastic.co/t/elasticsearch-kibana-copy-value-of-scripted-field-to-real-field/136306 "2018-06-20T13:47:32Z")

</div>

Hi there, is there a possibility to convert a scripted field value to a real elasticsearch field? Or is there a chance to copy the scripted field value to a new created elasticsearch field?

---

## [Copy field and convert to lowercase](https://discuss.elastic.co/t/copy-field-and-convert-to-lowercase/136301)

<div class="topic-metadata">

**Author:** [@atom](https://discuss.elastic.co/u/atom)\
**Replies:** 1\
**Last updated:** [June 20, 2018, 1:47pm UTC](https://discuss.elastic.co/t/copy-field-and-convert-to-lowercase/136301 "2018-06-20T13:47:02Z")

</div>

Hi There, in all of my indices i have a field that i want to copy to a new field and convert it to lowercase. Copying was easy: POST /INDEX-2018.06.07/\_update\_by\_query?conflicts=proceed&refresh=true { "query" …

---

## [ElasticSearch, ingest-attachment error - Validation Failed: 1: source is missing;2: content type is missing](https://discuss.elastic.co/t/elasticsearch-ingest-attachment-error-validation-failed-1-source-is-missing-2-content-type-is-missing/136705)

<div class="topic-metadata">

**Author:** [@kartsh](https://discuss.elastic.co/u/kartsh)\
**Replies:** 0\
**Last updated:** [June 20, 2018, 1:40pm UTC](https://discuss.elastic.co/t/elasticsearch-ingest-attachment-error-validation-failed-1-source-is-missing-2-content-type-is-missing/136705 "2018-06-20T13:40:14Z")

</div>

Am trying to indexing my pdf file from local path via java code. During indexing am getting the below error. Exception in thread "main" org.elasticsearch.action.ActionRequestValidationException: Validation Failed: 1: so…

---

## [Can't find : ~/.curator](https://discuss.elastic.co/t/cant-find-curator/136630)

<div class="topic-metadata">

**Author:** [@asalma](https://discuss.elastic.co/u/asalma)\
**Replies:** 2\
**Last updated:** [June 20, 2018, 1:33pm UTC](https://discuss.elastic.co/t/cant-find-curator/136630 "2018-06-20T13:33:51Z")

</div>

Hi, I please I already install curator in a server and I had put curator.yml in : ~/.curator/curator.yml But in this new server I can't find the path I have just this : /usr/bin/curator /opt/elasticsearch-curator/lib…

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1644)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1646)
