# Elasticsearch **URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1926 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1927 --- ## [Handling values with a suffix at index time?](https://discuss.elastic.co/t/handling-values-with-a-suffix-at-index-time/103263)
**Author:** [@Maxwell\_Flanders](https://discuss.elastic.co/u/Maxwell_Flanders)\ **Replies:** 0\ **Last updated:** [October 9, 2017, 9:42pm UTC](https://discuss.elastic.co/t/handling-values-with-a-suffix-at-index-time/103263 "2017-10-09T21:42:47Z")
For example, If I have a value, "15kb" that I would like to index as an integer, is there a tool to accommodate for that?? Or would I simply have to handle that before I get to the indexing phase. --- ## [java.nio.channels.OverlappingFileLockException: null](https://discuss.elastic.co/t/java-nio-channels-overlappingfilelockexception-null/103096)
**Author:** [@JJerpseth](https://discuss.elastic.co/u/JJerpseth)\ **Replies:** 3\ **Last updated:** [October 9, 2017, 8:47pm UTC](https://discuss.elastic.co/t/java-nio-channels-overlappingfilelockexception-null/103096 "2017-10-09T20:47:26Z")
Please note: I have already tried the solutions I found online which included 1 -- reboot machine 2 -- delete node.lock in my data areas Node dropped out of the cluster then elasticsearch failed to start with \[2017-1… --- ## [Ingest data problem after x-pack installed](https://discuss.elastic.co/t/ingest-data-problem-after-x-pack-installed/103249)
**Author:** [@Ximeng\_Zhao](https://discuss.elastic.co/u/Ximeng_Zhao)\ **Replies:** 4\ **Last updated:** [October 9, 2017, 8:31pm UTC](https://discuss.elastic.co/t/ingest-data-problem-after-x-pack-installed/103249 "2017-10-09T20:31:17Z")
Hello all, I have installed x-pack on both elasticsearch 5.6.2 and kibana 5.6.2. And I want to write a .json file to the elasticsearch with curl command from terminal. But it fails with following error messages. curl -… --- ## [How does the concept of a Splunk sourcetype within an index translate to ES?](https://discuss.elastic.co/t/how-does-the-concept-of-a-splunk-sourcetype-within-an-index-translate-to-es/103049)
**Author:** [@tjr1775](https://discuss.elastic.co/u/tjr1775)\ **Replies:** 2\ **Last updated:** [October 9, 2017, 7:58pm UTC](https://discuss.elastic.co/t/how-does-the-concept-of-a-splunk-sourcetype-within-an-index-translate-to-es/103049 "2017-10-09T19:58:37Z")
So coming from Splunk, there are various sourcetypes within an index, presumably without the limitations ES has on \_type and the fields needing to be uniform. How does the concept of a sourcetype translate to ES if you h… --- ## [Watcher: ERROR with multiple emails in to/cc fields via template](https://discuss.elastic.co/t/watcher-error-with-multiple-emails-in-to-cc-fields-via-template/100496)
**Author:** [@pabloc](https://discuss.elastic.co/u/pabloc)\ **Replies:** 3\ **Last updated:** [October 9, 2017, 7:46pm UTC](https://discuss.elastic.co/t/watcher-error-with-multiple-emails-in-to-cc-fields-via-template/100496 "2017-10-09T19:46:14Z")
Hello, I'm experiencing the exact problem detailed in the bellow which seems to be closed with no solution. I'm running version 2.4.1. Any news on this? Thank you. --- ## [Empty fields in document and scoring](https://discuss.elastic.co/t/empty-fields-in-document-and-scoring/103253)
**Author:** [@pokaleshrey](https://discuss.elastic.co/u/pokaleshrey)\ **Replies:** 1\ **Last updated:** [October 9, 2017, 7:34pm UTC](https://discuss.elastic.co/t/empty-fields-in-document-and-scoring/103253 "2017-10-09T19:34:29Z")
I many documents in my index and one of them is as below: { employeeName: "James Bond", employeePh: "1234567", postalCode : \[\], address: \[\], country: \[\], } I understand that they should not be there in the first … --- ## [Global locking with ES 5.x](https://discuss.elastic.co/t/global-locking-with-es-5-x/102674)
**Author:** [@jiggly](https://discuss.elastic.co/u/jiggly)\ **Replies:** 3\ **Last updated:** [October 9, 2017, 7:19pm UTC](https://discuss.elastic.co/t/global-locking-with-es-5-x/102674 "2017-10-09T19:19:21Z")
Hi, This page from ES 2.x documentation suggests that it is possible to use ElasticSearch as a global locking source of truth. Is it still reliable in 5.x? As I understand it, it shouldn't be a problem, but I wonder why… --- ## [\[5.3\] Heap details & collection](https://discuss.elastic.co/t/5-3-heap-details-collection/103048)
**Author:** [@ebillaud](https://discuss.elastic.co/u/ebillaud)\ **Replies:** 7\ **Last updated:** [October 9, 2017, 7:18pm UTC](https://discuss.elastic.co/t/5-3-heap-details-collection/103048 "2017-10-09T19:18:20Z")
Hello, I tried to measure the impact of our datamodel on the heap (in terms of non-collectable objects) . Here is what I've done : Wait a long time after last insertion (no segments.index\_writer\_memory); for each type… --- ## [Inherit from AbstractSearchScript in ScriptEngine](https://discuss.elastic.co/t/inherit-from-abstractsearchscript-in-scriptengine/103117)
**Author:** [@ItamarBenjamin](https://discuss.elastic.co/u/ItamarBenjamin)\ **Replies:** 1\ **Last updated:** [October 9, 2017, 5:14pm UTC](https://discuss.elastic.co/t/inherit-from-abstractsearchscript-in-scriptengine/103117 "2017-10-09T17:14:53Z")
Hi, I'm trying to write a custom script engine for elastic search. I noticed elastic comes with AbstractSearchScript class I can extend in order to tune the search. However, this class has a private protected method set… --- ## [Wildcard with exact phrase search using query\_string](https://discuss.elastic.co/t/wildcard-with-exact-phrase-search-using-query-string/102631)
**Author:** [@telebh](https://discuss.elastic.co/u/telebh)\ **Replies:** 6\ **Last updated:** [October 9, 2017, 4:10pm UTC](https://discuss.elastic.co/t/wildcard-with-exact-phrase-search-using-query-string/102631 "2017-10-09T16:10:37Z")
I have issue, I need to run exact search with wildcard using "query\_string". how can i do so? the query looks like this. this query returns "0" results { "query":{ "bool":{ "must":\[ { "match\_phrase":{ "docproperti… --- ## [Update performance - very low indexing rate](https://discuss.elastic.co/t/update-performance-very-low-indexing-rate/103183)
**Author:** [@matw](https://discuss.elastic.co/u/matw)\ **Replies:** 6\ **Last updated:** [October 9, 2017, 2:59pm UTC](https://discuss.elastic.co/t/update-performance-very-low-indexing-rate/103183 "2017-10-09T14:59:15Z")
We're using a redis -\> logstash -\> elasticsearch pipeline Our test system is a single instance installation with 8CPU, 12 GB RAM, running on VMware Currently we can’t separate the components, so no clustering is possib… --- ## [Query which exact matches a search term, but partially matches a different search term](https://discuss.elastic.co/t/query-which-exact-matches-a-search-term-but-partially-matches-a-different-search-term/103239)
**Author:** [@riscado](https://discuss.elastic.co/u/riscado)\ **Replies:** 0\ **Last updated:** [October 9, 2017, 2:28pm UTC](https://discuss.elastic.co/t/query-which-exact-matches-a-search-term-but-partially-matches-a-different-search-term/103239 "2017-10-09T14:28:04Z")
I've been investigating how to do this in a single query, but I'm really struggling to find a way. Let's imagine I have a search term: "wool socks" should exact match to field type which will have a keyword "wool socks"… --- ## [IoT sensors control using ElasticSearch](https://discuss.elastic.co/t/iot-sensors-control-using-elasticsearch/103231)
**Author:** [@pathakhcst](https://discuss.elastic.co/u/pathakhcst)\ **Replies:** 0\ **Last updated:** [October 9, 2017, 1:15pm UTC](https://discuss.elastic.co/t/iot-sensors-control-using-elasticsearch/103231 "2017-10-09T13:15:06Z")
I am trying to control IoT device using ES remotely. Is it possible to send request to MQTT broker/ES client from ES server? --- ## [Delete By Query using Java High Level Rest Client](https://discuss.elastic.co/t/delete-by-query-using-java-high-level-rest-client/102507)
**Author:** [@kumar1993](https://discuss.elastic.co/u/kumar1993)\ **Replies:** 2\ **Last updated:** [October 9, 2017, 12:39pm UTC](https://discuss.elastic.co/t/delete-by-query-using-java-high-level-rest-client/102507 "2017-10-09T12:39:09Z")
Is there a way to achieve delete by query using the java high level rest client ? previously i was using transport client to achieve the same thing, turns out that there is no straight forward way of doing this with the … --- ## [Can't restart elastic search service on debian](https://discuss.elastic.co/t/cant-restart-elastic-search-service-on-debian/103224)
**Author:** [@Nos2016](https://discuss.elastic.co/u/Nos2016)\ **Replies:** 0\ **Last updated:** [October 9, 2017, 12:35pm UTC](https://discuss.elastic.co/t/cant-restart-elastic-search-service-on-debian/103224 "2017-10-09T12:35:27Z")
On my debian VPS, I tried to restart my elasticsearch but it failed. I have no trace on /var/log/elasticsearch.log. I tried also to update my elasticsearch cluster but I received the following (sorry this is in french… --- ## [Some help for a newbie](https://discuss.elastic.co/t/some-help-for-a-newbie/103028)
**Author:** [@mat.bst](https://discuss.elastic.co/u/mat.bst)\ **Replies:** 4\ **Last updated:** [October 9, 2017, 12:33pm UTC](https://discuss.elastic.co/t/some-help-for-a-newbie/103028 "2017-10-09T12:33:09Z")
Hi everyone ! I'm posting today to ask some help with ElasticSearch. I would like use ELK for treat some data from a JSON file but I don't know how organize my ElasticSearch Structure. Below the structure of my JSON d… --- ## [Copying only changed files](https://discuss.elastic.co/t/copying-only-changed-files/103220)
**Author:** [@vishu.kolki](https://discuss.elastic.co/u/vishu.kolki)\ **Replies:** 0\ **Last updated:** [October 9, 2017, 11:48am UTC](https://discuss.elastic.co/t/copying-only-changed-files/103220 "2017-10-09T11:48:55Z")
Hi I am taking snapshot of elasticsearch, everyday it is taking incremental snapshots. But the problem is every time i am moving 300 + Gib of date to other location. It is cost consuming. Can i only move the snapshot a… --- ## [How to know if a particular document has been indexed in primary and all the replicas](https://discuss.elastic.co/t/how-to-know-if-a-particular-document-has-been-indexed-in-primary-and-all-the-replicas/103022)
**Author:** [@aniketkk](https://discuss.elastic.co/u/aniketkk)\ **Replies:** 3\ **Last updated:** [October 9, 2017, 10:16am UTC](https://discuss.elastic.co/t/how-to-know-if-a-particular-document-has-been-indexed-in-primary-and-all-the-replicas/103022 "2017-10-09T10:16:10Z")
I have an elastic search cluster where the replication factor is 2.I want to know if the particular document which has been sent for create or update, has been indexed across the primary as well as all the replicas. Is … --- ## [Tips on Optimization](https://discuss.elastic.co/t/tips-on-optimization/103199)
**Author:** [@aarjan](https://discuss.elastic.co/u/aarjan)\ **Replies:** 9\ **Last updated:** [October 9, 2017, 10:04am UTC](https://discuss.elastic.co/t/tips-on-optimization/103199 "2017-10-09T10:04:44Z")
I have just uploaded 4 years of 4GB data into aws elastic cluster. I have indexed documents by day. Since, i had stuck with default shard size of 5, now it has grown into more than 7300 primary shards. I had also stic… --- ## [How to parse below SQL query to ES?](https://discuss.elastic.co/t/how-to-parse-below-sql-query-to-es/102734)
**Author:** [@kedarsdixit](https://discuss.elastic.co/u/kedarsdixit)\ **Replies:** 9\ **Last updated:** [October 6, 2017, 1:25pm UTC](https://discuss.elastic.co/t/how-to-parse-below-sql-query-to-es/102734 "2017-10-06T13:25:23Z")
I have documents such as: { {id:1, timestamp:123456897} , {id:1, timestamp:123456893}, {id:1, timestamp:123356897} } Suppose I need to get highest time stamp for each id ? (assuming there can be multiple ids and ea… --- ## [Metricbeat logs - INFO Non-zero metrics in the last 30s](https://discuss.elastic.co/t/metricbeat-logs-info-non-zero-metrics-in-the-last-30s/103178)
**Author:** [@JayArthur](https://discuss.elastic.co/u/JayArthur)\ **Replies:** 0\ **Last updated:** [October 9, 2017, 6:19am UTC](https://discuss.elastic.co/t/metricbeat-logs-info-non-zero-metrics-in-the-last-30s/103178 "2017-10-09T06:19:16Z")
@magnusbaeck, Below is a sample log from my metricbeat log. Is everything okay ? How can one go about interpreting such logs ? 2017-10-09T09:15:10+03:00 INFO Non-zero metrics in the last 30s: fetches.system-cpu.events=… --- ## [Elasticsearch Migration Plugin installation steps](https://discuss.elastic.co/t/elasticsearch-migration-plugin-installation-steps/103160)
**Author:** [@Deb](https://discuss.elastic.co/u/Deb)\ **Replies:** 9\ **Last updated:** [October 9, 2017, 5:56am UTC](https://discuss.elastic.co/t/elasticsearch-migration-plugin-installation-steps/103160 "2017-10-09T05:56:51Z")
Cross-posting from stackoverflow In order to upgrade 2.3.z elasticsearch to 5.x, I have successfully installed elasticsearch migration plugin, but when linking to http://localhost:9200/\_plugin/elasticsearch-migration/ I… --- ## [Geo\_point Unindexed](https://discuss.elastic.co/t/geo-point-unindexed/102700)
**Author:** [@karnamonkster](https://discuss.elastic.co/u/karnamonkster)\ **Replies:** 19\ **Last updated:** [October 9, 2017, 4:42am UTC](https://discuss.elastic.co/t/geo-point-unindexed/102700 "2017-10-09T04:42:38Z")
Hi, I am not able to get the geo\_point indexed in the records The field gets converted with correct latitude and longitude fields storing it to location field also gets added successfully Also create a mapping templa… --- ## [Elasticsearch plugin is red (5.2.2)](https://discuss.elastic.co/t/elasticsearch-plugin-is-red-5-2-2/101950)
**Author:** [@thilina\_et.lk](https://discuss.elastic.co/u/thilina_et.lk)\ **Replies:** 4\ **Last updated:** [October 9, 2017, 2:21am UTC](https://discuss.elastic.co/t/elasticsearch-plugin-is-red-5-2-2/101950 "2017-10-09T02:21:47Z")
Hi, I have ElasticSearch running on a remote server. I'm using kibana to access the elasticsearch. But recently i can not access the elastic through kibana or postman but elastic queries are working fine with web applic… --- ## [How can I stop using X-Pack? (official ES 5 Docker image)](https://discuss.elastic.co/t/how-can-i-stop-using-x-pack-official-es-5-docker-image/103108)
**Author:** [@KajMagnus](https://discuss.elastic.co/u/KajMagnus)\ **Replies:** 2\ **Last updated:** [October 9, 2017, 2:17am UTC](https://discuss.elastic.co/t/how-can-i-stop-using-x-pack-official-es-5-docker-image/103108 "2017-10-09T02:17:13Z")
Hi, I use Elasticsearch via the Docker image ( FROM docker.elastic.co/elasticsearch/elasticsearch:5.5.2) and I've attempted to disable all X-Pack stuff. However, E.S. logs warnings every 10 minutes it seems: LICENSE \[… --- ## [Non default x-pack permissions reset to defaults after upgrading from 5.6.1 to 5.6.2](https://discuss.elastic.co/t/non-default-x-pack-permissions-reset-to-defaults-after-upgrading-from-5-6-1-to-5-6-2/103029)
**Author:** [@subzero2118](https://discuss.elastic.co/u/subzero2118)\ **Replies:** 1\ **Last updated:** [October 9, 2017, 1:32am UTC](https://discuss.elastic.co/t/non-default-x-pack-permissions-reset-to-defaults-after-upgrading-from-5-6-1-to-5-6-2/103029 "2017-10-09T01:32:40Z")
Per the subject line, when upgrading from x-pack 5.6.1 to 5.6.2 for elasticsearch, I noticed that my local passwords stopped working. I attempted to access https://IPAddress:9200 with said passwords and they didn't work … --- ## [Unbalanced search performance](https://discuss.elastic.co/t/unbalanced-search-performance/102606)
**Author:** [@avaneeshr](https://discuss.elastic.co/u/avaneeshr)\ **Replies:** 2\ **Last updated:** [October 8, 2017, 7:44pm UTC](https://discuss.elastic.co/t/unbalanced-search-performance/102606 "2017-10-08T19:44:08Z")
Hi! I am using ES v2.4.0 on 5 nodes with a very search query (bool queries) workload, in AWS, using compute optimized servers. I am querying the cluster via a HAProxy Load Balancer which uses roundrobin policy for each… --- ## [ES returns different results (and totals) alternately](https://discuss.elastic.co/t/es-returns-different-results-and-totals-alternately/103157)
**Author:** [@asafo](https://discuss.elastic.co/u/asafo)\ **Replies:** 1\ **Last updated:** [October 8, 2017, 5:18pm UTC](https://discuss.elastic.co/t/es-returns-different-results-and-totals-alternately/103157 "2017-10-08T17:18:15Z")
Hi, could use some help here. Something encountered on our ES 5.4 production cluster (4 nodes) with one of our indices (~500gb) a few days ago - The same exact request to the same server was returning different results … --- ## [How to get document by id (Get API) on a time series multi indexes environment?](https://discuss.elastic.co/t/how-to-get-document-by-id-get-api-on-a-time-series-multi-indexes-environment/103044)
**Author:** [@elia.palme](https://discuss.elastic.co/u/elia.palme)\ **Replies:** 9\ **Last updated:** [October 8, 2017, 4:33pm UTC](https://discuss.elastic.co/t/how-to-get-document-by-id-get-api-on-a-time-series-multi-indexes-environment/103044 "2017-10-08T16:33:23Z")
On a time series multi index environment where a new index is created every month what is the best approach to search for a document by id to ensure the document is unique among all indexes? I came up with two solutions… --- ## [Management threads consuming high CPU on an idle cluster](https://discuss.elastic.co/t/management-threads-consuming-high-cpu-on-an-idle-cluster/103002)
**Author:** [@Itiyama\_Sadana](https://discuss.elastic.co/u/Itiyama_Sadana)\ **Replies:** 13\ **Last updated:** [October 8, 2017, 1:48pm UTC](https://discuss.elastic.co/t/management-threads-consuming-high-cpu-on-an-idle-cluster/103002 "2017-10-08T13:48:17Z")
Cluster details 100 data nodes, 3 dedicated master node Data node JVM : 30 GB on each node Date node cores: 64 Dedicated master core: 64 Data node JVM: 30 GB Cluster data details Total 500TB Shards have a uniform… [Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1925) [Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1927)