# Elasticsearch **URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1499 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1500 --- ## [X-pack security enabled fails to start elastic search](https://discuss.elastic.co/t/x-pack-security-enabled-fails-to-start-elastic-search/154705)
**Author:** [@shiv94](https://discuss.elastic.co/u/shiv94)\ **Replies:** 2\ **Last updated:** [October 31, 2018, 12:29pm UTC](https://discuss.elastic.co/t/x-pack-security-enabled-fails-to-start-elastic-search/154705 "2018-10-31T12:29:08Z")
Enabling x-pack.security fails to connect to elastic search and closes the elastic search connection by throwing the following error \[2018-10-30T12:54:36,196\]\[INFO \]\[o.e.n.Node \] \[elk\] initialized \[2018-1… --- ## [New node is not getting added to the cluster](https://discuss.elastic.co/t/new-node-is-not-getting-added-to-the-cluster/154769)
**Author:** [@Eva](https://discuss.elastic.co/u/Eva)\ **Replies:** 9\ **Last updated:** [October 31, 2018, 12:21pm UTC](https://discuss.elastic.co/t/new-node-is-not-getting-added-to-the-cluster/154769 "2018-10-31T12:21:35Z")
Hello there I have a test cluster on aws ami with one node and i'm trying to add a new node to the same cluster and have installed elasticsearch of same version as in node 1, on an other aws instance. Below are my node… --- ## [Elastic Search to Monitor and store data from client side machine](https://discuss.elastic.co/t/elastic-search-to-monitor-and-store-data-from-client-side-machine/153723)
**Author:** [@somu\_p](https://discuss.elastic.co/u/somu_p)\ **Replies:** 4\ **Last updated:** [October 31, 2018, 12:04pm UTC](https://discuss.elastic.co/t/elastic-search-to-monitor-and-store-data-from-client-side-machine/153723 "2018-10-31T12:04:41Z")
i am new to ES i would like to monitor 100000 endpoint with Metric Beats. Can you please help me with below question: Can i monitor 100000 system with beats. is it possible? can i store those data to Elastic search, s… --- ## [How to read/write to Elasticsearch with Apache Spark with scala](https://discuss.elastic.co/t/how-to-read-write-to-elasticsearch-with-apache-spark-with-scala/154703)
**Author:** [@m\_5amy](https://discuss.elastic.co/u/m_5amy)\ **Replies:** 2\ **Last updated:** [October 31, 2018, 11:50am UTC](https://discuss.elastic.co/t/how-to-read-write-to-elasticsearch-with-apache-spark-with-scala/154703 "2018-10-31T11:50:01Z")
How to read/write to Elasticsearch with Apache Spark with scala Elasticsearch version 5 Spark version 2.2 Any Help ? --- ## [Timezone-affected date histogram](https://discuss.elastic.co/t/timezone-affected-date-histogram/154822)
**Author:** [@Vorta](https://discuss.elastic.co/u/Vorta)\ **Replies:** 2\ **Last updated:** [October 31, 2018, 11:47am UTC](https://discuss.elastic.co/t/timezone-affected-date-histogram/154822 "2018-10-31T11:47:27Z")
Hello! I have a following query coming from PHP: { "size": 0, "aggs": { "statuses\_histogram": { "date\_histogram": { "field": "created\_at", "interval": "1d", "min\_doc\_count": 0, … --- ## [Does Elasticsearch support transactional matters?](https://discuss.elastic.co/t/does-elasticsearch-support-transactional-matters/154800)
**Author:** [@hym](https://discuss.elastic.co/u/hym)\ **Replies:** 1\ **Last updated:** [October 31, 2018, 10:14am UTC](https://discuss.elastic.co/t/does-elasticsearch-support-transactional-matters/154800 "2018-10-31T10:14:01Z")
Hi all, is there any mechanism supported by elasticsearch for doing some operations in an Atomic way? Example1: Having two indices in place and you want to assign an alias per each (two different aliases) but in an At… --- ## [Autocomplete on many fields, sorted and without duplicates](https://discuss.elastic.co/t/autocomplete-on-many-fields-sorted-and-without-duplicates/154786)
**Author:** [@jlp1](https://discuss.elastic.co/u/jlp1)\ **Replies:** 0\ **Last updated:** [October 31, 2018, 9:28am UTC](https://discuss.elastic.co/t/autocomplete-on-many-fields-sorted-and-without-duplicates/154786 "2018-10-31T09:28:14Z")
I have a index with products containing fields like: product name, category, product id, product description etc. I want to have autocomplete feature that lists a product name, category, product id in specific order and… --- ## [How to create aggregated test reports from Cucumber JSON files](https://discuss.elastic.co/t/how-to-create-aggregated-test-reports-from-cucumber-json-files/154770)
**Author:** [@ashis](https://discuss.elastic.co/u/ashis)\ **Replies:** 3\ **Last updated:** [October 31, 2018, 9:28am UTC](https://discuss.elastic.co/t/how-to-create-aggregated-test-reports-from-cucumber-json-files/154770 "2018-10-31T09:28:01Z")
Hi, I am pretty new to this, I have got Elasticsearch, Logstash and Kibana installed and running successfully. My requirement is, I have a test report generated by Cucumber in JSON format for each run. I want to creat… --- ## [Elastic aggregation search result filters](https://discuss.elastic.co/t/elastic-aggregation-search-result-filters/154784)
**Author:** [@Baikal\_Irkutsk](https://discuss.elastic.co/u/Baikal_Irkutsk)\ **Replies:** 0\ **Last updated:** [October 31, 2018, 9:25am UTC](https://discuss.elastic.co/t/elastic-aggregation-search-result-filters/154784 "2018-10-31T09:25:19Z")
Hello everyone We have index mapping like that: { "test2": { "mappings": { "products": { "properties": { "category": { "properties": { "id": { "type": "long" }, "name":… --- ## [How to auto index parent document](https://discuss.elastic.co/t/how-to-auto-index-parent-document/154780)
**Author:** [@luzhzhsoft](https://discuss.elastic.co/u/luzhzhsoft)\ **Replies:** 1\ **Last updated:** [October 31, 2018, 9:12am UTC](https://discuss.elastic.co/t/how-to-auto-index-parent-document/154780 "2018-10-31T09:12:11Z")
When use join type .we need create parent document first.But index may be auto created by template .such as index by day.So when create a new index,we need get old parent data from old index,and index it to new index . … --- ## [How to transform indexed fields that appear in UTF-8 to unicode?](https://discuss.elastic.co/t/how-to-transform-indexed-fields-that-appear-in-utf-8-to-unicode/154756)
**Author:** [@abuameen](https://discuss.elastic.co/u/abuameen)\ **Replies:** 1\ **Last updated:** [October 31, 2018, 9:03am UTC](https://discuss.elastic.co/t/how-to-transform-indexed-fields-that-appear-in-utf-8-to-unicode/154756 "2018-10-31T09:03:30Z")
Hi, were using Bro IDS with elastic-search and kafka. however some indexed fields are in arabic but they appear in a utf-8 format like this. قس٠التعيين - إدارة الإختيار والتعيين is ther… --- ## [Bulk Reindexing](https://discuss.elastic.co/t/bulk-reindexing/154723)
**Author:** [@wwalker](https://discuss.elastic.co/u/wwalker)\ **Replies:** 1\ **Last updated:** [October 31, 2018, 8:49am UTC](https://discuss.elastic.co/t/bulk-reindexing/154723 "2018-10-31T08:49:50Z")
I have a field that I discovered has been recording values as both uppercase and lowercase. This is causing issues in Kibana data tables as they see Example as being different from example. I've corrected the issue in … --- ## [Performance drops significantly when Concurrent Stored Scripted updates are running](https://discuss.elastic.co/t/performance-drops-significantly-when-concurrent-stored-scripted-updates-are-running/154695)
**Author:** [@kant\_kodali](https://discuss.elastic.co/u/kant_kodali)\ **Replies:** 1\ **Last updated:** [October 31, 2018, 8:44am UTC](https://discuss.elastic.co/t/performance-drops-significantly-when-concurrent-stored-scripted-updates-are-running/154695 "2018-10-31T08:44:58Z")
what's going on? especially when the same stored script is used to upsert into different indices? --- ## [Search on word/pdf files using rest high level client](https://discuss.elastic.co/t/search-on-word-pdf-files-using-rest-high-level-client/154766)
**Author:** [@Anjana\_Surendrababu](https://discuss.elastic.co/u/Anjana_Surendrababu)\ **Replies:** 1\ **Last updated:** [October 31, 2018, 8:42am UTC](https://discuss.elastic.co/t/search-on-word-pdf-files-using-rest-high-level-client/154766 "2018-10-31T08:42:10Z")
I am using Elasticsearch Java REST High Level Client 6.4 in my project. I am giving search option for Knowledge module. While creating a knowledge I am creating a document with the following properties Id,Title,Descript… --- ## [Does Reindex From Remote require storing \_source in the source index (indices)?](https://discuss.elastic.co/t/does-reindex-from-remote-require-storing-source-in-the-source-index-indices/154507)
**Author:** [@khyron4eva](https://discuss.elastic.co/u/khyron4eva)\ **Replies:** 3\ **Last updated:** [October 31, 2018, 8:04am UTC](https://discuss.elastic.co/t/does-reindex-from-remote-require-storing-source-in-the-source-index-indices/154507 "2018-10-31T08:04:31Z")
Simple question: Can anyone confirm the necessity of storing \_source in the source indices in order to make Reindex From Remote work successfully? Is storing \_source required or not for Reindex From Remote? Cheers! --- ## [Migration plugin](https://discuss.elastic.co/t/migration-plugin/153562)
**Author:** [@gphadke](https://discuss.elastic.co/u/gphadke)\ **Replies:** 3\ **Last updated:** [October 31, 2018, 7:43am UTC](https://discuss.elastic.co/t/migration-plugin/153562 "2018-10-31T07:43:43Z")
Hello I have used the migration plugin earlier while upgrading between ES versions. I am not sure if there is any such plugin to help migrate to ES 6.x. Can anyone please point me to it if it exists? If not, is there a… --- ## [Decrease score over time](https://discuss.elastic.co/t/decrease-score-over-time/154735)
**Author:** [@pandronu](https://discuss.elastic.co/u/pandronu)\ **Replies:** 2\ **Last updated:** [October 31, 2018, 6:52am UTC](https://discuss.elastic.co/t/decrease-score-over-time/154735 "2018-10-31T06:52:20Z")
Hi. I've got a 'post' index, which has a 'createdAt' date field. I'm trying to create a query that will return all posts, however, it should apply negative scoring for every day from now to the past. So, if a post was… --- ## [How does master election process takes place when multiple master eligible nodes are present?](https://discuss.elastic.co/t/how-does-master-election-process-takes-place-when-multiple-master-eligible-nodes-are-present/154431)
**Author:** [@nikhil.k](https://discuss.elastic.co/u/nikhil.k)\ **Replies:** 6\ **Last updated:** [October 31, 2018, 6:22am UTC](https://discuss.elastic.co/t/how-does-master-election-process-takes-place-when-multiple-master-eligible-nodes-are-present/154431 "2018-10-31T06:22:21Z")
Hi Everyone, Elasticsearch Version-5.4.3 I want to know how master election process takes place when multiple nodes are present? Suppose, there are 5 elasticsearch nodes (all are master eligible nodes) present in a cl… --- ## [Incorrect month in Elasticsearch date\_histogram](https://discuss.elastic.co/t/incorrect-month-in-elasticsearch-date-histogram/154561)
**Author:** [@alinaqi306](https://discuss.elastic.co/u/alinaqi306)\ **Replies:** 4\ **Last updated:** [October 31, 2018, 6:20am UTC](https://discuss.elastic.co/t/incorrect-month-in-elasticsearch-date-histogram/154561 "2018-10-31T06:20:39Z")
My Document looks like below: { "\_index": "rep\_cdr", "\_type": "doc", "\_id": "TaArd2YBDRXNehCp7GmW", "\_score": 1, "\_source": { "level": "info", "@version": "1", "thirdPartyTime": 139… --- ## [ES 6.2.3 performance issues vs ES 2.3.4](https://discuss.elastic.co/t/es-6-2-3-performance-issues-vs-es-2-3-4/152598)
**Author:** [@SKJ](https://discuss.elastic.co/u/SKJ)\ **Replies:** 12\ **Last updated:** [October 31, 2018, 3:59am UTC](https://discuss.elastic.co/t/es-6-2-3-performance-issues-vs-es-2-3-4/152598 "2018-10-31T03:59:04Z")
We are facing severe performance issue with ES 6.2.3 in comparison to ES 2.3.4. Not sure, what we are missing. We were planning to shift to ES6 and have setup a new 6.2.3 cluster with 20 m5d.4xlarge data, 9 m5.4xlarge cl… --- ## [ElasticSearch6.4 compatible web crawler](https://discuss.elastic.co/t/elasticsearch6-4-compatible-web-crawler/154619)
**Author:** [@Subasini](https://discuss.elastic.co/u/Subasini)\ **Replies:** 3\ **Last updated:** [October 31, 2018, 4:49am UTC](https://discuss.elastic.co/t/elasticsearch6-4-compatible-web-crawler/154619 "2018-10-31T04:49:56Z")
Hi All, I want to use ElasticSearch 6.4 as I am going to replace GSA in my application. ElasticSearch will crawl around 60+ websites including child links. Since we are not going to use Cloud based solution - Can I u… --- ## [Failed to bind to \[9300-9400\]](https://discuss.elastic.co/t/failed-to-bind-to-9300-9400/153294)
**Author:** [@mikygee](https://discuss.elastic.co/u/mikygee)\ **Replies:** 3\ **Last updated:** [October 31, 2018, 12:05am UTC](https://discuss.elastic.co/t/failed-to-bind-to-9300-9400/153294 "2018-10-31T00:05:19Z")
Hello, I reinstalled elastic search and I'm not able to start it \[2018-10-21T19:41:44,265\]\[INFO \]\[o.e.n.Node \] \[\] initializing ... \[2018-10-21T19:41:44,383\]\[INFO \]\[o.e.e.NodeEnvironment \] \[-6v8xhD\] usi… --- ## [Upgrading Elasticsearch cluster](https://discuss.elastic.co/t/upgrading-elasticsearch-cluster/154726)
**Author:** [@lcui\_dxc](https://discuss.elastic.co/u/lcui_dxc)\ **Replies:** 5\ **Last updated:** [October 30, 2018, 10:27pm UTC](https://discuss.elastic.co/t/upgrading-elasticsearch-cluster/154726 "2018-10-30T22:27:21Z")
Hello there, We are trying to upgrade our ELK from 6.3.2 to 6.4.2. It seems we can use rolling upgrades... The first step would be to disable shard allocation, here we encounter an issue: here is what I did and got … --- ## [How access nested array field from wmibeat](https://discuss.elastic.co/t/how-access-nested-array-field-from-wmibeat/154707)
**Author:** [@fionamacd](https://discuss.elastic.co/u/fionamacd)\ **Replies:** 2\ **Last updated:** [October 30, 2018, 10:20pm UTC](https://discuss.elastic.co/t/how-access-nested-array-field-from-wmibeat/154707 "2018-10-30T22:20:12Z")
Hi, I am sending wmibeat to logstash and want to change the value of the field returned from string to number. I would normally do this with a mutate or grok in filter section, but I can't seem to get the field parsed c… --- ## [Variable \[state\] is not defined](https://discuss.elastic.co/t/variable-state-is-not-defined/154728)
**Author:** [@robinsonmhj](https://discuss.elastic.co/u/robinsonmhj)\ **Replies:** 2\ **Last updated:** [October 30, 2018, 10:08pm UTC](https://discuss.elastic.co/t/variable-state-is-not-defined/154728 "2018-10-30T22:08:51Z")
Hi Guys, I was playing with elastic search "Scripted Metric Aggregation", I get the error like this { "error": { "root\_cause": \[ { "type": "script\_exception", "reason": "compile error", "script\_stack": \[ "state.… --- ## [Curated POD's are creating and not removing automaticaly](https://discuss.elastic.co/t/curated-pods-are-creating-and-not-removing-automaticaly/154714)
**Author:** [@saravanakumar\_rajend](https://discuss.elastic.co/u/saravanakumar_rajend)\ **Replies:** 1\ **Last updated:** [October 30, 2018, 9:35pm UTC](https://discuss.elastic.co/t/curated-pods-are-creating-and-not-removing-automaticaly/154714 "2018-10-30T21:35:09Z")
Elastic Search curator pod's are creating and not deleted automatically when elastic search curator POD are creating and what is the need for that and how to remove automatically from kubernetes. waxen-kudu-elasticsearc… --- ## [Elasticsearch is consumig more memory](https://discuss.elastic.co/t/elasticsearch-is-consumig-more-memory/154713)
**Author:** [@saravanakumar\_rajend](https://discuss.elastic.co/u/saravanakumar_rajend)\ **Replies:** 0\ **Last updated:** [October 30, 2018, 6:52pm UTC](https://discuss.elastic.co/t/elasticsearch-is-consumig-more-memory/154713 "2018-10-30T18:52:32Z")
I have deployed elasticseach on kuberentes and which is consuming more memory, is there any particular reason why it's consuming more memory, and how to come out from this high memory utilization issue, please let me kno… --- ## [Persistant mapping after deleting index (SOLVED - it was a template) \[noob\]](https://discuss.elastic.co/t/persistant-mapping-after-deleting-index-solved-it-was-a-template-noob/154613)
**Author:** [@dmnc](https://discuss.elastic.co/u/dmnc)\ **Replies:** 1\ **Last updated:** [October 30, 2018, 8:53pm UTC](https://discuss.elastic.co/t/persistant-mapping-after-deleting-index-solved-it-was-a-template-noob/154613 "2018-10-30T20:53:47Z")
Hi, I'm learning to ES and Logstash, and because I need to plot geopoints to the map, I've somehow created this mapping: { "mapping": { "\_doc": { "properties": { "location": { "type": "geo… --- ## [Log issue with upgrade from 5.6.8 to 6.3.2](https://discuss.elastic.co/t/log-issue-with-upgrade-from-5-6-8-to-6-3-2/154708)
**Author:** [@wazzu62](https://discuss.elastic.co/u/wazzu62)\ **Replies:** 1\ **Last updated:** [October 30, 2018, 8:24pm UTC](https://discuss.elastic.co/t/log-issue-with-upgrade-from-5-6-8-to-6-3-2/154708 "2018-10-30T20:24:28Z")
Trying to do an upgrade on centos7 I have path.logs defined in my yml file as path.logs: /var/log/elasticsearch but logs seem to be written to /usr/share/elasticsearch/${sys:es.logs}.log Any ideas? --- ## [How is sharding implemented?](https://discuss.elastic.co/t/how-is-sharding-implemented/154716)
**Author:** [@sm6405](https://discuss.elastic.co/u/sm6405)\ **Replies:** 1\ **Last updated:** [October 30, 2018, 7:27pm UTC](https://discuss.elastic.co/t/how-is-sharding-implemented/154716 "2018-10-30T19:27:04Z")
I was wondering about the specific implementation of sharding within elasticsearch. I read many of the blog posts that state that the default value for sharding is 5 shards per index, however I was wondering about the pr… [Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1498) [Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1500)