# Elasticsearch **URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1797 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1798 --- ## [Move shards from one host to another](https://discuss.elastic.co/t/move-shards-from-one-host-to-another/118945)
**Author:** [@fhalde](https://discuss.elastic.co/u/fhalde)\ **Replies:** 4\ **Last updated:** [February 8, 2018, 2:37am UTC](https://discuss.elastic.co/t/move-shards-from-one-host-to-another/118945 "2018-02-08T02:37:32Z")
Hello Elastic We have a cluster of 30 machines and each index has 1 replica. So we can tolerate 1 VM taken down. But we have to repair 2 VMs now. We have a day ahead of us. Is there a way to move all shards from the 2 V… --- ## [Create cluster with elasticsearch6.1.2](https://discuss.elastic.co/t/create-cluster-with-elasticsearch6-1-2/117284)
**Author:** [@bill.chi](https://discuss.elastic.co/u/bill.chi)\ **Replies:** 2\ **Last updated:** [February 8, 2018, 2:29am UTC](https://discuss.elastic.co/t/create-cluster-with-elasticsearch6-1-2/117284 "2018-02-08T02:29:20Z")
I took a full day to create cluster with elasticsearch6.1.2 for testing. After I complete config and start every node. I found some error messages in log file of every node , the error message is "exception caught on … --- ## [ES 6 : nested document vs the new join type](https://discuss.elastic.co/t/es-6-nested-document-vs-the-new-join-type/118948)
**Author:** [@moiz](https://discuss.elastic.co/u/moiz)\ **Replies:** 0\ **Last updated:** [February 8, 2018, 12:22am UTC](https://discuss.elastic.co/t/es-6-nested-document-vs-the-new-join-type/118948 "2018-02-08T00:22:46Z")
Starting a search project with ES 6. Structure of data is something like stack overflow. Parent document is a question. And question has 2 types of children, answers and comments. Question has a title, author, time and t… --- ## [Errors，please help](https://discuss.elastic.co/t/errors-please-help/118801)
**Author:** [@KenChung](https://discuss.elastic.co/u/KenChung)\ **Replies:** 4\ **Last updated:** [February 8, 2018, 1:55am UTC](https://discuss.elastic.co/t/errors-please-help/118801 "2018-02-08T01:55:02Z")
I want to configure a test cluster Here is my node 2 configuration information： cluster.name: esapp node.name: node-2 node.master: false node.data: true network.host: 0.0.0.0 discovery.zen.ping.unicast.hosts: \["19… --- ## [Elasticsearch reindex only appears to take a few documents](https://discuss.elastic.co/t/elasticsearch-reindex-only-appears-to-take-a-few-documents/118920)
**Author:** [@motts](https://discuss.elastic.co/u/motts)\ **Replies:** 14\ **Last updated:** [February 8, 2018, 12:00am UTC](https://discuss.elastic.co/t/elasticsearch-reindex-only-appears-to-take-a-few-documents/118920 "2018-02-08T00:00:34Z")
Hello there, I am trying to reindex some data in index firewall2 to index firewall4. I set up the firewall4 index and its mapping. When I try to run the reindex command, I see the following: curl -XPOST 'localhost:9200… --- ## [ES design regarding duplicates across indexes](https://discuss.elastic.co/t/es-design-regarding-duplicates-across-indexes/117852)
**Author:** [@seanwang30](https://discuss.elastic.co/u/seanwang30)\ **Replies:** 8\ **Last updated:** [February 1, 2018, 8:23pm UTC](https://discuss.elastic.co/t/es-design-regarding-duplicates-across-indexes/117852 "2018-02-01T20:23:38Z")
Hi all: ES noob here. I'm using ES as our main storage but facing a dilemma. We store service data up to 36 hours, our first design is to make hourly indices, so the whole index could be deleted once it's expired. Each … --- ## [Org.elasticsearch.plugin:x-pack-security:6.2.0 transitive dependency not found on Elasticsearch Maven Repository](https://discuss.elastic.co/t/org-elasticsearch-plugin-x-pack-security-6-2-0-transitive-dependency-not-found-on-elasticsearch-maven-repository/118881)
**Author:** [@apang](https://discuss.elastic.co/u/apang)\ **Replies:** 2\ **Last updated:** [February 7, 2018, 10:49pm UTC](https://discuss.elastic.co/t/org-elasticsearch-plugin-x-pack-security-6-2-0-transitive-dependency-not-found-on-elasticsearch-maven-repository/118881 "2018-02-07T22:49:14Z")
When trying to retrieve dependencies in my Gradle project that has a compile dependency on org.elasticsearch.client:x-pack-transport:6.2.0, I get: Could not find org.elasticsearch.plugin:x-pack-security:6.2.0. Searched… --- ## [Comparing values from 2 ML Jobs in watcher](https://discuss.elastic.co/t/comparing-values-from-2-ml-jobs-in-watcher/118882)
**Author:** [@mgarg123](https://discuss.elastic.co/u/mgarg123)\ **Replies:** 5\ **Last updated:** [February 7, 2018, 10:40pm UTC](https://discuss.elastic.co/t/comparing-values-from-2-ml-jobs-in-watcher/118882 "2018-02-07T22:40:04Z")
Hi, I have 2 different ML jobs. Identifies the anomaly in the users unusual login time. IE if users regularly logs in between 11:00 AM - 6:00 PM and one day he/she logs in @ 12:00 AM. this will be detected as a anoma… --- ## [Parsing query array within a query](https://discuss.elastic.co/t/parsing-query-array-within-a-query/118936)
**Author:** [@nickds](https://discuss.elastic.co/u/nickds)\ **Replies:** 0\ **Last updated:** [February 7, 2018, 10:32pm UTC](https://discuss.elastic.co/t/parsing-query-array-within-a-query/118936 "2018-02-07T22:32:24Z")
Hi, I'm currently using Elasticsearch 6.1.1, and I'm a little curious to see if there's a better method for what I'm currently doing. So I've got two separate indexes (a-\* and b-). a- has a column (eg col1) which will … --- ## [Iterating over ES Aggregation query using JAVA API](https://discuss.elastic.co/t/iterating-over-es-aggregation-query-using-java-api/118931)
**Author:** [@joker](https://discuss.elastic.co/u/joker)\ **Replies:** 0\ **Last updated:** [February 7, 2018, 9:37pm UTC](https://discuss.elastic.co/t/iterating-over-es-aggregation-query-using-java-api/118931 "2018-02-07T21:37:33Z")
I have following query which is queried using JAVA, but I don't know how to iterate over "permalink\_url" field ? Field response for permalink\_url looks like =\> "permalink\_url": { "hits": { … --- ## [Scroll randomly failing on some shards](https://discuss.elastic.co/t/scroll-randomly-failing-on-some-shards/118927)
**Author:** [@alissonsales](https://discuss.elastic.co/u/alissonsales)\ **Replies:** 0\ **Last updated:** [February 7, 2018, 9:05pm UTC](https://discuss.elastic.co/t/scroll-randomly-failing-on-some-shards/118927 "2018-02-07T21:05:30Z")
Hi, I'm experiencing a weird behaviour while scrolling elasticsearch (v5.5.2). I have an application that performs multiple search/scrolls hourly for analytics purposes and sometimes the query/scroll fails on some shar… --- ## [Cleanup after Elasticsearch Maven plugin](https://discuss.elastic.co/t/cleanup-after-elasticsearch-maven-plugin/118917)
**Author:** [@Kevin\_Bourne](https://discuss.elastic.co/u/Kevin_Bourne)\ **Replies:** 2\ **Last updated:** [February 7, 2018, 9:03pm UTC](https://discuss.elastic.co/t/cleanup-after-elasticsearch-maven-plugin/118917 "2018-02-07T21:03:43Z")
For anyone who is using the Elasticsearch Maven plugin for Integration tests.... Do you need to clean up the "elasticsearch0" that is created in the target directory by default? It seems to me that the log file just kee… --- ## [How to return NA in watcher alert email if field is not available](https://discuss.elastic.co/t/how-to-return-na-in-watcher-alert-email-if-field-is-not-available/118719)
**Author:** [@saranyav](https://discuss.elastic.co/u/saranyav)\ **Replies:** 4\ **Last updated:** [February 7, 2018, 8:36pm UTC](https://discuss.elastic.co/t/how-to-return-na-in-watcher-alert-email-if-field-is-not-available/118719 "2018-02-07T20:36:31Z")
Hello, I am trying to return a field as NA in watcher alert email if that field is not available in \_source. I am using a transform script to see if the field is available in the \_source, if not I am returning NA. Ple… --- ## [How to monitor Elastic Stack without X-Pack?](https://discuss.elastic.co/t/how-to-monitor-elastic-stack-without-x-pack/118765)
**Author:** [@amarbl](https://discuss.elastic.co/u/amarbl)\ **Replies:** 1\ **Last updated:** [February 7, 2018, 8:19pm UTC](https://discuss.elastic.co/t/how-to-monitor-elastic-stack-without-x-pack/118765 "2018-02-07T20:19:27Z")
Hi Folks, Can we monitor the elastic stack 6.0 and above(like elastic search..) without using the X-Pack?As we know many of the Features like security, machine learning, graph APIs don't be supported under BASIC(free Li… --- ## [Specify data directory permissions for Docker container](https://discuss.elastic.co/t/specify-data-directory-permissions-for-docker-container/118912)
**Author:** [@leosco](https://discuss.elastic.co/u/leosco)\ **Replies:** 1\ **Last updated:** [February 7, 2018, 7:33pm UTC](https://discuss.elastic.co/t/specify-data-directory-permissions-for-docker-container/118912 "2018-02-07T19:33:31Z")
Hi there, I'm trying to run the latest Elasticsearch Docker container on Ubuntu 16, and on startup it attempts to access a data directory at /usr/share/elasticsearch/data where it outputs this error message: \[2018-02-0… --- ## [Ignore\_filters option for audit index method](https://discuss.elastic.co/t/ignore-filters-option-for-audit-index-method/118907)
**Author:** [@djtecha](https://discuss.elastic.co/u/djtecha)\ **Replies:** 0\ **Last updated:** [February 7, 2018, 6:47pm UTC](https://discuss.elastic.co/t/ignore-filters-option-for-audit-index-method/118907 "2018-02-07T18:47:45Z")
Hey there, So I'm really happy to see that es 6.2 offers the ignore\_filters for the audit trail (super helpful). But I was curious if this option is coming to the index output method? I tried adding it and ES doesn't re… --- ## [Updated 5.6,X to 6.2 and all my data is gone](https://discuss.elastic.co/t/updated-5-6-x-to-6-2-and-all-my-data-is-gone/118880)
**Author:** [@dorj1234](https://discuss.elastic.co/u/dorj1234)\ **Replies:** 3\ **Last updated:** [February 7, 2018, 6:31pm UTC](https://discuss.elastic.co/t/updated-5-6-x-to-6-2-and-all-my-data-is-gone/118880 "2018-02-07T18:31:05Z")
Hello, I just used yum update to upgrade my elk stack from 5.6.2 to 6.2. Once done - logging into it shows nothing, no existing indexes, visualizations, data. All gone. The elasticsearch.yml file still points to the de… --- ## [Elastic node hangs (i think)](https://discuss.elastic.co/t/elastic-node-hangs-i-think/118714)
**Author:** [@rajsolanki](https://discuss.elastic.co/u/rajsolanki)\ **Replies:** 4\ **Last updated:** [February 7, 2018, 6:22pm UTC](https://discuss.elastic.co/t/elastic-node-hangs-i-think/118714 "2018-02-07T18:22:45Z")
I just installed elastic search elasticsearch-6.1.3 on RHEL (Red Hat Enterprise Linux Server release 7.4 (Maipo)). I have 2 servers where log stash is installed. I m parsing HTTP server logs successfully. Issue is after … --- ## [Failed activate basic license](https://discuss.elastic.co/t/failed-activate-basic-license/118873)
**Author:** [@1\_Maximys\_1](https://discuss.elastic.co/u/1_Maximys_1)\ **Replies:** 1\ **Last updated:** [February 7, 2018, 5:50pm UTC](https://discuss.elastic.co/t/failed-activate-basic-license/118873 "2018-02-07T17:50:38Z")
Hi. I've installed ELK with docker. I need activate Kibana, because we need Monitor tab in Kibana. I received json license. How should I activate it? I found this cmdline: curl -XPUT -u elastic 'http://:/\_xpack/lic… --- ## [Troublewriting query in ES using JAVA API](https://discuss.elastic.co/t/troublewriting-query-in-es-using-java-api/118755)
**Author:** [@joker](https://discuss.elastic.co/u/joker)\ **Replies:** 3\ **Last updated:** [February 7, 2018, 5:22pm UTC](https://discuss.elastic.co/t/troublewriting-query-in-es-using-java-api/118755 "2018-02-07T17:22:32Z")
I have tried a lot and searched stackoverflow about building queries in JAVA for ES, I think I have basic understanding but still not able to write queries properly. Can someone please explain in detail with several exam… --- ## [Querying Nested Structure Without Hardcoding Keys](https://discuss.elastic.co/t/querying-nested-structure-without-hardcoding-keys/118857)
**Author:** [@jagt70](https://discuss.elastic.co/u/jagt70)\ **Replies:** 2\ **Last updated:** [February 7, 2018, 4:44pm UTC](https://discuss.elastic.co/t/querying-nested-structure-without-hardcoding-keys/118857 "2018-02-07T16:44:41Z")
Hi, I am totally new to Elasticsearch 6.0 and need help in querying documents with a nested structure (below). I have kept the example below simple, but in total the payload is around 28 KB. My Query What I am trying … --- ## [Invalid stemmer class specified: Cjk](https://discuss.elastic.co/t/invalid-stemmer-class-specified-cjk/118173)
**Author:** [@Palanikumark](https://discuss.elastic.co/u/Palanikumark)\ **Replies:** 7\ **Last updated:** [February 7, 2018, 4:44pm UTC](https://discuss.elastic.co/t/invalid-stemmer-class-specified-cjk/118173 "2018-02-07T16:44:35Z")
Describe the Bug: I configured Chinese store view in website using magento 2.1.7 EE and for catalog search im using Elastic search v 2.4.5. When triggering reindex documents are not getting generated in elastic search a… --- ## [Elasticsearch cluster overloaded](https://discuss.elastic.co/t/elasticsearch-cluster-overloaded/118868)
**Author:** [@fsperling](https://discuss.elastic.co/u/fsperling)\ **Replies:** 1\ **Last updated:** [February 7, 2018, 4:36pm UTC](https://discuss.elastic.co/t/elasticsearch-cluster-overloaded/118868 "2018-02-07T16:36:02Z")
Hi, Our elasticsearch cluster get overloaded from time to time. We see thread\_pool rejections on elasticsearch and logstash has error messages like the below \[logstash.outputs.elasticsearch\] retrying failed action wit… --- ## [504 timeout email watcher](https://discuss.elastic.co/t/504-timeout-email-watcher/117832)
**Author:** [@AbdulH](https://discuss.elastic.co/u/AbdulH)\ **Replies:** 8\ **Last updated:** [February 7, 2018, 4:27pm UTC](https://discuss.elastic.co/t/504-timeout-email-watcher/117832 "2018-02-07T16:27:26Z")
I managed to set up an email watcher on a server, with the same config on another server I getting no errors or any output in logs though the action fails. Using the following command to simulate the watcher: POST \_xpac… --- ## [Term Aggregation on float\_range fields](https://discuss.elastic.co/t/term-aggregation-on-float-range-fields/118878)
**Author:** [@Shibisoma](https://discuss.elastic.co/u/Shibisoma)\ **Replies:** 0\ **Last updated:** [February 7, 2018, 4:11pm UTC](https://discuss.elastic.co/t/term-aggregation-on-float-range-fields/118878 "2018-02-07T16:11:14Z")
Hello, running in to some trouble trying to perform aggregation on a float\_range field. I have a field NUM\_AGE which is of type float\_range as specified in my mapping, which I would like to get all the unique values for.… --- ## [Elasticsearch is not starting owing to wrong file permission](https://discuss.elastic.co/t/elasticsearch-is-not-starting-owing-to-wrong-file-permission/118855)
**Author:** [@itspecialistsimon](https://discuss.elastic.co/u/itspecialistsimon)\ **Replies:** 3\ **Last updated:** [February 7, 2018, 4:07pm UTC](https://discuss.elastic.co/t/elasticsearch-is-not-starting-owing-to-wrong-file-permission/118855 "2018-02-07T16:07:52Z")
Hi everyone, my Elasticsearch instance doesn't start. Here the logfile's extract: Caused by: java.security.AccessControlException: access denied ("java.io.FilePermission" "/opt/cert/elastic-certificates.p12" "read") … --- ## [Use logstash mapping for all future indicies](https://discuss.elastic.co/t/use-logstash-mapping-for-all-future-indicies/118533)
**Author:** [@motts](https://discuss.elastic.co/u/motts)\ **Replies:** 6\ **Last updated:** [February 7, 2018, 3:13pm UTC](https://discuss.elastic.co/t/use-logstash-mapping-for-all-future-indicies/118533 "2018-02-07T15:13:01Z")
Hello there, Is there a way to assign the mapping for the logstash index to all future indices created? I can create indices super easy, but having to define each field is a little time consuming, and so far, I have fou… --- ## [Error Initiating elasticsearch after windows 10 install](https://discuss.elastic.co/t/error-initiating-elasticsearch-after-windows-10-install/118660)
**Author:** [@firomero](https://discuss.elastic.co/u/firomero)\ **Replies:** 1\ **Last updated:** [February 7, 2018, 2:52pm UTC](https://discuss.elastic.co/t/error-initiating-elasticsearch-after-windows-10-install/118660 "2018-02-07T14:52:43Z")
I 've installed elasticsearch 6.1 on windows 10 with Java 8 amd64. But can not run it. It throws the followin error: WARNING: sun.reflect.Reflection.getCallerClass is not supported. This will impact performance. \[2018-… --- ## [Questions about custom tracks](https://discuss.elastic.co/t/questions-about-custom-tracks/118794)
**Author:** [@asp](https://discuss.elastic.co/u/asp)\ **Replies:** 3\ **Last updated:** [February 7, 2018, 2:18pm UTC](https://discuss.elastic.co/t/questions-about-custom-tracks/118794 "2018-02-07T14:18:42Z")
Hi, last time I tried to upgrade my productive ES instance from 5.1.2 to 6.1.0 I got performance issues afterwards. Before running the next rollout, I would like to do some loadtests before to be sure that changes duri… --- ## [ElasticSearch on AWS - Disaster Recovery?](https://discuss.elastic.co/t/elasticsearch-on-aws-disaster-recovery/118484)
**Author:** [@titan1978](https://discuss.elastic.co/u/titan1978)\ **Replies:** 6\ **Last updated:** [February 7, 2018, 2:15pm UTC](https://discuss.elastic.co/t/elasticsearch-on-aws-disaster-recovery/118484 "2018-02-07T14:15:15Z")
We're in the process of productionizing our US-EAST ELK stack. However, for the purpose of Disaster Recovery, we need to setup a US-WEST ELK stack as well. I Wanted to understand, after we setup the WEST (And assuming a… [Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1796) [Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1798)