# Elasticsearch **URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1564 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1565 --- ## [Setup cross cluster](https://discuss.elastic.co/t/setup-cross-cluster/146512)
**Author:** [@twan](https://discuss.elastic.co/u/twan)\ **Replies:** 2\ **Last updated:** [August 30, 2018, 6:47am UTC](https://discuss.elastic.co/t/setup-cross-cluster/146512 "2018-08-30T06:47:06Z")
Hi all, We recently did a PoC to use APM inside our environment. And are now discussing how the systems need to be setup for a prod-like environment. For APM a new ELK-stack will be deployed next to the existing one. Th… --- ## [Shards are unassigned allocation\_failed](https://discuss.elastic.co/t/shards-are-unassigned-allocation-failed/146624)
**Author:** [@siva1](https://discuss.elastic.co/u/siva1)\ **Replies:** 0\ **Last updated:** [August 30, 2018, 6:23am UTC](https://discuss.elastic.co/t/shards-are-unassigned-allocation-failed/146624 "2018-08-30T06:23:25Z")
Hi all, I am using ELK stack (single ES) and working with swarm mode, how i need to take backup old data and assigned new shards for new nodes in swarm. Can some one can help me. How to do this? .kibana 0 p… --- ## [Questions about file cache](https://discuss.elastic.co/t/questions-about-file-cache/146613)
**Author:** [@pohsun.teh](https://discuss.elastic.co/u/pohsun.teh)\ **Replies:** 0\ **Last updated:** [August 30, 2018, 4:36am UTC](https://discuss.elastic.co/t/questions-about-file-cache/146613 "2018-08-30T04:36:19Z")
Greetings, Right now I have this problem of request timeout which seldom happens but would like to figure out what cause it. Came across File Cache on ElasticSearch while doing some research Have few questions in my m… --- ## [Exclude meta-fileds from \_all](https://discuss.elastic.co/t/exclude-meta-fileds-from-all/145724)
**Author:** [@nikitakrasnov](https://discuss.elastic.co/u/nikitakrasnov)\ **Replies:** 6\ **Last updated:** [August 30, 2018, 5:51am UTC](https://discuss.elastic.co/t/exclude-meta-fileds-from-all/145724 "2018-08-30T05:51:24Z")
Hello. Is there the way to exclude meta-fields (for example \_id) from \_all field? --- ## [Not Solved!? Sync issues? with bulk create and threads exceeded](https://discuss.elastic.co/t/not-solved-sync-issues-with-bulk-create-and-threads-exceeded/146079)
**Author:** [@esmattdawson](https://discuss.elastic.co/u/esmattdawson)\ **Replies:** 8\ **Last updated:** [August 30, 2018, 5:26am UTC](https://discuss.elastic.co/t/not-solved-sync-issues-with-bulk-create-and-threads-exceeded/146079 "2018-08-30T05:26:30Z")
elasticsearch version 6.3.2 Cluster: 3 master + data nodes Index: 1 shard + 2 replicas, 10 second flush rate When I perform a bulk create over many indexes sometimes I get a bulk threads exceeded exception, which is … --- ## [Where to find Java Doc for JavaEsSpark](https://discuss.elastic.co/t/where-to-find-java-doc-for-javaesspark/146511)
**Author:** [@SKing](https://discuss.elastic.co/u/SKing)\ **Replies:** 0\ **Last updated:** [August 29, 2018, 10:31am UTC](https://discuss.elastic.co/t/where-to-find-java-doc-for-javaesspark/146511 "2018-08-29T10:31:54Z")
Can't find the link for Java Docs for JavaEsSpark. Can someone post it please? --- ## [Is Bulk Index create Index for all documents or some of them?](https://discuss.elastic.co/t/is-bulk-index-create-index-for-all-documents-or-some-of-them/146532)
**Author:** [@Gaurav\_Patel](https://discuss.elastic.co/u/Gaurav_Patel)\ **Replies:** 3\ **Last updated:** [August 30, 2018, 5:23am UTC](https://discuss.elastic.co/t/is-bulk-index-create-index-for-all-documents-or-some-of-them/146532 "2018-08-30T05:23:08Z")
I want to use bulk Index to Insert multiple(10) objects. I wanted to know if during insert operation out of 10 objects, 3 object not inserted. in that case BulkIndex operation will rollback operation or not. --- ## [How to build a cluster](https://discuss.elastic.co/t/how-to-build-a-cluster/146549)
**Author:** [@talon](https://discuss.elastic.co/u/talon)\ **Replies:** 5\ **Last updated:** [August 30, 2018, 5:07am UTC](https://discuss.elastic.co/t/how-to-build-a-cluster/146549 "2018-08-30T05:07:49Z")
I went to build a cluster (8 nodes for elasticsearch 2 nodes for kibana) with SAML integration so i think the first step is install elasticsearch and kibana second step is configure elasticsearch to make them as a clus… --- ## [Fetch Realm settings from elasticsearch.yml file in a static way on class load](https://discuss.elastic.co/t/fetch-realm-settings-from-elasticsearch-yml-file-in-a-static-way-on-class-load/146592)
**Author:** [@gautu7](https://discuss.elastic.co/u/gautu7)\ **Replies:** 5\ **Last updated:** [August 30, 2018, 2:58am UTC](https://discuss.elastic.co/t/fetch-realm-settings-from-elasticsearch-yml-file-in-a-static-way-on-class-load/146592 "2018-08-30T02:58:18Z")
Hi, I have a CustomRealm class which handles the custom realm logic to authenticate. I have a static cache so that it's only 1 per jvm, which has a value - setExpireAfterAccess(10). I want this value to come from the ym… --- ## [Enable trial licence by cmd](https://discuss.elastic.co/t/enable-trial-licence-by-cmd/146594)
**Author:** [@talon](https://discuss.elastic.co/u/talon)\ **Replies:** 2\ **Last updated:** [August 30, 2018, 2:27am UTC](https://discuss.elastic.co/t/enable-trial-licence-by-cmd/146594 "2018-08-30T02:27:38Z")
HI From the guide we can know how to enable trial licence or import licence. But we need to deploy the cluster by script to realize auto-deploy, so we can't enable it by login kibana, can you tell me is there way to en… --- ## [Caching Custom Realm Plugin tokens](https://discuss.elastic.co/t/caching-custom-realm-plugin-tokens/145972)
**Author:** [@gautu7](https://discuss.elastic.co/u/gautu7)\ **Replies:** 5\ **Last updated:** [August 30, 2018, 2:10am UTC](https://discuss.elastic.co/t/caching-custom-realm-plugin-tokens/145972 "2018-08-30T02:10:16Z")
I have a custom realm plugin implemented to which I want to add caching until a certain time period and invalidate the cache. There is a CachingRealm interface which I can implement for the cache eviction APIs. I was lo… --- ## [Upgrading from ELK 6.2.4 to 6.4 on Windows](https://discuss.elastic.co/t/upgrading-from-elk-6-2-4-to-6-4-on-windows/146575)
**Author:** [@rohitg](https://discuss.elastic.co/u/rohitg)\ **Replies:** 0\ **Last updated:** [August 29, 2018, 8:02pm UTC](https://discuss.elastic.co/t/upgrading-from-elk-6-2-4-to-6-4-on-windows/146575 "2018-08-29T20:02:39Z")
Hi, Can you provide some information to upgrade ELK on windows. I have to upgrade from ELK 6.2.4 to 6.4. --- ## [Overload control mechanism is supported to reduce the impact of DoS attacks](https://discuss.elastic.co/t/overload-control-mechanism-is-supported-to-reduce-the-impact-of-dos-attacks/146170)
**Author:** [@mrudrego](https://discuss.elastic.co/u/mrudrego)\ **Replies:** 3\ **Last updated:** [August 29, 2018, 7:47pm UTC](https://discuss.elastic.co/t/overload-control-mechanism-is-supported-to-reduce-the-impact-of-dos-attacks/146170 "2018-08-29T19:47:36Z")
Hi, We are using ELK 6.2.4 stack, is there a Overload control mechanism to reduce the impact of DoS attacks? If yes, can you please let us know what is the mechanism. Thanks & Regards, Mahesh --- ## [Watcher is not generating Email during anomaly](https://discuss.elastic.co/t/watcher-is-not-generating-email-during-anomaly/145670)
**Author:** [@Abhishek\_Dwivedi](https://discuss.elastic.co/u/Abhishek_Dwivedi)\ **Replies:** 3\ **Last updated:** [August 29, 2018, 6:59pm UTC](https://discuss.elastic.co/t/watcher-is-not-generating-email-during-anomaly/145670 "2018-08-29T18:59:32Z")
Hi, I am using Single metric ML job to detect an anomaly in my logs. I have also configured WATCHER TO generate EMAIL during any critical anomaly. But I found that the single metric viewer is showing 1 critical anomaly… --- ## [Deleted Rollup Job but cannot re-create it](https://discuss.elastic.co/t/deleted-rollup-job-but-cannot-re-create-it/146294)
**Author:** [@cawoodm](https://discuss.elastic.co/u/cawoodm)\ **Replies:** 4\ **Last updated:** [August 29, 2018, 6:06pm UTC](https://discuss.elastic.co/t/deleted-rollup-job-but-cannot-re-create-it/146294 "2018-08-29T18:06:46Z")
After creating a rollup job and deleting it we are unable to create a job again with the same id. POST /\_xpack/rollup/job/foo { "error": { "root\_cause": \[ { "type": "status\_except… --- ## [Exception caught on netty layer - java.lang.OutOfMemoryError](https://discuss.elastic.co/t/exception-caught-on-netty-layer-java-lang-outofmemoryerror/145588)
**Author:** [@Sanj\_Gunetileke](https://discuss.elastic.co/u/Sanj_Gunetileke)\ **Replies:** 7\ **Last updated:** [August 29, 2018, 4:53pm UTC](https://discuss.elastic.co/t/exception-caught-on-netty-layer-java-lang-outofmemoryerror/145588 "2018-08-29T16:53:29Z")
Hi folks, I keep on getting a JVM out of memory error. I have used the option to disable index closing, so when this error does occur the indexes do not close. I would appreciate any advice on this. Thanks in advance… --- ## [Unable to create an index in elastic search through filebeat/ logstash in 5.2 version](https://discuss.elastic.co/t/unable-to-create-an-index-in-elastic-search-through-filebeat-logstash-in-5-2-version/146562)
**Author:** [@gvreddy](https://discuss.elastic.co/u/gvreddy)\ **Replies:** 0\ **Last updated:** [August 29, 2018, 4:32pm UTC](https://discuss.elastic.co/t/unable-to-create-an-index-in-elastic-search-through-filebeat-logstash-in-5-2-version/146562 "2018-08-29T16:32:30Z")
Hi can somebody help me on this, am unable to create an index in elastic search, in this scenario i have already created "test1" index and its log path previously for testing purpose and deleted in elastic search, and no… --- ## [Nest \_mget convert \_source to dynamic type](https://discuss.elastic.co/t/nest-mget-convert-source-to-dynamic-type/146552)
**Author:** [@Doug\_Nelson1](https://discuss.elastic.co/u/Doug_Nelson1)\ **Replies:** 0\ **Last updated:** [August 29, 2018, 3:22pm UTC](https://discuss.elastic.co/t/nest-mget-convert-source-to-dynamic-type/146552 "2018-08-29T15:22:38Z")
When working with Nest client and doing a search, the Docs collection can be rendered as a dynamic object var response = es.Search\(s =\> s.MatchAll()); When doing an mget, the response returns a collection of h… --- ## [ELK configuration](https://discuss.elastic.co/t/elk-configuration/146558)
**Author:** [@Maddy\_M](https://discuss.elastic.co/u/Maddy_M)\ **Replies:** 0\ **Last updated:** [August 29, 2018, 4:23pm UTC](https://discuss.elastic.co/t/elk-configuration/146558 "2018-08-29T16:23:35Z")
Hi, I wanted to create 3 nodes for elastisearch. Could you please suggest the elastisearch.yml configuration for highavailability? I am considering all nodes are master and setting discovery.zen.minimum\_master\_nodes=2 … --- ## [Improve search performance-Configuration Issue](https://discuss.elastic.co/t/improve-search-performance-configuration-issue/146548)
**Author:** [@snigdharao](https://discuss.elastic.co/u/snigdharao)\ **Replies:** 5\ **Last updated:** [August 29, 2018, 3:24pm UTC](https://discuss.elastic.co/t/improve-search-performance-configuration-issue/146548 "2018-08-29T15:24:46Z")
I have indexed 85M documents and it doesnt respond fast .I have optimized my querys I am assuming i need to change my configuration, Could you please let me know what needs to be changed --- ## [Default mappings properties when creating index](https://discuss.elastic.co/t/default-mappings-properties-when-creating-index/146537)
**Author:** [@J0nasty](https://discuss.elastic.co/u/J0nasty)\ **Replies:** 0\ **Last updated:** [August 29, 2018, 1:38pm UTC](https://discuss.elastic.co/t/default-mappings-properties-when-creating-index/146537 "2018-08-29T13:38:25Z")
Hi, I want to create mappings settings for all types, not only for one. So when I have following create index query: PUT tweets { "mappings": { "typeName": { "\_source": { "enabled": false } } } } So instead … --- ## [Update and snapshot for indices with timestamp](https://discuss.elastic.co/t/update-and-snapshot-for-indices-with-timestamp/143230)
**Author:** [@ficco](https://discuss.elastic.co/u/ficco)\ **Replies:** 1\ **Last updated:** [August 29, 2018, 1:50pm UTC](https://discuss.elastic.co/t/update-and-snapshot-for-indices-with-timestamp/143230 "2018-08-29T13:50:33Z")
Hello, I have a question about implementing update and snapshot for indices with timestamp. The index format looks like result-2018.07 result-2018-08 which is good to use curator to do snapshot and delete. However, the… --- ## [Curator Snapshot Failure](https://discuss.elastic.co/t/curator-snapshot-failure/143326)
**Author:** [@dxc\_PaulT](https://discuss.elastic.co/u/dxc_PaulT)\ **Replies:** 1\ **Last updated:** [August 29, 2018, 1:48pm UTC](https://discuss.elastic.co/t/curator-snapshot-failure/143326 "2018-08-29T13:48:18Z")
I'm seeing CrashLoopBackOff error whilst running curator job. Logs state "Failed to verify all nodes have repository access". The cron job has been running without problem until the last few days. Action file extract i… --- ## [Is Directory path for storing data needs to be created manually or does it get created during application restart automatically](https://discuss.elastic.co/t/is-directory-path-for-storing-data-needs-to-be-created-manually-or-does-it-get-created-during-application-restart-automatically/146460)
**Author:** [@sandipatmca](https://discuss.elastic.co/u/sandipatmca)\ **Replies:** 2\ **Last updated:** [August 29, 2018, 1:40pm UTC](https://discuss.elastic.co/t/is-directory-path-for-storing-data-needs-to-be-created-manually-or-does-it-get-created-during-application-restart-automatically/146460 "2018-08-29T13:40:15Z")
I am setting path.data and path.log file as below in elasticsearch.yml file. Can someone please confirm if the directory "/opt/elasticsearch/data" and "/opt/elasticsearch/log" should pre-exists in that path Or it will … --- ## [Elasticsearch 6.3.0 shard recovery is slow](https://discuss.elastic.co/t/elasticsearch-6-3-0-shard-recovery-is-slow/140940)
**Author:** [@ctluce](https://discuss.elastic.co/u/ctluce)\ **Replies:** 13\ **Last updated:** [August 29, 2018, 1:39pm UTC](https://discuss.elastic.co/t/elasticsearch-6-3-0-shard-recovery-is-slow/140940 "2018-08-29T13:39:27Z")
Moving from a 2.4.6 to a 6.3.0 cluster we have noticed that shard recovery is a lot slower. On the 2.4.6 cluster recovery time is ~3 minutes for shards, on the 6.3.0 cluster recovery time is ~9-11 minutes. The clusters … --- ## [How to perform full text search for a numberic field?](https://discuss.elastic.co/t/how-to-perform-full-text-search-for-a-numberic-field/146467)
**Author:** [@betty](https://discuss.elastic.co/u/betty)\ **Replies:** 1\ **Last updated:** [August 29, 2018, 12:57pm UTC](https://discuss.elastic.co/t/how-to-perform-full-text-search-for-a-numberic-field/146467 "2018-08-29T12:57:06Z")
Hi experts, As the title described, I need to perform full-text search for a field with type "long". For example: {id: 100009078} I need to get it when I search for "78". Since the mapping cannot be changed once cre… --- ## [Finding document\_type?](https://discuss.elastic.co/t/finding-document-type/145176)
**Author:** [@S\_Chase](https://discuss.elastic.co/u/S_Chase)\ **Replies:** 1\ **Last updated:** [August 29, 2018, 12:33pm UTC](https://discuss.elastic.co/t/finding-document-type/145176 "2018-08-29T12:33:18Z")
I get a log message when elasticsearch starts that document\_type is in use and is depreciated, etc. etc. I've read the docs on it and didn't think I was even using it since I started with 6.3.0 - but I still get the not… --- ## [Delete index at regular basis](https://discuss.elastic.co/t/delete-index-at-regular-basis/146516)
**Author:** [@Tek\_Chand](https://discuss.elastic.co/u/Tek_Chand)\ **Replies:** 2\ **Last updated:** [August 29, 2018, 12:08pm UTC](https://discuss.elastic.co/t/delete-index-at-regular-basis/146516 "2018-08-29T12:08:45Z")
Hello All, Currently i am using elasticsearch6.2.4 and its working fine. But i want to upgrade from elasticsearch6.2.4 to 6.4.0. Before proceeding i have one query:- Currently i am using Curator to delete index at reg… --- ## [Bootstrap checks failed in es 6.4](https://discuss.elastic.co/t/bootstrap-checks-failed-in-es-6-4/146498)
**Author:** [@amit.patra](https://discuss.elastic.co/u/amit.patra)\ **Replies:** 2\ **Last updated:** [August 29, 2018, 11:32am UTC](https://discuss.elastic.co/t/bootstrap-checks-failed-in-es-6-4/146498 "2018-08-29T11:32:15Z")
Hi, We have upgraded es 5.5 to 6.4 according to https://www.elastic.co/guide/en/elasticsearch/reference/current/restart-upgrade.html But after upgrade below error is there : \[2018-08-29T14:42:44,446\]\[ERROR\]\[o.e.b.B… --- ## [Waiting for elected master node to setup local exporter \[default\_local\] (does it have x-pack installed?)](https://discuss.elastic.co/t/waiting-for-elected-master-node-to-setup-local-exporter-default-local-does-it-have-x-pack-installed/146518)
**Author:** [@leprovokateur](https://discuss.elastic.co/u/leprovokateur)\ **Replies:** 0\ **Last updated:** [August 29, 2018, 11:22am UTC](https://discuss.elastic.co/t/waiting-for-elected-master-node-to-setup-local-exporter-default-local-does-it-have-x-pack-installed/146518 "2018-08-29T11:22:56Z")
Hi, I have a cluster of two elasticsearch instances. After the update from 6.3.1 to 6.4 the elasticsearch log on one machine is flooded with messages like the following: \[2018-08-29T13:17:01,091\]\[INFO \]\[o.e.x.m.e.l.Lo… [Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1563) [Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1565)