# Elasticsearch **URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1970 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1971 --- ## [In my elasticsearch 5.4.2 the cluster start without 3 shards](https://discuss.elastic.co/t/in-my-elasticsearch-5-4-2-the-cluster-start-without-3-shards/98102)
**Author:** [@zqc0512](https://discuss.elastic.co/u/zqc0512)\ **Replies:** 4\ **Last updated:** [August 23, 2017, 3:54pm UTC](https://discuss.elastic.co/t/in-my-elasticsearch-5-4-2-the-cluster-start-without-3-shards/98102 "2017-08-23T15:54:48Z")
how can do to change the es cluster status yellow to green. it up 4 hours. “unassigned\_shards” : 3, thanks. --- ## [Anyone using SystemD to ensure Elasticsearch is restarted if it crashes?](https://discuss.elastic.co/t/anyone-using-systemd-to-ensure-elasticsearch-is-restarted-if-it-crashes/98080)
**Author:** [@A\_B](https://discuss.elastic.co/u/A_B)\ **Replies:** 4\ **Last updated:** [August 23, 2017, 3:05pm UTC](https://discuss.elastic.co/t/anyone-using-systemd-to-ensure-elasticsearch-is-restarted-if-it-crashes/98080 "2017-08-23T15:05:00Z")
Hello all, not sure how good of an idea it is but I'm thinking of adding a few lines to the SystemD unit file for Elasticsearch so the service will automatically restart if it dies. Something like Restart ... \[Servi… --- ## [Building aggregations from JSON with the Java client](https://discuss.elastic.co/t/building-aggregations-from-json-with-the-java-client/98101)
**Author:** [@MikeThomsen](https://discuss.elastic.co/u/MikeThomsen)\ **Replies:** 0\ **Last updated:** [August 23, 2017, 2:55pm UTC](https://discuss.elastic.co/t/building-aggregations-from-json-with-the-java-client/98101 "2017-08-23T14:55:25Z")
I’m working on a project where using the AggregationBuilders is not an option because we need to be able to define new aggregations without code changes. I’ve done a lot of searching, and it looks like Elastic dropped th… --- ## [ES 5.4.1 Startup Exception - exception caught on transport layer](https://discuss.elastic.co/t/es-5-4-1-startup-exception-exception-caught-on-transport-layer/98100)
**Author:** [@SKumarMN](https://discuss.elastic.co/u/SKumarMN)\ **Replies:** 0\ **Last updated:** [August 23, 2017, 2:49pm UTC](https://discuss.elastic.co/t/es-5-4-1-startup-exception-exception-caught-on-transport-layer/98100 "2017-08-23T14:49:30Z")
When i try to startup ES 5.4.1 on Windows 7, i get the below exception however ES starts. I tried with default settings in elasticsearch.yml file and tried adding the network.host or http.host/ transport.host with IP add… --- ## [What is the best suitable Elasticsearch architecture?](https://discuss.elastic.co/t/what-is-the-best-suitable-elasticsearch-architecture/95394)
**Author:** [@amruth](https://discuss.elastic.co/u/amruth)\ **Replies:** 3\ **Last updated:** [August 23, 2017, 2:24pm UTC](https://discuss.elastic.co/t/what-is-the-best-suitable-elasticsearch-architecture/95394 "2017-08-23T14:24:50Z")
Hi, I am planning to use Elasticsearch Cluster with 4 different servers with each Node on one server. Out of which 3 Nodes are Master Eligible and Data Nodes and the other is Coordinating only Node(Kibana is also running… --- ## [Node discovery issue post upgrade to newer version of ELK stack](https://discuss.elastic.co/t/node-discovery-issue-post-upgrade-to-newer-version-of-elk-stack/97741)
**Author:** [@Vivek\_Samaga](https://discuss.elastic.co/u/Vivek_Samaga)\ **Replies:** 17\ **Last updated:** [August 23, 2017, 1:52pm UTC](https://discuss.elastic.co/t/node-discovery-issue-post-upgrade-to-newer-version-of-elk-stack/97741 "2017-08-23T13:52:43Z")
I have migrated all my ELK nodes to new versions. I have 2 ES nodes with configs as below 10.\*\*\*.235 elk\_es\_crt\_00 cluster.name: csm\_elk\_es\_crt\_00 node.name: "elkescrt00.\*\*\*.net" bootstrap.memory\_lock: false networ… --- ## [Elasticsearch path.data](https://discuss.elastic.co/t/elasticsearch-path-data/98062)
**Author:** [@richardlee713](https://discuss.elastic.co/u/richardlee713)\ **Replies:** 1\ **Last updated:** [August 23, 2017, 1:32pm UTC](https://discuss.elastic.co/t/elasticsearch-path-data/98062 "2017-08-23T13:32:58Z")
I have two webservers, each with their own installation of Elasticsearch. Both these webservers have a shared folder on their D: drive. I want to use the same data folder so that I have one set of indexes and each elast… --- ## [Node types and cluster settings in ES 5.x](https://discuss.elastic.co/t/node-types-and-cluster-settings-in-es-5-x/97914)
**Author:** [@Eduard\_Kubanda](https://discuss.elastic.co/u/Eduard_Kubanda)\ **Replies:** 3\ **Last updated:** [August 23, 2017, 1:22pm UTC](https://discuss.elastic.co/t/node-types-and-cluster-settings-in-es-5-x/97914 "2017-08-23T13:22:08Z")
Hi there, I am a bit confused about cluster nodes settings. There is a lot of topics and articles about nodes / shards / replicas settings, but I often find inaccuracies between current (or my) version - articles & topi… --- ## [Restore to new cluster - No MetaData Problem](https://discuss.elastic.co/t/restore-to-new-cluster-no-metadata-problem/96666)
**Author:** [@Bruce\_Carey](https://discuss.elastic.co/u/Bruce_Carey)\ **Replies:** 5\ **Last updated:** [August 23, 2017, 1:03pm UTC](https://discuss.elastic.co/t/restore-to-new-cluster-no-metadata-problem/96666 "2017-08-23T13:03:03Z")
I’m testing the backup system. I want to be able to restore to a new/different cluster/host if for some reason the original crashes and is entirely unrecoverable. So, I did a backup to an NFS storage on a backup machin… --- ## [Looking for help setting up a machine learning test to find "virility"](https://discuss.elastic.co/t/looking-for-help-setting-up-a-machine-learning-test-to-find-virility/98057)
**Author:** [@yehosef](https://discuss.elastic.co/u/yehosef)\ **Replies:** 8\ **Last updated:** [August 23, 2017, 12:53pm UTC](https://discuss.elastic.co/t/looking-for-help-setting-up-a-machine-learning-test-to-find-virility/98057 "2017-08-23T12:53:32Z")
I’m testing x-pack and the machine learning, and I’m trying to develop a test case to test its effectiveness and usefulness for my application. The idea is that I’m tracking posts on a site and I’m watching a few metric… --- ## [Wait until indexed in NEST](https://discuss.elastic.co/t/wait-until-indexed-in-nest/98071)
**Author:** [@mjgasior](https://discuss.elastic.co/u/mjgasior)\ **Replies:** 0\ **Last updated:** [August 23, 2017, 12:23pm UTC](https://discuss.elastic.co/t/wait-until-indexed-in-nest/98071 "2017-08-23T12:23:49Z")
As in the topic - how can I wait until everything is indexed and searchable without using the Refresh method? var projects = new List\() { (...) }; IBulkResponse response = await Client.IndexManyAsync(projects… --- ## [Plugin installation on Elastic 5.5](https://discuss.elastic.co/t/plugin-installation-on-elastic-5-5/98056)
**Author:** [@Kumar\_Narottam](https://discuss.elastic.co/u/Kumar_Narottam)\ **Replies:** 1\ **Last updated:** [August 23, 2017, 11:07am UTC](https://discuss.elastic.co/t/plugin-installation-on-elastic-5-5/98056 "2017-08-23T11:07:35Z")
I have installed elastic 5.5 via debian package. Plugin installation has become a night mare in elastic 5.5. I am going to usr/share/elasticsearch/bin$ to access by elasticsearch-plugin executable file, but it does not … --- ## [How to get connected vpn users](https://discuss.elastic.co/t/how-to-get-connected-vpn-users/98039)
**Author:** [@schlum](https://discuss.elastic.co/u/schlum)\ **Replies:** 1\ **Last updated:** [August 23, 2017, 10:28am UTC](https://discuss.elastic.co/t/how-to-get-connected-vpn-users/98039 "2017-08-23T10:28:45Z")
Hi, I am new to ELK and cannot find the good way to do the following (neither the keywords to search the documentation…) : I have an index with my ASA VPN logs. When a user connect we get a “login” log and a “logout” … --- ## [Gigabit or Gigabyte?](https://discuss.elastic.co/t/gigabit-or-gigabyte/97332)
**Author:** [@jogoinar10](https://discuss.elastic.co/u/jogoinar10)\ **Replies:** 2\ **Last updated:** [August 23, 2017, 10:27am UTC](https://discuss.elastic.co/t/gigabit-or-gigabyte/97332 "2017-08-23T10:27:21Z")
When I check my elasticsearch using http://localhost:9200/\_cat/indices?v, I can see that there is the size of the index. let’s say I have an index there with 10gb… Is it 10gigabit? or 10gigabyt? --- ## [Elasticsearch.Net deserialize to my type](https://discuss.elastic.co/t/elasticsearch-net-deserialize-to-my-type/97418)
**Author:** [@Karolinebryn](https://discuss.elastic.co/u/Karolinebryn)\ **Replies:** 1\ **Last updated:** [August 23, 2017, 10:27am UTC](https://discuss.elastic.co/t/elasticsearch-net-deserialize-to-my-type/97418 "2017-08-23T10:27:12Z")
According to the documentation on Elasticsearch.Net you can provide your own type that Elasticsearch.Net will deserialize into, like this: ElasticsearchLowLevelClient.Index\(indexName, type, id, obj); Whi… --- ## [High elastic search heap memory consumption while indexing huge files](https://discuss.elastic.co/t/high-elastic-search-heap-memory-consumption-while-indexing-huge-files/98004)
**Author:** [@akash](https://discuss.elastic.co/u/akash)\ **Replies:** 6\ **Last updated:** [August 23, 2017, 10:14am UTC](https://discuss.elastic.co/t/high-elastic-search-heap-memory-consumption-while-indexing-huge-files/98004 "2017-08-23T10:14:54Z")
Hi, We are trying to index large files in elastic search. Elastic heap memory consumption shoots up while indexing. Basic observation is that while indexing memory can go upto 30x and post indexing it remains at around… --- ## [Elasticsearch - indexing too slow](https://discuss.elastic.co/t/elasticsearch-indexing-too-slow/98046)
**Author:** [@cca](https://discuss.elastic.co/u/cca)\ **Replies:** 0\ **Last updated:** [August 23, 2017, 10:02am UTC](https://discuss.elastic.co/t/elasticsearch-indexing-too-slow/98046 "2017-08-23T10:02:14Z")
Hello, I took back an application which works with elasticsearch v2.4.4. The indexation 2.8 of documents takes 9 hours. I would like to improve this ? Actually I have two nodes elasticsearch on two server with 1 shards… --- ## [May i change the indices folder name as my own using logstash](https://discuss.elastic.co/t/may-i-change-the-indices-folder-name-as-my-own-using-logstash/98045)
**Author:** [@suganth](https://discuss.elastic.co/u/suganth)\ **Replies:** 0\ **Last updated:** [August 23, 2017, 9:54am UTC](https://discuss.elastic.co/t/may-i-change-the-indices-folder-name-as-my-own-using-logstash/98045 "2017-08-23T09:54:21Z")
Hi, My requirement is when the logstash giving input to the elasticsearch it starts creating indices in the data directory currently the indices folder name is like this “8Vrmw6l3ToWu32FQ7nuWUw” my requirement is this n… --- ## [ELK Stack on production system](https://discuss.elastic.co/t/elk-stack-on-production-system/98035)
**Author:** [@Prachi\_Mishra](https://discuss.elastic.co/u/Prachi_Mishra)\ **Replies:** 0\ **Last updated:** [August 23, 2017, 9:15am UTC](https://discuss.elastic.co/t/elk-stack-on-production-system/98035 "2017-08-23T09:15:08Z")
I was doing some research on ELK Stack on my local machine .And the work has been appreciated by the higher management however I need some approval from our security team before installing it in my production machine . I… --- ## [Nested Filtered Aggregations](https://discuss.elastic.co/t/nested-filtered-aggregations/97939)
**Author:** [@Ben\_G](https://discuss.elastic.co/u/Ben_G)\ **Replies:** 1\ **Last updated:** [August 23, 2017, 7:51am UTC](https://discuss.elastic.co/t/nested-filtered-aggregations/97939 "2017-08-23T07:51:38Z")
I’m looking for a way to get the min and max value from a 2 level nested object which have been filtered. So below im trying to get the min and max price which has a currencyCode GBP. Each product can have multiple skus … --- ## [Alternate for synonyms](https://discuss.elastic.co/t/alternate-for-synonyms/98015)
**Author:** [@Vinothkumar](https://discuss.elastic.co/u/Vinothkumar)\ **Replies:** 0\ **Last updated:** [August 23, 2017, 7:25am UTC](https://discuss.elastic.co/t/alternate-for-synonyms/98015 "2017-08-23T07:25:46Z")
Is there any other alternative to access synonyms except synonms.txt and wordsnet configuration? --- ## [Updating Nested type](https://discuss.elastic.co/t/updating-nested-type/98014)
**Author:** [@hatim.stovewala](https://discuss.elastic.co/u/hatim.stovewala)\ **Replies:** 0\ **Last updated:** [August 23, 2017, 7:20am UTC](https://discuss.elastic.co/t/updating-nested-type/98014 "2017-08-23T07:20:13Z")
Assume I have a Document with Nested Document as: { "dept\_name" : "IT", "dept\_code" : "IT", "staffs" : \[ { "emp\_name" : "A", "emp\_id" : "1", "emp\_salary" : "10000" }, { "emp\_name" : "B", "emp\_id… --- ## [Storing Message in an Array for Slack Notification](https://discuss.elastic.co/t/storing-message-in-an-array-for-slack-notification/97949)
**Author:** [@lincoln.coe](https://discuss.elastic.co/u/lincoln.coe)\ **Replies:** 1\ **Last updated:** [August 23, 2017, 7:07am UTC](https://discuss.elastic.co/t/storing-message-in-an-array-for-slack-notification/97949 "2017-08-23T07:07:01Z")
I’ve got most of my watcher setup and running, but right now I’m trying to get the message from all hits to return in the slack notification, but I get a Warning Internal Server Error when saving it and I’m not sure wher… --- ## [Split documents & store/retrieve data](https://discuss.elastic.co/t/split-documents-store-retrieve-data/98011)
**Author:** [@karthickv](https://discuss.elastic.co/u/karthickv)\ **Replies:** 0\ **Last updated:** [August 23, 2017, 6:51am UTC](https://discuss.elastic.co/t/split-documents-store-retrieve-data/98011 "2017-08-23T06:51:04Z")
Hi, I’m saving time-based stats into ES index. I know that we can split index on a daily/weekly basis. However i need to know if the same is possible with documents. In short i want to know if i can split & save the doc… --- ## [How can I perform Fraud Detection using Graph feature in X-Pack?](https://discuss.elastic.co/t/how-can-i-perform-fraud-detection-using-graph-feature-in-x-pack/95715)
**Author:** [@PinkiMondal](https://discuss.elastic.co/u/PinkiMondal)\ **Replies:** 2\ **Last updated:** [August 23, 2017, 5:10am UTC](https://discuss.elastic.co/t/how-can-i-perform-fraud-detection-using-graph-feature-in-x-pack/95715 "2017-08-23T05:10:22Z")
I am using Elastic , Kibana version 5.5.1 and integrated X-Pack with Kibana. Now I want to check how Fraud Detection is being done through Graph feature. Please explain with example… --- ## [X-pack license email triggering](https://discuss.elastic.co/t/x-pack-license-email-triggering/97849)
**Author:** [@Dibyakanta](https://discuss.elastic.co/u/Dibyakanta)\ **Replies:** 8\ **Last updated:** [August 23, 2017, 4:38am UTC](https://discuss.elastic.co/t/x-pack-license-email-triggering/97849 "2017-08-23T04:38:23Z")
Continuing the discussion from The license: a stab in the dark: Hi, I want to ask whether there is any utility to trigger email before some days of expiration? Thanks in advance. --- ## [Reduce default shards for dynamic index](https://discuss.elastic.co/t/reduce-default-shards-for-dynamic-index/97989)
**Author:** [@niraj\_kumar](https://discuss.elastic.co/u/niraj_kumar)\ **Replies:** 2\ **Last updated:** [August 23, 2017, 3:48am UTC](https://discuss.elastic.co/t/reduce-default-shards-for-dynamic-index/97989 "2017-08-23T03:48:17Z")
Hi Everyone, I am processing logs via logstash and this creates new dynamic indexes based on a pattern. How can i reduce the default number of shards from 5 to 3. – Niraj --- ## [Home Lab/Network ELK Stack Hardware Requirements](https://discuss.elastic.co/t/home-lab-network-elk-stack-hardware-requirements/97990)
**Author:** [@NubaScuba](https://discuss.elastic.co/u/NubaScuba)\ **Replies:** 3\ **Last updated:** [August 23, 2017, 3:00am UTC](https://discuss.elastic.co/t/home-lab-network-elk-stack-hardware-requirements/97990 "2017-08-23T03:00:42Z")
Hi All, Brand new to to the Elk Stack and I’ve been reading/lurking through lots of different stuff and my brain is getting fried as i can’t seem to find information specific enough to a home lab. Any information would … --- ## [Problem creating query](https://discuss.elastic.co/t/problem-creating-query/96634)
**Author:** [@Jhon\_David\_Castillo](https://discuss.elastic.co/u/Jhon_David_Castillo)\ **Replies:** 4\ **Last updated:** [August 22, 2017, 10:12pm UTC](https://discuss.elastic.co/t/problem-creating-query/96634 "2017-08-22T22:12:42Z")
I need to create a query that throws the following: { “occurrences”: \[ { “providerName”: “”, “resourceCount”: 123, “registryCount”: 123 } \] } It would be a kind of groupby by ProviderName I have done the follo… --- ## [Reading mutilevel nested field in spark dataframe](https://discuss.elastic.co/t/reading-mutilevel-nested-field-in-spark-dataframe/97640)
**Author:** [@prabhushrikant](https://discuss.elastic.co/u/prabhushrikant)\ **Replies:** 2\ **Last updated:** [August 22, 2017, 9:02pm UTC](https://discuss.elastic.co/t/reading-mutilevel-nested-field-in-spark-dataframe/97640 "2017-08-22T21:02:23Z")
I am trying to read a mutli-level nested field “affiliations.org.orgName” using spark connector in following index {"userId": 402885, "userUuid": "F2896A1F1A7D411A69", "firstName": "T… [Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1969) [Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1971)