# Elasticsearch **URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=741 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 742 --- ## [Is there any way to validate other APIs like create index or update\_by\_query before executing it?](https://discuss.elastic.co/t/is-there-any-way-to-validate-other-apis-like-create-index-or-update-by-query-before-executing-it/258539)
**Author:** [@Graywd](https://discuss.elastic.co/u/Graywd)\ **Replies:** 2\ **Last updated:** [December 16, 2020, 2:36am UTC](https://discuss.elastic.co/t/is-there-any-way-to-validate-other-apis-like-create-index-or-update-by-query-before-executing-it/258539 "2020-12-16T02:36:44Z")
The situation is that before the es statement real executes I need to validate it to guarantee it will work at the time point expected. Runtime error can be tolerated while the semantic error is not. Thanks. --- ## [Issues while upgrading to Docker based Elastic Stack 7.10.1](https://discuss.elastic.co/t/issues-while-upgrading-to-docker-based-elastic-stack-7-10-1/258790)
**Author:** [@nielarshi](https://discuss.elastic.co/u/nielarshi)\ **Replies:** 1\ **Last updated:** [December 16, 2020, 12:05am UTC](https://discuss.elastic.co/t/issues-while-upgrading-to-docker-based-elastic-stack-7-10-1/258790 "2020-12-16T00:05:59Z")
I am trying to upgrade my Elastic Stack to 7.10.1 from 7.1.1 but facing some issues. I already have 7.1.1 version setup with 3 docker nodes cluster which works fine. I followed below to upgrade to 7.10.1 version with s… --- ## [Setting up security in elasticsearch](https://discuss.elastic.co/t/setting-up-security-in-elasticsearch/258751)
**Author:** [@joret](https://discuss.elastic.co/u/joret)\ **Replies:** 1\ **Last updated:** [December 15, 2020, 11:03pm UTC](https://discuss.elastic.co/t/setting-up-security-in-elasticsearch/258751 "2020-12-15T23:03:28Z")
I have Elasticsearch set up in server and Java in another server. the java application communicates with Elasticsearch . I need to implement SSL certificate between JAVA and Elasticsearch communication --- ## [How to add authentication connexion to ELK ( with password )?](https://discuss.elastic.co/t/how-to-add-authentication-connexion-to-elk-with-password/258724)
**Author:** [@winstonsmith](https://discuss.elastic.co/u/winstonsmith)\ **Replies:** 2\ **Last updated:** [December 15, 2020, 10:58pm UTC](https://discuss.elastic.co/t/how-to-add-authentication-connexion-to-elk-with-password/258724 "2020-12-15T22:58:10Z")
Hello i want to do a few things how to dd the ELK login authentication (login and pwd) how to change the Kibana logo with another Thanks --- ## [Frozen indices and shard limitation](https://discuss.elastic.co/t/frozen-indices-and-shard-limitation/258702)
**Author:** [@Travis](https://discuss.elastic.co/u/Travis)\ **Replies:** 4\ **Last updated:** [December 15, 2020, 10:29pm UTC](https://discuss.elastic.co/t/frozen-indices-and-shard-limitation/258702 "2020-12-15T22:29:53Z")
Hello all ! I know the number of shards is limited by the amount of heap. For example, on my hot node, I have 30GB of heap so limit is 600 shards on this node (20 shards par GB of heap) But what about the limit for col… --- ## [Monitoring hot threads and tasks](https://discuss.elastic.co/t/monitoring-hot-threads-and-tasks/258782)
**Author:** [@liorg2](https://discuss.elastic.co/u/liorg2)\ **Replies:** 0\ **Last updated:** [December 15, 2020, 9:48pm UTC](https://discuss.elastic.co/t/monitoring-hot-threads-and-tasks/258782 "2020-12-15T21:48:20Z")
Hello, I was wondering what is the best way to monitor tasks and hot threads, and maybe event to create a dashboard with their data --- ## [ElasticSearch didn't start at first try](https://discuss.elastic.co/t/elasticsearch-didnt-start-at-first-try/258747)
**Author:** [@kae](https://discuss.elastic.co/u/kae)\ **Replies:** 2\ **Last updated:** [December 15, 2020, 9:01pm UTC](https://discuss.elastic.co/t/elasticsearch-didnt-start-at-first-try/258747 "2020-12-15T21:01:10Z")
Hello Everyone, during deployment of my VM in my POD, ElasticSearch didn't start. issue on Journalctl is following : Dec 15 17:33:05 systemd\[1\]: Starting Elasticsearch... -- Subject: Unit elasticsearch.service has be… --- ## [Manage multiple indicies with one ILM-Policy](https://discuss.elastic.co/t/manage-multiple-indicies-with-one-ilm-policy/258733)
**Author:** [@cwiechmann](https://discuss.elastic.co/u/cwiechmann)\ **Replies:** 2\ **Last updated:** [December 15, 2020, 8:33pm UTC](https://discuss.elastic.co/t/manage-multiple-indicies-with-one-ilm-policy/258733 "2020-12-15T20:33:03Z")
Hi All, I have the following structure of indices, that are created as needed, based on a template, to store documents received from a different regions: some-data-from-region-us-000001 some-data-from-region-eu-000001 … --- ## [Elasticsearch 7.10.1 - Indexing term\_vector for search\_as\_you\_type field issue](https://discuss.elastic.co/t/elasticsearch-7-10-1-indexing-term-vector-for-search-as-you-type-field-issue/258456)
**Author:** [@chandra2037](https://discuss.elastic.co/u/chandra2037)\ **Replies:** 4\ **Last updated:** [December 15, 2020, 8:20pm UTC](https://discuss.elastic.co/t/elasticsearch-7-10-1-indexing-term-vector-for-search-as-you-type-field-issue/258456 "2020-12-15T20:20:47Z")
Hi, Elasticsearch Version: 7.10.1 Getting the following error when trying to index a document {"\_index":"test1","\_type":"\_doc","\_id":"1000370980","status":400,"error":{"type":"illegal\_argument\_exception","reason":"can… --- ## [Error in start of elasticsearch on ubuntu \[first installation\]](https://discuss.elastic.co/t/error-in-start-of-elasticsearch-on-ubuntu-first-installation/258528)
**Author:** [@vlsireddy](https://discuss.elastic.co/u/vlsireddy)\ **Replies:** 3\ **Last updated:** [December 15, 2020, 7:55pm UTC](https://discuss.elastic.co/t/error-in-start-of-elasticsearch-on-ubuntu-first-installation/258528 "2020-12-15T19:55:33Z")
HI, \[1\] I Installed elastic search and tried starting it and i see this error. kryogen@Ubuntu:~/Documents/elastic/elasticsearch-7.10.1$ ./bin/elasticsearch Exception in thread "main" SettingsException\[Failed to load s… --- ## [Correctly map converted timestamps in watcher payload](https://discuss.elastic.co/t/correctly-map-converted-timestamps-in-watcher-payload/258748)
**Author:** [@esguy](https://discuss.elastic.co/u/esguy)\ **Replies:** 0\ **Last updated:** [December 15, 2020, 6:46pm UTC](https://discuss.elastic.co/t/correctly-map-converted-timestamps-in-watcher-payload/258748 "2020-12-15T18:46:31Z")
I am running into an issue where I can correctly convert document timestamps within a watcher payload and store into a list but I am unsure how to correctly map this to the returned payload. Hopefully some code will hel… --- ## [How to collect information using remote script and visualise them in. dedicated Kibana visualization?](https://discuss.elastic.co/t/how-to-collect-information-using-remote-script-and-visualise-them-in-dedicated-kibana-visualization/258564)
**Author:** [@Mauro\_Tridici](https://discuss.elastic.co/u/Mauro_Tridici)\ **Replies:** 6\ **Last updated:** [December 15, 2020, 6:15pm UTC](https://discuss.elastic.co/t/how-to-collect-information-using-remote-script-and-visualise-them-in-dedicated-kibana-visualization/258564 "2020-12-15T18:15:40Z")
Dear Users, I started using ELK stack from a few days, so I'm not an expert. After a very basic ELK stack deploy, everything seems to be running as expected. Now, I would like to: execute a script on a remote server,… --- ## [Can't connect to cluster when master node is off](https://discuss.elastic.co/t/cant-connect-to-cluster-when-master-node-is-off/258634)
**Author:** [@hamidreza\_ghadir](https://discuss.elastic.co/u/hamidreza_ghadir)\ **Replies:** 6\ **Last updated:** [December 15, 2020, 5:30pm UTC](https://discuss.elastic.co/t/cant-connect-to-cluster-when-master-node-is-off/258634 "2020-12-15T17:30:27Z")
Hi, I have a cluster with three node. When master node is turned off , I can't connect to any of nodes with their addresses. MasterNode: 0.0.0.0:9200, Node2: 0.0.0.0:9201, Node3: 0.0.0.0:9202 with this configuration: … --- ## [CPU usage per Index](https://discuss.elastic.co/t/cpu-usage-per-index/258743)
**Author:** [@valleram](https://discuss.elastic.co/u/valleram)\ **Replies:** 2\ **Last updated:** [December 15, 2020, 5:28pm UTC](https://discuss.elastic.co/t/cpu-usage-per-index/258743 "2020-12-15T17:28:07Z")
Hello All, I want to know if there is an existing way in Elasticsearch to monitor CPU usage per index. Any help would be much appreciate it? Thank you --- ## [Elastic Search service is stopped and disabled in services.msc](https://discuss.elastic.co/t/elastic-search-service-is-stopped-and-disabled-in-services-msc/257672)
**Author:** [@Bhavrendra](https://discuss.elastic.co/u/Bhavrendra)\ **Replies:** 4\ **Last updated:** [December 15, 2020, 2:05pm UTC](https://discuss.elastic.co/t/elastic-search-service-is-stopped-and-disabled-in-services-msc/257672 "2020-12-15T14:05:09Z")
Hi, i have a machine with 1 node, 16gb RAM and 500gb HDD. I'm using filebeats to read data for around 15 applications and each days index is reading and storing around 53gb of logs data per day. Recently when i see that … --- ## [Validation Failed: 1: this action would add \[2\] total shards, but this cluster currently has \[2000\]/\[2000\] maximum shards open](https://discuss.elastic.co/t/validation-failed-1-this-action-would-add-2-total-shards-but-this-cluster-currently-has-2000-2000-maximum-shards-open/257064)
**Author:** [@rneema1](https://discuss.elastic.co/u/rneema1)\ **Replies:** 5\ **Last updated:** [December 15, 2020, 1:21pm UTC](https://discuss.elastic.co/t/validation-failed-1-this-action-would-add-2-total-shards-but-this-cluster-currently-has-2000-2000-maximum-shards-open/257064 "2020-12-15T13:21:02Z")
I'm using Elastic 7.6.2 I'm creating an index using a pipeline, Reading and sending text file through the filebeat and sending to a pipeline. I'm getting this error : Validation Failed: 1: this action would add \[2\] … --- ## [How to link/stitch-together events in an efficient way?](https://discuss.elastic.co/t/how-to-link-stitch-together-events-in-an-efficient-way/258611)
**Author:** [@kelk](https://discuss.elastic.co/u/kelk)\ **Replies:** 2\ **Last updated:** [December 15, 2020, 1:07pm UTC](https://discuss.elastic.co/t/how-to-link-stitch-together-events-in-an-efficient-way/258611 "2020-12-15T13:07:41Z")
We have following data from auditD type=SYSCALL msg=audit(1607953823.861:1184699): arch=c000003e syscall=263 success=yes exit=0 a0=ffffffffffffff9c a1=17780c0 a2=0 a3=7ffe280a6ae0 items=2 ppid=45207 pid=45248 auid=1002 … --- ## [Field Name length more than 255](https://discuss.elastic.co/t/field-name-length-more-than-255/258592)
**Author:** [@srikanthkadem](https://discuss.elastic.co/u/srikanthkadem)\ **Replies:** 2\ **Last updated:** [December 15, 2020, 1:03pm UTC](https://discuss.elastic.co/t/field-name-length-more-than-255/258592 "2020-12-15T13:03:11Z")
Hi Team, I am facing issue in Syncing data into Elastic , upon investigatation I found that few of my fields name is more than 255. I trimmed it 250 to see if Sync working fine, it worked. Can you please help me in incr… --- ## [Two specific nodes with 100% CPU](https://discuss.elastic.co/t/two-specific-nodes-with-100-cpu/258591)
**Author:** [@Lior\_Yakobov](https://discuss.elastic.co/u/Lior_Yakobov)\ **Replies:** 3\ **Last updated:** [December 15, 2020, 11:49am UTC](https://discuss.elastic.co/t/two-specific-nodes-with-100-cpu/258591 "2020-12-15T11:49:25Z")
Hello, We are experiencing for a few days now a scenario which 2 nodes are at 100% CPU usage. I can tell that these are searches as the search pool and search queue are filled, but I cannot figure out from where they a… --- ## [Failed to create elasticsearch client](https://discuss.elastic.co/t/failed-to-create-elasticsearch-client/256243)
**Author:** [@Deviad](https://discuss.elastic.co/u/Deviad)\ **Replies:** 1\ **Last updated:** [December 15, 2020, 10:45am UTC](https://discuss.elastic.co/t/failed-to-create-elasticsearch-client/256243 "2020-12-15T10:45:50Z")
Hello everyone, I pasted all the files in here: I am running elasticsearch in a container and fscrawler throws: 19:06:59.272 \[main\] FATAL fr.pilato.elasticsearch.crawler.fs.cli.FsCrawlerCli - We can not start Elas… --- ## [I can not run elasticsearch command](https://discuss.elastic.co/t/i-can-not-run-elasticsearch-command/258652)
**Author:** [@Vlad\_Dumitru](https://discuss.elastic.co/u/Vlad_Dumitru)\ **Replies:** 3\ **Last updated:** [December 15, 2020, 10:36am UTC](https://discuss.elastic.co/t/i-can-not-run-elasticsearch-command/258652 "2020-12-15T10:36:08Z")
OS: Manjaro STEPS: I was following this tutorial in order to install elasticsearch If I'm trying to run elasticsearch I will get this error: /usr/bin/elasticsearch-env: line 128: cd: /usr/share/elasticsearch/conf… --- ## [Select distinct value from multiple indexes](https://discuss.elastic.co/t/select-distinct-value-from-multiple-indexes/258696)
**Author:** [@ahmedbrandver](https://discuss.elastic.co/u/ahmedbrandver)\ **Replies:** 0\ **Last updated:** [December 15, 2020, 10:17am UTC](https://discuss.elastic.co/t/select-distinct-value-from-multiple-indexes/258696 "2020-12-15T10:17:59Z")
Hello, how can I add a aggregation to get data based on unique field of multiple indexes. Let's say I have three different indexes in which they have a unique code but one unique code can be exists in different field of … --- ## [\[esaggs\] \> Too Many Requests 7.8.1](https://discuss.elastic.co/t/esaggs-too-many-requests-7-8-1/258694)
**Author:** [@raja.yerrabothula](https://discuss.elastic.co/u/raja.yerrabothula)\ **Replies:** 0\ **Last updated:** [December 15, 2020, 10:09am UTC](https://discuss.elastic.co/t/esaggs-too-many-requests-7-8-1/258694 "2020-12-15T10:09:26Z")
i have a production elasticsearch and kibana installed, when generating a report cannot add more three columns and limit to 5 rows only, my requirement is around 63K rows when generating this report i am getting \[esaggs\]… --- ## [Elastic thinks that it uses all RAM](https://discuss.elastic.co/t/elastic-thinks-that-it-uses-all-ram/258688)
**Author:** [@ThreatInter](https://discuss.elastic.co/u/ThreatInter)\ **Replies:** 0\ **Last updated:** [December 15, 2020, 9:37am UTC](https://discuss.elastic.co/t/elastic-thinks-that-it-uses-all-ram/258688 "2020-12-15T09:37:22Z")
Hello, I noticed one thing about our cluster. When I made curl request (curl -XGET 'http://h1-es01:9200/\_nodes/stats/os?pretty') I saw this: h1-es01 "mem" : { "total\_in\_bytes" : 134885113856, … --- ## [How to set java path for elasticsearch](https://discuss.elastic.co/t/how-to-set-java-path-for-elasticsearch/258686)
**Author:** [@Aniket\_Pant](https://discuss.elastic.co/u/Aniket_Pant)\ **Replies:** 2\ **Last updated:** [December 15, 2020, 9:36am UTC](https://discuss.elastic.co/t/how-to-set-java-path-for-elasticsearch/258686 "2020-12-15T09:36:14Z")
I have java-11 i want to add JAVA\_HOME path in elasticsearch how can i do this i edit this in /etc/default/elasticsearch but when do GET /\_cluster/stats/ it give me output "jvm" : { "max\_uptime\_in\_millis" : 105897… --- ## [How force to move to Warm phase](https://discuss.elastic.co/t/how-force-to-move-to-warm-phase/258685)
**Author:** [@Anabella\_Cristaldi](https://discuss.elastic.co/u/Anabella_Cristaldi)\ **Replies:** 2\ **Last updated:** [December 15, 2020, 9:21am UTC](https://discuss.elastic.co/t/how-force-to-move-to-warm-phase/258685 "2020-12-15T09:21:56Z")
Hi, I have an index in a hot phase, which was completed After n days from roll over the index will enter the warm phase and it will be relocated to the warm node. Is it possible to force the index to move to the warm … --- ## [UDP Message from Filebeat to ElasticSearch to Grafana - How to filter for my value?](https://discuss.elastic.co/t/udp-message-from-filebeat-to-elasticsearch-to-grafana-how-to-filter-for-my-value/258302)
**Author:** [@dewell](https://discuss.elastic.co/u/dewell)\ **Replies:** 1\ **Last updated:** [December 15, 2020, 8:52am UTC](https://discuss.elastic.co/t/udp-message-from-filebeat-to-elasticsearch-to-grafana-how-to-filter-for-my-value/258302 "2020-12-15T08:52:06Z")
Hello, with the help of several guides I tried to show a constant UDP stream of double values (10 8byte double values each second) in a line chart in Grafana but I'm not sure how to get the value from elasticsearch into… --- ## [How to put filters for 700+ users to know their count of logins daily basis](https://discuss.elastic.co/t/how-to-put-filters-for-700-users-to-know-their-count-of-logins-daily-basis/258483)
**Author:** [@kirankrish](https://discuss.elastic.co/u/kirankrish)\ **Replies:** 4\ **Last updated:** [December 15, 2020, 8:23am UTC](https://discuss.elastic.co/t/how-to-put-filters-for-700-users-to-know-their-count-of-logins-daily-basis/258483 "2020-12-15T08:23:43Z")
We have logs which captures users logged in and these users can be upto 700+. We need to know the count of each user logged in on a daily basis. What is the optimum way to handle this? --- ## [Snapshots - guarantee of correctness?](https://discuss.elastic.co/t/snapshots-guarantee-of-correctness/258025)
**Author:** [@Rysiu](https://discuss.elastic.co/u/Rysiu)\ **Replies:** 5\ **Last updated:** [December 15, 2020, 7:35am UTC](https://discuss.elastic.co/t/snapshots-guarantee-of-correctness/258025 "2020-12-15T07:35:35Z")
Are the snapshots made by elasticsearch surely not to have any errors? Is there any additional option to quickly check the correctness of generated snapshots? --- ## [Need some explanation on Watcher execution](https://discuss.elastic.co/t/need-some-explanation-on-watcher-execution/258399)
**Author:** [@prajwalgmpp](https://discuss.elastic.co/u/prajwalgmpp)\ **Replies:** 3\ **Last updated:** [December 15, 2020, 7:11am UTC](https://discuss.elastic.co/t/need-some-explanation-on-watcher-execution/258399 "2020-12-15T07:11:39Z")
Under watch execution, it is noted that "On each node, that contains one of the .watches shards, a scheduler, that is bound to the watcher lifecycle runs. On each node, that contains one of the .watches shards, a sched… [Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=740) [Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=742)