# Elasticsearch **URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=591 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 592 --- ## [Unassigned shards Inquiry](https://discuss.elastic.co/t/unassigned-shards-inquiry/281477)
**Author:** [@nadler](https://discuss.elastic.co/u/nadler)\ **Replies:** 6\ **Last updated:** [August 17, 2021, 8:16am UTC](https://discuss.elastic.co/t/unassigned-shards-inquiry/281477 "2021-08-17T08:16:46Z")
Hi, One of our teams in the company has complained that every week or so they get an alert for unassigned shards on their cluster. They asked me to look for the cause of the issue. My question is: Is there a way to se… --- ## [How to analyze JVM heap memory ？](https://discuss.elastic.co/t/how-to-analyze-jvm-heap-memory/281631)
**Author:** [@casterQ](https://discuss.elastic.co/u/casterQ)\ **Replies:** 4\ **Last updated:** [August 17, 2021, 7:24am UTC](https://discuss.elastic.co/t/how-to-analyze-jvm-heap-memory/281631 "2021-08-17T07:24:29Z")
I want to know where memory used in es, as shown in the following figure：21.3gb memory used now in this node.i know some of them, such as: indices.queries.cache.size indices.fielddata.cache.size index.requests.cache.si… --- ## [How to set up security for elasticsearch cluster](https://discuss.elastic.co/t/how-to-set-up-security-for-elasticsearch-cluster/281552)
**Author:** [@0d153a83fd88577dba87](https://discuss.elastic.co/u/0d153a83fd88577dba87)\ **Replies:** 10\ **Last updated:** [August 17, 2021, 6:42am UTC](https://discuss.elastic.co/t/how-to-set-up-security-for-elasticsearch-cluster/281552 "2021-08-17T06:42:34Z")
network.host: ip1 discovery.seed\_hosts: \["ip1", "ip2"\] cluster.initial\_master\_nodes: \["ip1"\] network.host: ip2 discovery.seed\_hosts: \["ip1", "ip2"\] cluster.initial\_master\_nodes: \["ip1"\] these are two yml files o… --- ## [No subsecond precision for apache logs](https://discuss.elastic.co/t/no-subsecond-precision-for-apache-logs/281614)
**Author:** [@rizvaughan](https://discuss.elastic.co/u/rizvaughan)\ **Replies:** 6\ **Last updated:** [August 17, 2021, 4:47am UTC](https://discuss.elastic.co/t/no-subsecond-precision-for-apache-logs/281614 "2021-08-17T04:47:43Z")
Hello all, I have apache logs coming into elasticsearch(aws). The logs are being created in epoch 'format'. I am using td-agent for the transportation. I tried different methods to transform the date to humand readable … --- ## [Data migration between elastic clusters](https://discuss.elastic.co/t/data-migration-between-elastic-clusters/281363)
**Author:** [@shanavas](https://discuss.elastic.co/u/shanavas)\ **Replies:** 3\ **Last updated:** [August 17, 2021, 4:28am UTC](https://discuss.elastic.co/t/data-migration-between-elastic-clusters/281363 "2021-08-17T04:28:04Z")
We have two es clusters, one running on premise and another one on the cloud. The one premise one can't store data for more than a week. The cloud cluster retains the data for a longer duration (a few months). So the … --- ## [Configuring indices for monitoring using new template API](https://discuss.elastic.co/t/configuring-indices-for-monitoring-using-new-template-api/281533)
**Author:** [@aoi1](https://discuss.elastic.co/u/aoi1)\ **Replies:** 6\ **Last updated:** [August 17, 2021, 4:03am UTC](https://discuss.elastic.co/t/configuring-indices-for-monitoring-using-new-template-api/281533 "2021-08-17T04:03:17Z")
Hello! I have a question. In this document, it uses \_template API. But I recognize the \_template API is deprecated in Elasticsearch version 7.8. Is this document correct in the version after 7.8? I am trying to conf… --- ## [How can I log 400 Bad Request when creating documents](https://discuss.elastic.co/t/how-can-i-log-400-bad-request-when-creating-documents/281238)
**Author:** [@kiancross](https://discuss.elastic.co/u/kiancross)\ **Replies:** 2\ **Last updated:** [August 17, 2021, 2:20am UTC](https://discuss.elastic.co/t/how-can-i-log-400-bad-request-when-creating-documents/281238 "2021-08-17T02:20:02Z")
When creating documents, I want 400 Bad Requests to be added to the log so I can see clients that are getting errors. Is this possible? --- ## [All shards being reassigned from one of our Warm nodes](https://discuss.elastic.co/t/all-shards-being-reassigned-from-one-of-our-warm-nodes/281203)
**Author:** [@TheEvilDonut](https://discuss.elastic.co/u/TheEvilDonut)\ **Replies:** 3\ **Last updated:** [August 17, 2021, 1:29am UTC](https://discuss.elastic.co/t/all-shards-being-reassigned-from-one-of-our-warm-nodes/281203 "2021-08-17T01:29:59Z")
Good day all. We have noticed a few days ago that all shards from one of our warm data nodes are being rebalanced and reassigned to the other warm nodes. We are currently at a loss at finding the reason. The node itsel… --- ## [Unable to take snapshot - Version 5.6.12](https://discuss.elastic.co/t/unable-to-take-snapshot-version-5-6-12/281262)
**Author:** [@sridharparepalli](https://discuss.elastic.co/u/sridharparepalli)\ **Replies:** 1\ **Last updated:** [August 17, 2021, 1:24am UTC](https://discuss.elastic.co/t/unable-to-take-snapshot-version-5-6-12/281262 "2021-08-17T01:24:24Z")
Hello, I was able to register the snapshot successfully. However, when I try to take a backup I'm getting this error message. "No matches found..." Any help is greatly appreciated. Register Snapshot (works fine): sudo … --- ## [Aggregation with different timezones](https://discuss.elastic.co/t/aggregation-with-different-timezones/281305)
**Author:** [@scorona85](https://discuss.elastic.co/u/scorona85)\ **Replies:** 1\ **Last updated:** [August 17, 2021, 1:22am UTC](https://discuss.elastic.co/t/aggregation-with-different-timezones/281305 "2021-08-17T01:22:03Z")
How can I create an aggregation of datas aquired from different part of Timezones (example New York -6.00 and Rome +2.00). In the document I have a field 'timestamp' defined as "data". I have to create a "date\_histogram"… --- ## [Unrecognized VM option 'UseConcMarkSweepGC' while trying to install ES 7.13.0](https://discuss.elastic.co/t/unrecognized-vm-option-useconcmarksweepgc-while-trying-to-install-es-7-13-0/281307)
**Author:** [@babai7](https://discuss.elastic.co/u/babai7)\ **Replies:** 1\ **Last updated:** [August 17, 2021, 1:20am UTC](https://discuss.elastic.co/t/unrecognized-vm-option-useconcmarksweepgc-while-trying-to-install-es-7-13-0/281307 "2021-08-17T01:20:55Z")
Aug 13 09:16:10 \*\*\*\*\*\*\*\*\* elasticsearch\[1120000\]: error: Aug 13 09:16:10 \*\*\*\*\*\*\*\*\* elasticsearch\[1120000\]: Unrecognized VM option 'UseConcMarkSweepGC' Aug 13 09:16:10 \*\*\*\*\*\*\*\*\* elasticsearch\[1120000\]: Error: Could not … --- ## [Get the full date format in elasticsearch](https://discuss.elastic.co/t/get-the-full-date-format-in-elasticsearch/281310)
**Author:** [@Sandeep\_Raju](https://discuss.elastic.co/u/Sandeep_Raju)\ **Replies:** 1\ **Last updated:** [August 17, 2021, 1:18am UTC](https://discuss.elastic.co/t/get-the-full-date-format-in-elasticsearch/281310 "2021-08-17T01:18:09Z")
Hi all, In an old project, the date fields have been mapped and data is present. Now in Kibana, I can see human readable format of date When i Use GET API to get format of date in devtools, i get ony format of date fi… --- ## [Set elasticsearch initial password via docker-compose](https://discuss.elastic.co/t/set-elasticsearch-initial-password-via-docker-compose/281299)
**Author:** [@naaviin](https://discuss.elastic.co/u/naaviin)\ **Replies:** 1\ **Last updated:** [August 17, 2021, 1:15am UTC](https://discuss.elastic.co/t/set-elasticsearch-initial-password-via-docker-compose/281299 "2021-08-17T01:15:05Z")
Can i know, how to set initial password for elasticsearch database using docker-compose bin/elasticsearch-setup-passwords auto -u "http://192.168.2.120:9200 We can use environment variable however, it will display duri… --- ## [Can't login in kibana on ECK with ldap](https://discuss.elastic.co/t/cant-login-in-kibana-on-eck-with-ldap/281345)
**Author:** [@kbi753](https://discuss.elastic.co/u/kbi753)\ **Replies:** 3\ **Last updated:** [August 17, 2021, 1:10am UTC](https://discuss.elastic.co/t/cant-login-in-kibana-on-eck-with-ldap/281345 "2021-08-17T01:10:41Z")
Hello, We are trying to setup ldap authentication on our elasticsearch infra. Are are using ECK (elastic on kubernetes) I think I did a valid configuration, I don't find any error in the logs.. I even found this in t… --- ## [Sorting the response JSON](https://discuss.elastic.co/t/sorting-the-response-json/281532)
**Author:** [@Anubhav\_Singh1](https://discuss.elastic.co/u/Anubhav_Singh1)\ **Replies:** 1\ **Last updated:** [August 17, 2021, 1:07am UTC](https://discuss.elastic.co/t/sorting-the-response-json/281532 "2021-08-17T01:07:36Z")
I'm using the below synonyms in my elasticsearch index. Road Types avenue,ave,boulevard,blvd,circle,cir,court,ct,drive,dr,highway,hwy,lane,ln,loop,lp,parkway,pkwy,place,pl,road,rd,route,rte,street,st,terrace,ter,trail… --- ## [Design Decision on Elastic Search - Replace Searchable Entity on Primary DB](https://discuss.elastic.co/t/design-decision-on-elastic-search-replace-searchable-entity-on-primary-db/281551)
**Author:** [@CharlieUPB](https://discuss.elastic.co/u/CharlieUPB)\ **Replies:** 1\ **Last updated:** [August 17, 2021, 1:00am UTC](https://discuss.elastic.co/t/design-decision-on-elastic-search-replace-searchable-entity-on-primary-db/281551 "2021-08-17T01:00:16Z")
Hi guys I cant seem to find an answer to this question, can you please clarify my question. I have a normal database such as mongo where I store my domain related data, customers, products, prices. Now I came with the … --- ## [Elastic Seach: master not discovered or elected yet, an election requires at least 2 nodes with ids from](https://discuss.elastic.co/t/elastic-seach-master-not-discovered-or-elected-yet-an-election-requires-at-least-2-nodes-with-ids-from/281564)
**Author:** [@michelefa1988](https://discuss.elastic.co/u/michelefa1988)\ **Replies:** 1\ **Last updated:** [August 17, 2021, 12:57am UTC](https://discuss.elastic.co/t/elastic-seach-master-not-discovered-or-elected-yet-an-election-requires-at-least-2-nodes-with-ids-from/281564 "2021-08-17T00:57:44Z")
Hello, Elastic search was running 7.10.1 was running successfully (via helm chart, however recently I got the following error The configuration is pretty standard (3 nodes 3x masters I would like to know what the corr… --- ## [How does everyone feel about Amazon's prerolled ES service and how they have forked Elasticsearch?](https://discuss.elastic.co/t/how-does-everyone-feel-about-amazons-prerolled-es-service-and-how-they-have-forked-elasticsearch/281417)
**Author:** [@Jason\_Baumgartner](https://discuss.elastic.co/u/Jason_Baumgartner)\ **Replies:** 2\ **Last updated:** [August 16, 2021, 9:02pm UTC](https://discuss.elastic.co/t/how-does-everyone-feel-about-amazons-prerolled-es-service-and-how-they-have-forked-elasticsearch/281417 "2021-08-16T21:02:49Z")
First, I wanted to get other's opinions on Amazon's Elasticsearch service. While they do provide some nice features like nightly snapshots, etc. -- I'm discovering each day more annoying issues with their service. There… --- ## [Master not discovered in the bootstrap cluster](https://discuss.elastic.co/t/master-not-discovered-in-the-bootstrap-cluster/281586)
**Author:** [@kadiveti](https://discuss.elastic.co/u/kadiveti)\ **Replies:** 2\ **Last updated:** [August 16, 2021, 7:24pm UTC](https://discuss.elastic.co/t/master-not-discovered-in-the-bootstrap-cluster/281586 "2021-08-16T19:24:40Z")
Hello All, I tried to set up a simple 3 node elastic cluster. I tried almost the same setup 10 times. Every I see a new issue will come up when setting this. Every time I create this setup from Azure and delete the set… --- ## [Saving y laptop](https://discuss.elastic.co/t/saving-y-laptop/281577)
**Author:** [@testingHackerone](https://discuss.elastic.co/u/testingHackerone)\ **Replies:** 0\ **Last updated:** [August 16, 2021, 5:16pm UTC](https://discuss.elastic.co/t/saving-y-laptop/281577 "2021-08-16T17:16:49Z")
cool --- ## [Failed to execute watch - Timeout waiting for task](https://discuss.elastic.co/t/failed-to-execute-watch-timeout-waiting-for-task/280256)
**Author:** [@Brandon\_Sollins](https://discuss.elastic.co/u/Brandon_Sollins)\ **Replies:** 1\ **Last updated:** [August 16, 2021, 6:22pm UTC](https://discuss.elastic.co/t/failed-to-execute-watch-timeout-waiting-for-task/280256 "2021-08-16T18:22:37Z")
I am noticing random watch timeouts on my cluster that is returning the following traceback: \[2021-07-31T05:08:11,951\]\[DEBUG\]\[o.e.x.w.e.ExecutionService\] failed to execute watch \[\\] org.elasti… --- ## [Where is the object mapping for \[host\] defined?](https://discuss.elastic.co/t/where-is-the-object-mapping-for-host-defined/281541)
**Author:** [@antoineco](https://discuss.elastic.co/u/antoineco)\ **Replies:** 14\ **Last updated:** [August 16, 2021, 2:26pm UTC](https://discuss.elastic.co/t/where-is-the-object-mapping-for-host-defined/281541 "2021-08-16T14:26:42Z")
Context Since the release of Elastic v8.0.0 (alpha), the elasticsearch output of Logstash started throwing the following error, even on a fresh installation: object mapping for \[host\] tried to parse field \[host\] as obj… --- ## [How to sort and aggs the result in nested element](https://discuss.elastic.co/t/how-to-sort-and-aggs-the-result-in-nested-element/281549)
**Author:** [@OmarBO](https://discuss.elastic.co/u/OmarBO)\ **Replies:** 0\ **Last updated:** [August 16, 2021, 1:31pm UTC](https://discuss.elastic.co/t/how-to-sort-and-aggs-the-result-in-nested-element/281549 "2021-08-16T13:31:19Z")
Hello, I'm new to the Elasticsearch and I faced a problem while developing an ES Query. I have an index of reports of patients that every doc is like this one. So each report of one patient { "patient": { "gender… --- ## [Exceptions for Rename Ingest Processor](https://discuss.elastic.co/t/exceptions-for-rename-ingest-processor/281399)
**Author:** [@pkward](https://discuss.elastic.co/u/pkward)\ **Replies:** 1\ **Last updated:** [August 16, 2021, 12:21pm UTC](https://discuss.elastic.co/t/exceptions-for-rename-ingest-processor/281399 "2021-08-16T12:21:25Z")
Hi, I'm trying to create an ingest pipeline to rename fields, if they exist. I see there is an if statement option for the Rename processor, but I'm unsure of how to implement it. I want to do "if" : "ctx.containsKey('… --- ## [How to run Elasticsearch 7.10.2 as root user](https://discuss.elastic.co/t/how-to-run-elasticsearch-7-10-2-as-root-user/281354)
**Author:** [@mba](https://discuss.elastic.co/u/mba)\ **Replies:** 7\ **Last updated:** [August 16, 2021, 11:21am UTC](https://discuss.elastic.co/t/how-to-run-elasticsearch-7-10-2-as-root-user/281354 "2021-08-16T11:21:14Z")
I know we can not run elastic search as root user but still my requirement is to run Elasticsearch 7.10.2 as root user then how to run it ?? --- ## [Match on Ngram field where the words are in order without scripting](https://discuss.elastic.co/t/match-on-ngram-field-where-the-words-are-in-order-without-scripting/281518)
**Author:** [@Ron\_lusha](https://discuss.elastic.co/u/Ron_lusha)\ **Replies:** 0\ **Last updated:** [August 16, 2021, 8:37am UTC](https://discuss.elastic.co/t/match-on-ngram-field-where-the-words-are-in-order-without-scripting/281518 "2021-08-16T08:37:37Z")
Hello, I have a question regarding auto-complete using Ngram search, Im using elasticsearch 7.3, so the new "wildcard" field type is not relevant for me This is my index: PUT ngram\_test { "mappings": { "propertie… --- ## [Trigger In elastic search](https://discuss.elastic.co/t/trigger-in-elastic-search/281458)
**Author:** [@ashurajchandra](https://discuss.elastic.co/u/ashurajchandra)\ **Replies:** 20\ **Last updated:** [August 16, 2021, 10:41am UTC](https://discuss.elastic.co/t/trigger-in-elastic-search/281458 "2021-08-16T10:41:38Z")
I'm working in startup and I got the task of writing trigger for error logs , but not when i'm using PUT \_watcher/watch/diagnostic\_monitor { "metadata" : { "color" : "red" }, "trigger" : { "schedule" : {… --- ## [How to Provide mapping to the API before injesting data to the elasticsearch using logstash conf file](https://discuss.elastic.co/t/how-to-provide-mapping-to-the-api-before-injesting-data-to-the-elasticsearch-using-logstash-conf-file/281061)
**Author:** [@Divyank\_Mahalle](https://discuss.elastic.co/u/Divyank_Mahalle)\ **Replies:** 1\ **Last updated:** [August 16, 2021, 6:58am UTC](https://discuss.elastic.co/t/how-to-provide-mapping-to-the-api-before-injesting-data-to-the-elasticsearch-using-logstash-conf-file/281061 "2021-08-16T06:58:45Z")
Hi, I am using Twilio API for ingesting data to elasticsearch. It is providing Output in the form of JSON. curl -G https://api.twilio.com/2010-04-01/Accounts/ACXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/Usage/Records/LastMonth.… --- ## [Duplicate a document on elasticsearch](https://discuss.elastic.co/t/duplicate-a-document-on-elasticsearch/281504)
**Author:** [@Sandeep\_Raju](https://discuss.elastic.co/u/Sandeep_Raju)\ **Replies:** 1\ **Last updated:** [August 16, 2021, 6:22am UTC](https://discuss.elastic.co/t/duplicate-a-document-on-elasticsearch/281504 "2021-08-16T06:22:50Z")
Hi, I want to create a duplicate document entry in elasticsearch as it has 40 fields associated with it. Also i want to create another document entry with just 1 fields altered. Which command to go about ? --- ## [Search thread pool active and queue not full but rejected happened](https://discuss.elastic.co/t/search-thread-pool-active-and-queue-not-full-but-rejected-happened/281494)
**Author:** [@casterQ](https://discuss.elastic.co/u/casterQ)\ **Replies:** 7\ **Last updated:** [August 16, 2021, 4:20am UTC](https://discuss.elastic.co/t/search-thread-pool-active-and-queue-not-full-but-rejected-happened/281494 "2021-08-16T04:20:12Z")
i found a datanode search thread pool has rejected，but grafana monitor show that moment search threap\_pool ’s active(size=49) and queue(size=2000) is not full，I can't understand why ，please help me。thanks a lot... [Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=590) [Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=592)