# Elasticsearch **URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=754 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 755 --- ## [Already deleted indices comes back as dangling whenever a node restarts](https://discuss.elastic.co/t/already-deleted-indices-comes-back-as-dangling-whenever-a-node-restarts/256841)
**Author:** [@jatin\_gupta](https://discuss.elastic.co/u/jatin_gupta)\ **Replies:** 14\ **Last updated:** [November 29, 2020, 7:55am UTC](https://discuss.elastic.co/t/already-deleted-indices-comes-back-as-dangling-whenever-a-node-restarts/256841 "2020-11-29T07:55:12Z")
Hi, I am running a 8 node ES cluster with version 7.4.2 Everytime a node on the cluster restarts the state becomes red as a lot of dangling indices which are already deleted tries to get restored on the cluster. Only … --- ## [Confusion about licensing for Stack Monitoring](https://discuss.elastic.co/t/confusion-about-licensing-for-stack-monitoring/256956)
**Author:** [@ffknob](https://discuss.elastic.co/u/ffknob)\ **Replies:** 1\ **Last updated:** [November 29, 2020, 2:51am UTC](https://discuss.elastic.co/t/confusion-about-licensing-for-stack-monitoring/256956 "2020-11-29T02:51:47Z")
I have a Platinum subscription fo a cluster in the Elastic Cloud. I'll use this cluster to monitor many other clusters... some of them are licensed, most of them are not. So, in order to be able to use the "Multi-Stack … --- ## [Index on Elastic search contains and starts with search](https://discuss.elastic.co/t/index-on-elastic-search-contains-and-starts-with-search/256968)
**Author:** [@arup\_chakraborty](https://discuss.elastic.co/u/arup_chakraborty)\ **Replies:** 0\ **Last updated:** [November 28, 2020, 11:47pm UTC](https://discuss.elastic.co/t/index-on-elastic-search-contains-and-starts-with-search/256968 "2020-11-28T23:47:54Z")
We are using elastic search for faster searching on our organization data . The data model has organization id, address, organization name, business start date and organization contacts array . We have asked to perform … --- ## [Dynamic template to convert all types to string](https://discuss.elastic.co/t/dynamic-template-to-convert-all-types-to-string/256960)
**Author:** [@nunogt](https://discuss.elastic.co/u/nunogt)\ **Replies:** 0\ **Last updated:** [November 28, 2020, 6:03pm UTC](https://discuss.elastic.co/t/dynamic-template-to-convert-all-types-to-string/256960 "2020-11-28T18:03:46Z")
Hi there, Consider the following logstash json filter snippet: json { skip\_on\_invalid\_json =\> true source =\> "message\_body" target =\> "jsondoc" } which results on the following logstash… --- ## [How to use go-elasticsearch library with gin framework?](https://discuss.elastic.co/t/how-to-use-go-elasticsearch-library-with-gin-framework/256941)
**Author:** [@iooi](https://discuss.elastic.co/u/iooi)\ **Replies:** 0\ **Last updated:** [November 28, 2020, 8:59am UTC](https://discuss.elastic.co/t/how-to-use-go-elasticsearch-library-with-gin-framework/256941 "2020-11-28T08:59:56Z")
Using gin for API. Its route.go func Init(api \*gin.Engine) { r := api.Group("/v1") r.GET("/sites/search/:url", site.Search) } In the controller file, want to use go-elasticsearch for searching ES data. import… --- ## [Cannot remove field with ingest processor](https://discuss.elastic.co/t/cannot-remove-field-with-ingest-processor/256828)
**Author:** [@tatdat](https://discuss.elastic.co/u/tatdat)\ **Replies:** 3\ **Last updated:** [November 28, 2020, 8:07am UTC](https://discuss.elastic.co/t/cannot-remove-field-with-ingest-processor/256828 "2020-11-28T08:07:29Z")
I using ES 7.9.0 My data { "\_index": "original-index-2020.11", "\_type": "\_doc", "\_id": "7K27Bas23a", "\_version": 1, "\_score": null, "\_source": { "http.request.auth": "-", … --- ## [Default logs format filebeat](https://discuss.elastic.co/t/default-logs-format-filebeat/256933)
**Author:** [@Supun\_Madushanka](https://discuss.elastic.co/u/Supun_Madushanka)\ **Replies:** 0\ **Last updated:** [November 28, 2020, 5:21am UTC](https://discuss.elastic.co/t/default-logs-format-filebeat/256933 "2020-11-28T05:21:47Z")
I am new to elk stack. i configure filebeat and elk and kibana I have nodejs application. I write logs in to file. now i send the row log for the elk. here is my log format {phase} {ip} {room} {message} ${JSON.stringif… --- ## [How to monitor Elasticsearch snapshots](https://discuss.elastic.co/t/how-to-monitor-elasticsearch-snapshots/256037)
**Author:** [@mwise29](https://discuss.elastic.co/u/mwise29)\ **Replies:** 13\ **Last updated:** [November 28, 2020, 4:53am UTC](https://discuss.elastic.co/t/how-to-monitor-elasticsearch-snapshots/256037 "2020-11-28T04:53:47Z")
I'd like advice on how to monitor snapshots. Is there a way to do it via a monitor? We'd only want the status of the last snapshot taken (report either success or failed). --- ## [TimeOut Error during indexing](https://discuss.elastic.co/t/timeout-error-during-indexing/256312)
**Author:** [@amir\_veyseh](https://discuss.elastic.co/u/amir_veyseh)\ **Replies:** 5\ **Last updated:** [November 28, 2020, 4:51am UTC](https://discuss.elastic.co/t/timeout-error-during-indexing/256312 "2020-11-28T04:51:12Z")
I have installed EleasticSearch using the instructions from here. I run it using systemd. I have also made the following changes in the configuration: Disabling swap Change heap size to 20 GB Set refresh interval to -1 … --- ## [How to restore indices younger than](https://discuss.elastic.co/t/how-to-restore-indices-younger-than/256927)
**Author:** [@Juan\_Bertolotti](https://discuss.elastic.co/u/Juan_Bertolotti)\ **Replies:** 1\ **Last updated:** [November 28, 2020, 4:49am UTC](https://discuss.elastic.co/t/how-to-restore-indices-younger-than/256927 "2020-11-28T04:49:26Z")
Hi All, Im looking for a way to restore specific indices from a snapshot, lets say I wan yo restore just the latest 15 days. Is there any way to achieve that? Ive tried curator with no luck yet. Im running ELK 6.8.8 --- ## [Ingesting O365 logs but having issues with specific mappings](https://discuss.elastic.co/t/ingesting-o365-logs-but-having-issues-with-specific-mappings/256081)
**Author:** [@victor.nilsson](https://discuss.elastic.co/u/victor.nilsson)\ **Replies:** 5\ **Last updated:** [November 27, 2020, 8:33pm UTC](https://discuss.elastic.co/t/ingesting-o365-logs-but-having-issues-with-specific-mappings/256081 "2020-11-27T20:33:52Z")
Hi, We are using Filebeat with the O365 module. These events get shipped to Redis which then Logstash fetches from. The logs are getting ingested but some of the events are having mapping issues with the field "o365.aud… --- ## [Having an issue while trying to reindex using a script](https://discuss.elastic.co/t/having-an-issue-while-trying-to-reindex-using-a-script/256915)
**Author:** [@tarek](https://discuss.elastic.co/u/tarek)\ **Replies:** 1\ **Last updated:** [November 27, 2020, 8:29pm UTC](https://discuss.elastic.co/t/having-an-issue-while-trying-to-reindex-using-a-script/256915 "2020-11-27T20:29:38Z")
Hello, So, I'm trying to reindex documents into a new index with a stored script. the used script has a parameter called "increment". when I start reindexing, I get a null pointer exception. This is my code. POST \_sc… --- ## [Perform search on ES but limit to hot nodes only?](https://discuss.elastic.co/t/perform-search-on-es-but-limit-to-hot-nodes-only/256782)
**Author:** [@smlbiobot](https://discuss.elastic.co/u/smlbiobot)\ **Replies:** 8\ **Last updated:** [November 27, 2020, 8:16pm UTC](https://discuss.elastic.co/t/perform-search-on-es-but-limit-to-hot-nodes-only/256782 "2020-11-27T20:16:34Z")
We have employed a hot-warm architecture in our cluster, and the indices share the same prefix. Right now, to keep our process sane, we do this to our indices: Reindex the original index named name-YYYY.MM into a new i… --- ## [Can any one tell me to make aggregation on dynamic field\_name or restructure data](https://discuss.elastic.co/t/can-any-one-tell-me-to-make-aggregation-on-dynamic-field-name-or-restructure-data/255412)
**Author:** [@tushar.sharma.cse](https://discuss.elastic.co/u/tushar.sharma.cse)\ **Replies:** 2\ **Last updated:** [November 27, 2020, 6:54pm UTC](https://discuss.elastic.co/t/can-any-one-tell-me-to-make-aggregation-on-dynamic-field-name-or-restructure-data/255412 "2020-11-27T18:54:58Z")
{"updated\_on":"2020-11-15","journal":{"2020-10-20":"a","2020-10-21":"b"}} {"updated\_on":"2020-11-14","journal":{"2020-10-21":"c","2020-10-23":"b"}} How to form aggregation query based on “journal” hash key’s(where k… --- ## [Filter Aggregation on nested object ... not working as expected!](https://discuss.elastic.co/t/filter-aggregation-on-nested-object-not-working-as-expected/256718)
**Author:** [@Guillaume\_R](https://discuss.elastic.co/u/Guillaume_R)\ **Replies:** 6\ **Last updated:** [November 27, 2020, 6:53pm UTC](https://discuss.elastic.co/t/filter-aggregation-on-nested-object-not-working-as-expected/256718 "2020-11-27T18:53:08Z")
Hello, I have some product like this { "id\_product" : "180", "name" : "Domane AL 3 femme", "manufacturer" : "TREK", "cat\_path" : "Product\>377~velos~Vélos\>35~route~Route\>44~course… --- ## [Network.host or http.host - documentation problem?](https://discuss.elastic.co/t/network-host-or-http-host-documentation-problem/64179)
**Author:** [@tsmori](https://discuss.elastic.co/u/tsmori)\ **Replies:** 28\ **Last updated:** [November 27, 2020, 5:01pm UTC](https://discuss.elastic.co/t/network-host-or-http-host-documentation-problem/64179 "2020-11-27T17:01:04Z")
The default works fine, however it's only binding to localhost. I want to be able to bind elasticsearch to a non-loopback IP. Docs say this is possible, but setting 0.0.0.0 or the actual adapater IP results in the follo… --- ## [Shard hit count & miss count](https://discuss.elastic.co/t/shard-hit-count-miss-count/256896)
**Author:** [@nyquillus](https://discuss.elastic.co/u/nyquillus)\ **Replies:** 0\ **Last updated:** [November 27, 2020, 3:28pm UTC](https://discuss.elastic.co/t/shard-hit-count-miss-count/256896 "2020-11-27T15:28:45Z")
Hi, I've got some instances where i see x hits and y misses on some of my shards. The only question on my mind is what is hit count and miss count. Could someone please explain this to me simply? Thanks in advance. --- ## [Kibana index pattern don't show data with time filter field name](https://discuss.elastic.co/t/kibana-index-pattern-dont-show-data-with-time-filter-field-name/256741)
**Author:** [@gyana\_nayak](https://discuss.elastic.co/u/gyana_nayak)\ **Replies:** 9\ **Last updated:** [November 27, 2020, 2:08pm UTC](https://discuss.elastic.co/t/kibana-index-pattern-dont-show-data-with-time-filter-field-name/256741 "2020-11-27T14:08:13Z")
i am trying to create an index from Java code to index some data but if i am creating index pattern with time filter Kibana never shows any data. Following below order while creating index with some setting and adding an… --- ## [Index doesn't want to be stored in hot node](https://discuss.elastic.co/t/index-doesnt-want-to-be-stored-in-hot-node/256876)
**Author:** [@xziten](https://discuss.elastic.co/u/xziten)\ **Replies:** 0\ **Last updated:** [November 27, 2020, 12:44pm UTC](https://discuss.elastic.co/t/index-doesnt-want-to-be-stored-in-hot-node/256876 "2020-11-27T12:44:32Z")
Hi, I have an elastic cluster with : 3 master nodes : roles \[ data, master \] 1 hot node : roles \[ data\_hot \] 2 warm nodes : roles \[ data\_warm \] 3 cold nodes : roles \[ data\_cold \] ELK Version : 7.10 I setted up an … --- ## [Backup and restore of elasticsearch indices](https://discuss.elastic.co/t/backup-and-restore-of-elasticsearch-indices/256855)
**Author:** [@rohitarorait82](https://discuss.elastic.co/u/rohitarorait82)\ **Replies:** 1\ **Last updated:** [November 27, 2020, 11:34am UTC](https://discuss.elastic.co/t/backup-and-restore-of-elasticsearch-indices/256855 "2020-11-27T11:34:40Z")
Hi All, Backup team has taken the backup of path.data folder and provided us the backup. I copied the folder and placed in new server. I have given the same folder in path.data property of elasticsearch.yml in new clus… --- ## [Cannot get scrolling to work when trying to extract more than 10,000 results](https://discuss.elastic.co/t/cannot-get-scrolling-to-work-when-trying-to-extract-more-than-10-000-results/256861)
**Author:** [@terry433iid](https://discuss.elastic.co/u/terry433iid)\ **Replies:** 0\ **Last updated:** [November 27, 2020, 9:56am UTC](https://discuss.elastic.co/t/cannot-get-scrolling-to-work-when-trying-to-extract-more-than-10-000-results/256861 "2020-11-27T09:56:03Z")
I have an index ('jenkins\_job\_logs') that stores console logs from jenkins jobs, the index fields include the actual console data plus a unique ID for the jenkins job ('task\_id'), there are 30k plus documents in the inde… --- ## [Not able to update Null values in elastic search using Nest with field mapping](https://discuss.elastic.co/t/not-able-to-update-null-values-in-elastic-search-using-nest-with-field-mapping/256834)
**Author:** [@prvn\_prasher](https://discuss.elastic.co/u/prvn_prasher)\ **Replies:** 0\ **Last updated:** [November 27, 2020, 4:07am UTC](https://discuss.elastic.co/t/not-able-to-update-null-values-in-elastic-search-using-nest-with-field-mapping/256834 "2020-11-27T04:07:56Z")
I just noticed I couldn't able to update null values in existing properties. For example, i am trying to update the Date. I am using Nest with C# with field mapping. So I think serialization ignoring null values. I tr… --- ## [Need than throttle restart for watcher](https://discuss.elastic.co/t/need-than-throttle-restart-for-watcher/256830)
**Author:** [@Juan\_David\_Jaramillo](https://discuss.elastic.co/u/Juan_David_Jaramillo)\ **Replies:** 0\ **Last updated:** [November 27, 2020, 12:48am UTC](https://discuss.elastic.co/t/need-than-throttle-restart-for-watcher/256830 "2020-11-27T00:48:01Z")
hello, i have a watcher, with the time throttle, i used the api ack, i executed it with the id of the watcher and the action, but it did not work, since it does not restart the time throttle, which is what i need so that… --- ## [HowTo Filter documents contain duplicates in array with PainLess](https://discuss.elastic.co/t/howto-filter-documents-contain-duplicates-in-array-with-painless/256829)
**Author:** [@vsmelov](https://discuss.elastic.co/u/vsmelov)\ **Replies:** 0\ **Last updated:** [November 27, 2020, 12:27am UTC](https://discuss.elastic.co/t/howto-filter-documents-contain-duplicates-in-array-with-painless/256829 "2020-11-27T00:27:31Z")
I have documents like {"tokens" \[ {"city": "RU-Moscow", ...}, {"city": "RU-Piter", ...}, {"city": "RU-Moscow", ...}, {"city": "GE-Berlin", ...}, {"city": "NL-Amsterdam", ...} {"city": "NL-Amst… --- ## [Filtering documents by an unknown value of a field](https://discuss.elastic.co/t/filtering-documents-by-an-unknown-value-of-a-field/256768)
**Author:** [@jonatelo](https://discuss.elastic.co/u/jonatelo)\ **Replies:** 1\ **Last updated:** [November 26, 2020, 9:07pm UTC](https://discuss.elastic.co/t/filtering-documents-by-an-unknown-value-of-a-field/256768 "2020-11-26T21:07:05Z")
Hi, I'm trying to create a query to filter my documents by one (can be anyone) value from a field (in my case "host.name"). The point is that I don't know previously the unique values of this field. I need found these … --- ## [Create a new column with the hash of an existing column](https://discuss.elastic.co/t/create-a-new-column-with-the-hash-of-an-existing-column/256779)
**Author:** [@p1k4chu](https://discuss.elastic.co/u/p1k4chu)\ **Replies:** 1\ **Last updated:** [November 26, 2020, 8:30pm UTC](https://discuss.elastic.co/t/create-a-new-column-with-the-hash-of-an-existing-column/256779 "2020-11-26T20:30:55Z")
I have an elasticsearch index to which I want to add a new column whose value is going to be the hash(sha256 or md5) of an existing column. Manually doing it isn't feasible as the index has more than 600,000,000 document… --- ## [Mixing proximity with exact an not exact](https://discuss.elastic.co/t/mixing-proximity-with-exact-an-not-exact/256824)
**Author:** [@Sucaz](https://discuss.elastic.co/u/Sucaz)\ **Replies:** 0\ **Last updated:** [November 26, 2020, 8:22pm UTC](https://discuss.elastic.co/t/mixing-proximity-with-exact-an-not-exact/256824 "2020-11-26T20:22:41Z")
Hi, Is there a way to mix search of words in distance, where one word is exact and the other one isn't, with query\_string? something like: (Exact("Fox") quick)~2 Is it a combination of quote\_field\_suffix (as in http… --- ## [Adding a basic user/pass authentication for ElasticSearch](https://discuss.elastic.co/t/adding-a-basic-user-pass-authentication-for-elasticsearch/256822)
**Author:** [@yattaes](https://discuss.elastic.co/u/yattaes)\ **Replies:** 0\ **Last updated:** [November 26, 2020, 8:17pm UTC](https://discuss.elastic.co/t/adding-a-basic-user-pass-authentication-for-elasticsearch/256822 "2020-11-26T20:17:14Z")
Hi, I deployed Elasticsearch with the following the page below to my Azure Kubernetes environment. Deploy an Elasticsearch cluster | Elastic Cloud on Kubernetes \[master\] | Elastic It works fine. But I want to add a… --- ## [OOM on Elasticsearch client](https://discuss.elastic.co/t/oom-on-elasticsearch-client/256821)
**Author:** [@vikramc](https://discuss.elastic.co/u/vikramc)\ **Replies:** 0\ **Last updated:** [November 26, 2020, 8:03pm UTC](https://discuss.elastic.co/t/oom-on-elasticsearch-client/256821 "2020-11-26T20:03:52Z")
Hi All, We are using ES 6.8.0 and we see that our applicaiton is going out of memory after certain crossing certain threshold of data processing. We see that there are lots of “io.netty.channel.ChannelOutboundBuffer$Ent… --- ## [How to delete all documents that a field have specific length?](https://discuss.elastic.co/t/how-to-delete-all-documents-that-a-field-have-specific-length/256813)
**Author:** [@Ehsan\_sarshar](https://discuss.elastic.co/u/Ehsan_sarshar)\ **Replies:** 1\ **Last updated:** [November 26, 2020, 7:13pm UTC](https://discuss.elastic.co/t/how-to-delete-all-documents-that-a-field-have-specific-length/256813 "2020-11-26T19:13:43Z")
for example I have following documents { term: "bo" }, { term: "book" } I want to delete all documents that "term" field length is less than 3 [Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=753) [Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=755)