# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1200

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1201

---

## [Failed to find metadata for existing index .kibana\_task\_manager \[location: Yi\_UxiceTwS093xLAQJpzw, generation: 30\]](https://discuss.elastic.co/t/failed-to-find-metadata-for-existing-index-kibana-task-manager-location-yi-uxicetws093xlaqjpzw-generation-30/194023)

<div class="topic-metadata">

**Author:** [@Felipe\_Cabral\_Jeroni](https://discuss.elastic.co/u/Felipe_Cabral_Jeroni)\
**Replies:** 4\
**Last updated:** [August 6, 2019, 2:39pm UTC](https://discuss.elastic.co/t/failed-to-find-metadata-for-existing-index-kibana-task-manager-location-yi-uxicetws093xlaqjpzw-generation-30/194023 "2019-08-06T14:39:50Z")

</div>

Hi all, Due to a disk space problem, I've deleted the indexes and now I'm getting the following error: java.io.IOException: failed to find metadata for existing index .kibana\_task\_manager \[location: Yi\_UxiceTwS093xLAQJ…

---

## [Nested aggregation crashes cluster all the time](https://discuss.elastic.co/t/nested-aggregation-crashes-cluster-all-the-time/194034)

<div class="topic-metadata">

**Author:** [@zatom](https://discuss.elastic.co/u/zatom)\
**Replies:** 0\
**Last updated:** [August 6, 2019, 2:26pm UTC](https://discuss.elastic.co/t/nested-aggregation-crashes-cluster-all-the-time/194034 "2019-08-06T14:26:39Z")

</div>

I have had working queries with nested aggregation before with size of millions for field and ids. But, this time I am having issue with similar nested aggregation for 2 different fields. It is crashing the cluster all t…

---

## [Nested terms aggregations - min\_doc\_count isn't returning key-wise(field in terms) 0 for empty buckets](https://discuss.elastic.co/t/nested-terms-aggregations-min-doc-count-isnt-returning-key-wise-field-in-terms-0-for-empty-buckets/194027)

<div class="topic-metadata">

**Author:** [@saurabh-bhosale](https://discuss.elastic.co/u/saurabh-bhosale)\
**Replies:** 0\
**Last updated:** [August 6, 2019, 2:13pm UTC](https://discuss.elastic.co/t/nested-terms-aggregations-min-doc-count-isnt-returning-key-wise-field-in-terms-0-for-empty-buckets/194027 "2019-08-06T14:13:09Z")

</div>

{ "size": 0, "aggs" : { "level\_one\_aggregation": { "date\_range": { "field": "index\_field\_one", "format": "yyyy-MM-dd", "ranges": \[{ "from": "2019-01-01", …

---

## [Inverted full text search](https://discuss.elastic.co/t/inverted-full-text-search/194014)

<div class="topic-metadata">

**Author:** [@Aleksandr\_Ivannikov](https://discuss.elastic.co/u/Aleksandr_Ivannikov)\
**Replies:** 1\
**Last updated:** [August 6, 2019, 1:28pm UTC](https://discuss.elastic.co/t/inverted-full-text-search/194014 "2019-08-06T13:28:31Z")

</div>

Hi, When it comes to full text search, use case we usually mean is: there are documents with more or less long text (articles) and we want to find certain comparatively short phrase matches inside those articles. Is it…

---

## [Hide page from results](https://discuss.elastic.co/t/hide-page-from-results/194008)

<div class="topic-metadata">

**Author:** [@mccWeb](https://discuss.elastic.co/u/mccWeb)\
**Replies:** 0\
**Last updated:** [August 6, 2019, 12:30pm UTC](https://discuss.elastic.co/t/hide-page-from-results/194008 "2019-08-06T12:30:34Z")

</div>

Greetings, How do I hide a section of the website temporarily, until approved, from search results? Thank you, L.

---

## [ILM policy setup for automated deployment system](https://discuss.elastic.co/t/ilm-policy-setup-for-automated-deployment-system/193985)

<div class="topic-metadata">

**Author:** [@somi](https://discuss.elastic.co/u/somi)\
**Replies:** 4\
**Last updated:** [August 6, 2019, 12:12pm UTC](https://discuss.elastic.co/t/ilm-policy-setup-for-automated-deployment-system/193985 "2019-08-06T12:12:02Z")

</div>

Hello there, I am working on the development of a monitoring application for a large scale distributed system and lately I am facing an elastic setup problem, hope you guys can help me out. First of all, I have to poin…

---

## [Filter\_path usage](https://discuss.elastic.co/t/filter-path-usage/193054)

<div class="topic-metadata">

**Author:** [@rubpa](https://discuss.elastic.co/u/rubpa)\
**Replies:** 3\
**Last updated:** [August 6, 2019, 12:04pm UTC](https://discuss.elastic.co/t/filter-path-usage/193054 "2019-08-06T12:04:04Z")

</div>

I have used templates to tune the number of replicas and over time I've a number of templates. I don't remember the exact names. GET \_template gives very verbose output because of a huge number of internal templates (st…

---

## [End-User Customize Field Names](https://discuss.elastic.co/t/end-user-customize-field-names/193803)

<div class="topic-metadata">

**Author:** [@rockso](https://discuss.elastic.co/u/rockso)\
**Replies:** 2\
**Last updated:** [August 6, 2019, 11:35am UTC](https://discuss.elastic.co/t/end-user-customize-field-names/193803 "2019-08-06T11:35:05Z")

</div>

I am building a project that allows the user to export data to Elasticsearch. The users have asked for the ability to change several of the field names that my project uses so that my project's data matches their other e…

---

## [How can i approach to object in object using scripted fields??](https://discuss.elastic.co/t/how-can-i-approach-to-object-in-object-using-scripted-fields/193995)

<div class="topic-metadata">

**Author:** [@hyungsun\_lim](https://discuss.elastic.co/u/hyungsun_lim)\
**Replies:** 0\
**Last updated:** [August 6, 2019, 11:21am UTC](https://discuss.elastic.co/t/how-can-i-approach-to-object-in-object-using-scripted-fields/193995 "2019-08-06T11:21:38Z")

</div>

How can i approach to object in object using scripted fields? I have data like below: human : \[ { info : \[ { type: "A" user: "a@domain.com" }, { type: "B" user: "a@domain.com" } \] }, { info : \[ { type:…

---

## [\[ImageURL\] query malformed, no start\_object after query name](https://discuss.elastic.co/t/imageurl-query-malformed-no-start-object-after-query-name/193988)

<div class="topic-metadata">

**Author:** [@nauman76](https://discuss.elastic.co/u/nauman76)\
**Replies:** 0\
**Last updated:** [August 6, 2019, 10:53am UTC](https://discuss.elastic.co/t/imageurl-query-malformed-no-start-object-after-query-name/193988 "2019-08-06T10:53:51Z")

</div>

I have the following request json for ES query. It gives me error "\[ImageURL\] query malformed, no start\_object after query name" Where i am doing wrong? Please help. I want to get records where "ImageURL" is not null { …

---

## [How to fetch data from elasticsearch by an external reporting application .?](https://discuss.elastic.co/t/how-to-fetch-data-from-elasticsearch-by-an-external-reporting-application/193986)

<div class="topic-metadata">

**Author:** [@ritesh\_singh](https://discuss.elastic.co/u/ritesh_singh)\
**Replies:** 0\
**Last updated:** [August 6, 2019, 10:46am UTC](https://discuss.elastic.co/t/how-to-fetch-data-from-elasticsearch-by-an-external-reporting-application/193986 "2019-08-06T10:46:42Z")

</div>

I have a large amount of data in my elasticsearch and i have to get the data of some fields for a specific time periods (based on the specific value of some fields) for a reporting application.Please provide me the best …

---

## [Can we use basic elastic package for commercial use](https://discuss.elastic.co/t/can-we-use-basic-elastic-package-for-commercial-use/192230)

<div class="topic-metadata">

**Author:** [@ragnar1290](https://discuss.elastic.co/u/ragnar1290)\
**Replies:** 2\
**Last updated:** [August 6, 2019, 10:46am UTC](https://discuss.elastic.co/t/can-we-use-basic-elastic-package-for-commercial-use/192230 "2019-08-06T10:46:28Z")

</div>

Hi Team, I want to know can we use basic package of elasticsearch,kibana and logstash for commercial use cases.

---

## [About monitoring error](https://discuss.elastic.co/t/about-monitoring-error/193979)

<div class="topic-metadata">

**Author:** [@lugo](https://discuss.elastic.co/u/lugo)\
**Replies:** 1\
**Last updated:** [August 6, 2019, 10:31am UTC](https://discuss.elastic.co/t/about-monitoring-error/193979 "2019-08-06T10:31:03Z")

</div>

I seem to have deleted some indexes about kibana before. Then I started to report errors. I updated the ES version and kibana version, or I was still reporting errors. \[2019-08-06T18:19:39,689\]\[WARN \]\[o.e.x.m.e.l.Loca…

---

## [While searching a string I cannot retrieve strings which consist of a symbol(.,& ) between characters](https://discuss.elastic.co/t/while-searching-a-string-i-cannot-retrieve-strings-which-consist-of-a-symbol-between-characters/193978)

<div class="topic-metadata">

**Author:** [@Chetan\_Pandey](https://discuss.elastic.co/u/Chetan_Pandey)\
**Replies:** 0\
**Last updated:** [August 6, 2019, 10:24am UTC](https://discuss.elastic.co/t/while-searching-a-string-i-cannot-retrieve-strings-which-consist-of-a-symbol-between-characters/193978 "2019-08-06T10:24:08Z")

</div>

\----\> I am using elastic search 7.3, My data consists of strings like K&S K.S. K S KS KS. when I search for K S I don't get any result for K&S. I have tried normalizer for this problem but still not getting relevant res…

---

## [Secure connection on HTTP layer](https://discuss.elastic.co/t/secure-connection-on-http-layer/193805)

<div class="topic-metadata">

**Author:** [@Ayush\_Mathur](https://discuss.elastic.co/u/Ayush_Mathur)\
**Replies:** 13\
**Last updated:** [August 6, 2019, 10:18am UTC](https://discuss.elastic.co/t/secure-connection-on-http-layer/193805 "2019-08-06T10:18:21Z")

</div>

I currently have 3 node ES cluster running on 6.2.3 version with transport security configured successfully. Now I'm planning to secure the HTTP client connections to my cluster by following steps mentioned in : https:…

---

## [Conditionally add a new field to existing data in elastic search](https://discuss.elastic.co/t/conditionally-add-a-new-field-to-existing-data-in-elastic-search/193456)

<div class="topic-metadata">

**Author:** [@feb](https://discuss.elastic.co/u/feb)\
**Replies:** 6\
**Last updated:** [August 6, 2019, 10:05am UTC](https://discuss.elastic.co/t/conditionally-add-a-new-field-to-existing-data-in-elastic-search/193456 "2019-08-06T10:05:03Z")

</div>

Hello there. New to Elastic Search. Kindly suggest a solution to add a new field conditionally to my document current data in ElasticSearch "\_index": "test", "\_type": "logs", "\_id": "AWDgIKFCvg3odC71dRbc", "\_score":…

---

## [Elastic is not running on port 9200](https://discuss.elastic.co/t/elastic-is-not-running-on-port-9200/193960)

<div class="topic-metadata">

**Author:** [@tomsk](https://discuss.elastic.co/u/tomsk)\
**Replies:** 2\
**Last updated:** [August 6, 2019, 9:09am UTC](https://discuss.elastic.co/t/elastic-is-not-running-on-port-9200/193960 "2019-08-06T09:09:14Z")

</div>

Hello, l started Elasticsearch using docker-compose.yml: version: '2' services: elasticsearch: image: docker.elastic.co/elasticsearch/elasticsearch:5.6.16 container\_name: elasticsearch restart: unless-stop…

---

## [Is it normal for elastic search to occupy 12 gb of ram](https://discuss.elastic.co/t/is-it-normal-for-elastic-search-to-occupy-12-gb-of-ram/193945)

<div class="topic-metadata">

**Author:** [@iaskdoubt](https://discuss.elastic.co/u/iaskdoubt)\
**Replies:** 3\
**Last updated:** [August 6, 2019, 9:07am UTC](https://discuss.elastic.co/t/is-it-normal-for-elastic-search-to-occupy-12-gb-of-ram/193945 "2019-08-06T09:07:25Z")

</div>

Hi we are using elastic search and have a per day index with a event per second of around 900 and each event having a size of .5 ~ 2 kB . The problem is that our elastic search is occupying a lot of memory .. can any on…

---

## [Ingest processor: Attaching header information to all the following log entries](https://discuss.elastic.co/t/ingest-processor-attaching-header-information-to-all-the-following-log-entries/193966)

<div class="topic-metadata">

**Author:** [@EldrosKandar](https://discuss.elastic.co/u/EldrosKandar)\
**Replies:** 0\
**Last updated:** [August 6, 2019, 9:03am UTC](https://discuss.elastic.co/t/ingest-processor-attaching-header-information-to-all-the-following-log-entries/193966 "2019-08-06T09:03:43Z")

</div>

I'm using Filebeat and Ingest node to feed my ELK stack with logs. The first line of the log is an header with a different format but information relevant to the rest of the log entries. Is there a way to forward this in…

---

## [Filter by script](https://discuss.elastic.co/t/filter-by-script/193917)

<div class="topic-metadata">

**Author:** [@sinhnguyen](https://discuss.elastic.co/u/sinhnguyen)\
**Replies:** 1\
**Last updated:** [August 6, 2019, 8:42am UTC](https://discuss.elastic.co/t/filter-by-script/193917 "2019-08-06T08:42:43Z")

</div>

I would like to get records had updatedAt value at least 6 months ago from now. filter: { script: { // 186 \* 24 \* 60 \* 60 \* 1000 = 16070400000 (186 days ago ~ 6 months) script: "doc\['latestScrape'\].value \<= (new Dat…

---

## [Intermittent unknown host exception in elasticsearch](https://discuss.elastic.co/t/intermittent-unknown-host-exception-in-elasticsearch/193958)

<div class="topic-metadata">

**Author:** [@Vivek\_Vardhan](https://discuss.elastic.co/u/Vivek_Vardhan)\
**Replies:** 0\
**Last updated:** [August 6, 2019, 8:03am UTC](https://discuss.elastic.co/t/intermittent-unknown-host-exception-in-elasticsearch/193958 "2019-08-06T08:03:14Z")

</div>

Hi Team, I am getting intermittently, unknown host exception while bulk inserting data in elasticsearch. \[INFO \] 2019-08-05 07:29:54.859 \[pool-4-thread-1\] ElasticSearchRestClient - Total Time taken: 1326 \[INFO \] 2019-0…

---

## [Elasticsearch goes down when there's lot of data to search](https://discuss.elastic.co/t/elasticsearch-goes-down-when-theres-lot-of-data-to-search/193498)

<div class="topic-metadata">

**Author:** [@javidr](https://discuss.elastic.co/u/javidr)\
**Replies:** 3\
**Last updated:** [August 6, 2019, 7:59am UTC](https://discuss.elastic.co/t/elasticsearch-goes-down-when-theres-lot-of-data-to-search/193498 "2019-08-06T07:59:59Z")

</div>

Hi I have an index with almost 1 million documents, and when i set the time range for more than 30 days, it gives me a timeout, and the elasticsearch instance goes down. Any idea what could be the problem? I assume the…

---

## [Clustering Dockerized Elasticsearch with multiple Docker Host](https://discuss.elastic.co/t/clustering-dockerized-elasticsearch-with-multiple-docker-host/193950)

<div class="topic-metadata">

**Author:** [@ts-kazuob](https://discuss.elastic.co/u/ts-kazuob)\
**Replies:** 0\
**Last updated:** [August 6, 2019, 7:30am UTC](https://discuss.elastic.co/t/clustering-dockerized-elasticsearch-with-multiple-docker-host/193950 "2019-08-06T07:30:30Z")

</div>

Trying to make it clustering with docker compose. I have two elasticsearch docker containers which are deployed in different Docker Hosts. docker-compose.yml for docker-container-1 services: elasticsearch: rest…

---

## [Result window is too large error in custom plugin](https://discuss.elastic.co/t/result-window-is-too-large-error-in-custom-plugin/193949)

<div class="topic-metadata">

**Author:** [@masterThomas](https://discuss.elastic.co/u/masterThomas)\
**Replies:** 0\
**Last updated:** [August 6, 2019, 7:26am UTC](https://discuss.elastic.co/t/result-window-is-too-large-error-in-custom-plugin/193949 "2019-08-06T07:26:46Z")

</div>

hi team, i m writing my custom plugin in Kibana and use table in EUI to visualize events. So when i click to 241403 page it comes to error " Result window is too large, from + size must be less than or equal to: \[10000\]…

---

## [Elastic Service SAML with Okta](https://discuss.elastic.co/t/elastic-service-saml-with-okta/193915)

<div class="topic-metadata">

**Author:** [@ajhstn](https://discuss.elastic.co/u/ajhstn)\
**Replies:** 1\
**Last updated:** [August 6, 2019, 7:02am UTC](https://discuss.elastic.co/t/elastic-service-saml-with-okta/193915 "2019-08-06T07:02:21Z")

</div>

Hello - trying to configure SSO using SAML with our external iDP provider, Okta. I am following this document. https://www.elastic.co/guide/en/cloud/release-ms-25/ec-securing-clusters-SAML.html After completing the st…

---

## [How to use elasticsearch-setup-passwords with TLS and selfsigned certificates?](https://discuss.elastic.co/t/how-to-use-elasticsearch-setup-passwords-with-tls-and-selfsigned-certificates/193795)

<div class="topic-metadata">

**Author:** [@asp](https://discuss.elastic.co/u/asp)\
**Replies:** 6\
**Last updated:** [August 6, 2019, 5:29am UTC](https://discuss.elastic.co/t/how-to-use-elasticsearch-setup-passwords-with-tls-and-selfsigned-certificates/193795 "2019-08-06T05:29:14Z")

</div>

Hi, I ran an existing Cluster 7.2.0 without xpack security in kubernetes. I am using self signed pem certificates which I have created with elasticsearch-certutils. Configuration is completely done via environment vari…

---

## [How to filter a line in field](https://discuss.elastic.co/t/how-to-filter-a-line-in-field/193718)

<div class="topic-metadata">

**Author:** [@Smkumaran](https://discuss.elastic.co/u/Smkumaran)\
**Replies:** 2\
**Last updated:** [August 6, 2019, 3:18am UTC](https://discuss.elastic.co/t/how-to-filter-a-line-in-field/193718 "2019-08-06T03:18:46Z")

</div>

Hello, In my case, one of the field has following texts: (connectionIP =RDP) To login \[from 08/08/2019 5:30 AM to 09/08/2019 4:00 PM (GMT+8.00) multiple operations\]. Can anyone help me to filter inbetween pls ? . Th…

---

## [About Rolling upgrade problem](https://discuss.elastic.co/t/about-rolling-upgrade-problem/193902)

<div class="topic-metadata">

**Author:** [@lugo](https://discuss.elastic.co/u/lugo)\
**Replies:** 1\
**Last updated:** [August 6, 2019, 2:42am UTC](https://discuss.elastic.co/t/about-rolling-upgrade-problem/193902 "2019-08-06T02:42:15Z")

</div>

I upgraded from 6.5 to 6.5.1, we have 3node. I upgrade according to official documents But the results are different from what is shown in the document. The document says: Before upgrading the next node, wait for t…

---

## [Workaround for scroll on nested aggregation](https://discuss.elastic.co/t/workaround-for-scroll-on-nested-aggregation/193906)

<div class="topic-metadata">

**Author:** [@i4never](https://discuss.elastic.co/u/i4never)\
**Replies:** 0\
**Last updated:** [August 6, 2019, 2:25am UTC](https://discuss.elastic.co/t/workaround-for-scroll-on-nested-aggregation/193906 "2019-08-06T02:25:25Z")

</div>

I've read this but this feature is merged for 6.7.0. Is there any workaround for scroll nested aggregation for version 6.5?

---

## [How to reindex, to remove unwanted nested structure](https://discuss.elastic.co/t/how-to-reindex-to-remove-unwanted-nested-structure/193617)

<div class="topic-metadata">

**Author:** [@weed101](https://discuss.elastic.co/u/weed101)\
**Replies:** 2\
**Last updated:** [August 6, 2019, 2:16am UTC](https://discuss.elastic.co/t/how-to-reindex-to-remove-unwanted-nested-structure/193617 "2019-08-06T02:16:38Z")

</div>

Hi, I'm trying to reindex an index of nested records into an index that is more flat and cleaner. Is there a way to handle painless scripts with using the root field name as my column and the nested value as its value? …

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1199)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1201)
