# Elasticsearch **URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=820 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 821 --- ## [Elasticsearch Indexing Not Working Periodically](https://discuss.elastic.co/t/elasticsearch-indexing-not-working-periodically/247036)
**Author:** [@jaydba](https://discuss.elastic.co/u/jaydba)\ **Replies:** 6\ **Last updated:** [September 1, 2020, 7:17pm UTC](https://discuss.elastic.co/t/elasticsearch-indexing-not-working-periodically/247036 "2020-09-01T19:17:43Z")
Hello; I am very new to working with Elasticsearch, but I've come up against an error that the vendor of our software (bundled with Elasticsearch) is not able to solve or find a root cause of. Unfortunately I am not se… --- ## [After changing index template, new index not taking the changes](https://discuss.elastic.co/t/after-changing-index-template-new-index-not-taking-the-changes/245465)
**Author:** [@zvazquez](https://discuss.elastic.co/u/zvazquez)\ **Replies:** 8\ **Last updated:** [September 1, 2020, 5:06pm UTC](https://discuss.elastic.co/t/after-changing-index-template-new-index-not-taking-the-changes/245465 "2020-09-01T17:06:09Z")
Hi, I am experiencing a weird problem where I am updating an index template by changing the mapping of a timestamp property from date to date\_nano and even when in the definition of template it shows the proper mapping … --- ## [Multiple small indexes or one index with potential mapping explosion](https://discuss.elastic.co/t/multiple-small-indexes-or-one-index-with-potential-mapping-explosion/244917)
**Author:** [@mcampster](https://discuss.elastic.co/u/mcampster)\ **Replies:** 2\ **Last updated:** [September 1, 2020, 4:22pm UTC](https://discuss.elastic.co/t/multiple-small-indexes-or-one-index-with-potential-mapping-explosion/244917 "2020-09-01T16:22:34Z")
Background Having read the various posts on multiple indexes with small number of document vs single index with all the documents, I still am not sure what to do in my situation... We have a approximately 2-3 million d… --- ## [ES 7.9 doesn't start](https://discuss.elastic.co/t/es-7-9-doesnt-start/246908)
**Author:** [@YURA](https://discuss.elastic.co/u/YURA)\ **Replies:** 7\ **Last updated:** [September 1, 2020, 1:34pm UTC](https://discuss.elastic.co/t/es-7-9-doesnt-start/246908 "2020-09-01T13:34:04Z")
java -version openjdk version "1.8.0\_262" OpenJDK Runtime Environment (build 1.8.0\_262-b10) OpenJDK 64-Bit Server VM (build 25.262-b10, mixed mode) cat /etc/redhat-release CentOS Linux release 7.8.2003 (Core) was i… --- ## [Automatically Delete older Documents](https://discuss.elastic.co/t/automatically-delete-older-documents/247078)
**Author:** [@Arun\_N](https://discuss.elastic.co/u/Arun_N)\ **Replies:** 10\ **Last updated:** [September 1, 2020, 1:16pm UTC](https://discuss.elastic.co/t/automatically-delete-older-documents/247078 "2020-09-01T13:16:54Z")
Hi Team, I need your help to understand how to set TTL like mechanism to delete the Elastic Search documentation automatically once it's reached the expiration time. I have read about delete by query API but the proble… --- ## [TopHitsAggregator objects are not Garbage Collected](https://discuss.elastic.co/t/tophitsaggregator-objects-are-not-garbage-collected/246487)
**Author:** [@parasharsh](https://discuss.elastic.co/u/parasharsh)\ **Replies:** 1\ **Last updated:** [September 1, 2020, 12:57pm UTC](https://discuss.elastic.co/t/tophitsaggregator-objects-are-not-garbage-collected/246487 "2020-09-01T12:57:02Z")
Hi,Recently we saw the OOM on our ES instance. On Checking the Heap Dump in VisulaVM we observed large number of instances of org.apache.lucene.search.ScoreDoc in the HEAP - 41,984,154 The dominators by Retained size (O… --- ## [Wildcard queries on multiple fields and filtering by score](https://discuss.elastic.co/t/wildcard-queries-on-multiple-fields-and-filtering-by-score/247079)
**Author:** [@zamkinos](https://discuss.elastic.co/u/zamkinos)\ **Replies:** 0\ **Last updated:** [September 1, 2020, 11:22am UTC](https://discuss.elastic.co/t/wildcard-queries-on-multiple-fields-and-filtering-by-score/247079 "2020-09-01T11:22:31Z")
I have an index like below: For example user searchs "c 001", I look at search\_all\_fields and find it in two documents. With WildCardQuery for all searching keywords " c " and " 001 " But the second one is useless. … --- ## [Failed to start transform](https://discuss.elastic.co/t/failed-to-start-transform/246273)
**Author:** [@liorg2](https://discuss.elastic.co/u/liorg2)\ **Replies:** 8\ **Last updated:** [September 1, 2020, 10:24am UTC](https://discuss.elastic.co/t/failed-to-start-transform/246273 "2020-09-01T10:24:09Z")
Hi I'm trying to start a transform but keep getting errors and turns the cluster's state into red (sooooo... frustrating ) last message on Kinana is "Created transform." Any help will be appreciated (removing the pain… --- ## [In\_flight\_request is too large and throw \[circuit\_breaking\_exception\] \[parent\] Data too large](https://discuss.elastic.co/t/in-flight-request-is-too-large-and-throw-circuit-breaking-exception-parent-data-too-large/246482)
**Author:** [@greyhats13](https://discuss.elastic.co/u/greyhats13)\ **Replies:** 25\ **Last updated:** [September 1, 2020, 10:21am UTC](https://discuss.elastic.co/t/in-flight-request-is-too-large-and-throw-circuit-breaking-exception-parent-data-too-large/246482 "2020-09-01T10:21:05Z")
{"statusCode":500,"error":"Internal Server Error","message":"\[parent\] Data too large, data for \[indices:data/read/get\[s\]\] would be \[32115499902/29.9gb\], which is larger than the limit of \[31621696716/29.4gb\], real usage:… --- ## [Shards unassigned after some nodes went down](https://discuss.elastic.co/t/shards-unassigned-after-some-nodes-went-down/246734)
**Author:** [@tmporary](https://discuss.elastic.co/u/tmporary)\ **Replies:** 7\ **Last updated:** [September 1, 2020, 9:51am UTC](https://discuss.elastic.co/t/shards-unassigned-after-some-nodes-went-down/246734 "2020-09-01T09:51:26Z")
Hi, We have a ES cluster consisted of 6 nodes, 3 in one data center 3 in another data center. Each of them is master eligible but 4 are data nodes. We have 3 indices, each has 5 primary shards with 1 replica. Now due to… --- ## [Deleting indexes with ILM Policy and Index Template](https://discuss.elastic.co/t/deleting-indexes-with-ilm-policy-and-index-template/246776)
**Author:** [@RahejaGaurav](https://discuss.elastic.co/u/RahejaGaurav)\ **Replies:** 4\ **Last updated:** [September 1, 2020, 9:44am UTC](https://discuss.elastic.co/t/deleting-indexes-with-ilm-policy-and-index-template/246776 "2020-09-01T09:44:58Z")
Elasticsearch: 7.6.2, Kibana: Kibana:7.6.2 As given in the Tutorial: Automate rollover with ILM. I tried to create an ILM Policy and a simple Index template with two index pattern as given below url: /\_ilm/policy/e… --- ## [Levenshtein distance of 2 handles same Token differently?](https://discuss.elastic.co/t/levenshtein-distance-of-2-handles-same-token-differently/247065)
**Author:** [@as\_ES](https://discuss.elastic.co/u/as_ES)\ **Replies:** 0\ **Last updated:** [September 1, 2020, 9:07am UTC](https://discuss.elastic.co/t/levenshtein-distance-of-2-handles-same-token-differently/247065 "2020-09-01T09:07:25Z")
Hi, I created two indices with the exact same mapping. The specific field has an EdgeNGram Tokenizer (Min:1 Max:50, keeping only Letters and Digits) and an analyzer with "lowercase", "asciifolding" and "synonym" filters… --- ## [Curator\_cli rollover not generating new index](https://discuss.elastic.co/t/curator-cli-rollover-not-generating-new-index/246941)
**Author:** [@sushant4tech](https://discuss.elastic.co/u/sushant4tech)\ **Replies:** 0\ **Last updated:** [August 31, 2020, 11:21am UTC](https://discuss.elastic.co/t/curator-cli-rollover-not-generating-new-index/246941 "2020-08-31T11:21:57Z")
I am using curator version 5.8.1. I plan to replace rundeck with curator at my end. I am using curator\_cli to operate. I have curator.yml that works for me. --- client: hosts: - https://###EDITED###.us-east-1.es.a… --- ## [Doc count with Path Hierarchy](https://discuss.elastic.co/t/doc-count-with-path-hierarchy/247062)
**Author:** [@Arun\_Kumar5](https://discuss.elastic.co/u/Arun_Kumar5)\ **Replies:** 0\ **Last updated:** [September 1, 2020, 8:34am UTC](https://discuss.elastic.co/t/doc-count-with-path-hierarchy/247062 "2020-09-01T08:34:11Z")
A index doc can belongs to multiple group (path) and i aggregated search result based on group like below: below doc have two path as you can see in nested structure: "NavigationCollection": \[ { "LangId": 1, "Path":… --- ## [Give wildcard read privileges to specific documents](https://discuss.elastic.co/t/give-wildcard-read-privileges-to-specific-documents/246959)
**Author:** [@Den1](https://discuss.elastic.co/u/Den1)\ **Replies:** 4\ **Last updated:** [September 1, 2020, 8:11am UTC](https://discuss.elastic.co/t/give-wildcard-read-privileges-to-specific-documents/246959 "2020-09-01T08:11:58Z")
Hello, I added custom permissions for new role like this: {"match": {"computerName.keyword" : "HOST-depName-ABC"}} in this case user will see documents only with "HOST-depName-ABC" computerName.keyword. I want to use… --- ## [Creating "prod" cluster with ingest nodes?](https://discuss.elastic.co/t/creating-prod-cluster-with-ingest-nodes/247007)
**Author:** [@Andreas\_Falk](https://discuss.elastic.co/u/Andreas_Falk)\ **Replies:** 6\ **Last updated:** [September 1, 2020, 7:25am UTC](https://discuss.elastic.co/t/creating-prod-cluster-with-ingest-nodes/247007 "2020-09-01T07:25:30Z")
Hi, We are going to expand our test cluster with 3 "everything" nodes to split up ingest/master and data roles. We are mostly a logcluster with winlogbeat and filebeats. Something like this (sketch from supper table) :… --- ## [StackOverFlow error in ES client](https://discuss.elastic.co/t/stackoverflow-error-in-es-client/247050)
**Author:** [@Ashwin\_Mathew](https://discuss.elastic.co/u/Ashwin_Mathew)\ **Replies:** 0\ **Last updated:** [September 1, 2020, 6:36am UTC](https://discuss.elastic.co/t/stackoverflow-error-in-es-client/247050 "2020-09-01T06:36:13Z")
Hello, I am getting the following errors at random times while indexing: https://pastebin.pl/view/a1039e86 After this happens, the ES rest client shuts down and I can't seem to process any message after that. Any hel… --- ## [Index alias with wildcard?](https://discuss.elastic.co/t/index-alias-with-wildcard/247026)
**Author:** [@AClerk](https://discuss.elastic.co/u/AClerk)\ **Replies:** 5\ **Last updated:** [September 1, 2020, 6:36am UTC](https://discuss.elastic.co/t/index-alias-with-wildcard/247026 "2020-09-01T06:36:05Z")
Hello, I am creating a daily index. Indices look like the following my-index-2020-08-31 my-index-2020-08-30 my-index-2020-08-29 my-index-yyyy-mm-dd Is t possible to add to the template an index alias with wildcard? … --- ## [How to index all fields using index action type in Watchers transform?](https://discuss.elastic.co/t/how-to-index-all-fields-using-index-action-type-in-watchers-transform/246840)
**Author:** [@kelk](https://discuss.elastic.co/u/kelk)\ **Replies:** 1\ **Last updated:** [September 1, 2020, 6:15am UTC](https://discuss.elastic.co/t/how-to-index-all-fields-using-index-action-type-in-watchers-transform/246840 "2020-09-01T06:15:01Z")
hi friends, Currently we were alerting via email as part of watcher which makes false positives to a greater degree. So I was thinking to index all the watcher outcomes into an index and control from there. I saw bit of… --- ## [Alternative for mapping type](https://discuss.elastic.co/t/alternative-for-mapping-type/246972)
**Author:** [@Nupur](https://discuss.elastic.co/u/Nupur)\ **Replies:** 5\ **Last updated:** [September 1, 2020, 5:53am UTC](https://discuss.elastic.co/t/alternative-for-mapping-type/246972 "2020-09-01T05:53:22Z")
what is the best way to index data when i have two types .. and only one field in data is different based on the type. I have 4-5 fields for a single doc. is it good to use single index or two indexes . each for a type … --- ## [Add custom log files to stdout](https://discuss.elastic.co/t/add-custom-log-files-to-stdout/246950)
**Author:** [@knagasri](https://discuss.elastic.co/u/knagasri)\ **Replies:** 12\ **Last updated:** [September 1, 2020, 5:52am UTC](https://discuss.elastic.co/t/add-custom-log-files-to-stdout/246950 "2020-09-01T05:52:37Z")
How can we add a custom log file to stdout. For example, can we add all the logs in /var/log folder . If possible, how can we achieve that? --- ## [Cluster is down on 2 nodes server high disk watermark](https://discuss.elastic.co/t/cluster-is-down-on-2-nodes-server-high-disk-watermark/246859)
**Author:** [@Dilip\_Kumar](https://discuss.elastic.co/u/Dilip_Kumar)\ **Replies:** 12\ **Last updated:** [September 1, 2020, 3:42am UTC](https://discuss.elastic.co/t/cluster-is-down-on-2-nodes-server-high-disk-watermark/246859 "2020-09-01T03:42:20Z")
Hi All, I have two node cluster suddenly cluster got down. es version 5.6 and ram size of each node is 16 GB and heap size is given 8GB. I am sharing my nod1 log , please help to find solution.. \[2020-08-30T00:30:09,91… --- ## [Offloading old data to cheaper storage](https://discuss.elastic.co/t/offloading-old-data-to-cheaper-storage/247004)
**Author:** [@andywt123](https://discuss.elastic.co/u/andywt123)\ **Replies:** 2\ **Last updated:** [September 1, 2020, 3:33am UTC](https://discuss.elastic.co/t/offloading-old-data-to-cheaper-storage/247004 "2020-09-01T03:33:55Z")
We are currently using elastic to aggregate logs with filebeats. We want to be able to offload data that is older then 60 days and then store in AWS s3. The data does not need to be searchable but we may need to retrieve… --- ## [Elasticsearch service failed to start on CentOS](https://discuss.elastic.co/t/elasticsearch-service-failed-to-start-on-centos/247034)
**Author:** [@munwarrior](https://discuss.elastic.co/u/munwarrior)\ **Replies:** 1\ **Last updated:** [September 1, 2020, 3:15am UTC](https://discuss.elastic.co/t/elasticsearch-service-failed-to-start-on-centos/247034 "2020-09-01T03:15:04Z")
Hi, I've follow the steps in https://casesup.com/category/knowledgebase/installation/how-to-install-elasticsearch-on-linux-server to install elasticsearch in Centos 8. but it stuck at step 3 when I tried to create serv… --- ## [Throttle the ES-Hadoop write speed](https://discuss.elastic.co/t/throttle-the-es-hadoop-write-speed/246702)
**Author:** [@chenchuangc](https://discuss.elastic.co/u/chenchuangc)\ **Replies:** 2\ **Last updated:** [September 1, 2020, 2:31am UTC](https://discuss.elastic.co/t/throttle-the-es-hadoop-write-speed/246702 "2020-09-01T02:31:04Z")
1. problem background I am using an elasticsearch cluster to save the result from spark2.3. Also this cluster offer an online query . My spark task is a daily work that will write 6 million records to ES cluster every … --- ## [Replacement for setTypes(list of types) in 7.8 version - can we pass multiple indices to SearchRequest](https://discuss.elastic.co/t/replacement-for-settypes-list-of-types-in-7-8-version-can-we-pass-multiple-indices-to-searchrequest/247022)
**Author:** [@elastic78](https://discuss.elastic.co/u/elastic78)\ **Replies:** 1\ **Last updated:** [August 31, 2020, 11:11pm UTC](https://discuss.elastic.co/t/replacement-for-settypes-list-of-types-in-7-8-version-can-we-pass-multiple-indices-to-searchrequest/247022 "2020-08-31T23:11:42Z")
In 5.5.2 version we had a search query as shown below which uses settypes array(basically list of types). SearchRequestBuilder searchBuilder = client.prepareSearch(index).setTypes((String) types.toArray(new String\[types… --- ## [Ilm-history-2-000001 UNASSIGNED, primary shard for this replica is not yet active](https://discuss.elastic.co/t/ilm-history-2-000001-unassigned-primary-shard-for-this-replica-is-not-yet-active/246978)
**Author:** [@Petr.Simik](https://discuss.elastic.co/u/Petr.Simik)\ **Replies:** 3\ **Last updated:** [August 31, 2020, 9:44pm UTC](https://discuss.elastic.co/t/ilm-history-2-000001-unassigned-primary-shard-for-this-replica-is-not-yet-active/246978 "2020-08-31T21:44:17Z")
Please I need critical help with cluster in state RED after upgrade 7.4.2-\>7.9 during upgrade of 5th node of 15 it did not recover it health to 100% but 99% all indices are green except 2 shards index … --- ## [Fail to send data to elastic unexpected EOF](https://discuss.elastic.co/t/fail-to-send-data-to-elastic-unexpected-eof/246732)
**Author:** [@greyhats13](https://discuss.elastic.co/u/greyhats13)\ **Replies:** 3\ **Last updated:** [August 31, 2020, 9:31pm UTC](https://discuss.elastic.co/t/fail-to-send-data-to-elastic-unexpected-eof/246732 "2020-08-31T21:31:13Z")
Hi guys, we are shipping the logs to elastic public endpoint (internet) from go microservices using this modulule elastic https://github.com/elastic/go-elasticsearch, but we encounter this error: 1. "could not get index… --- ## [Creating dynamic rollup indexes](https://discuss.elastic.co/t/creating-dynamic-rollup-indexes/246578)
**Author:** [@rohitarorait82](https://discuss.elastic.co/u/rohitarorait82)\ **Replies:** 3\ **Last updated:** [August 31, 2020, 9:26pm UTC](https://discuss.elastic.co/t/creating-dynamic-rollup-indexes/246578 "2020-08-31T21:26:49Z")
Hi Team, I am working on rollup indices for the first time and don't have much idea about its capabilities. I want to rollup my data every month and can have all the visualization/scripts/dashboards in the current indi… --- ## [Hitting 'too\_many\_clauses' exception when used in aggregation filter context](https://discuss.elastic.co/t/hitting-too-many-clauses-exception-when-used-in-aggregation-filter-context/247010)
**Author:** [@Karthik\_Arun](https://discuss.elastic.co/u/Karthik_Arun)\ **Replies:** 0\ **Last updated:** [August 31, 2020, 8:13pm UTC](https://discuss.elastic.co/t/hitting-too-many-clauses-exception-when-used-in-aggregation-filter-context/247010 "2020-08-31T20:13:44Z")
I have a terms query returning over 5k clauses and when this is used within the filter context of the query, I never hit this 'too\_many\_clauses exception - you have exceeded 1024 clauses'. However if I use this terms qu… [Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=819) [Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=821)