# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=442

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 443

---

## [ILM Error while deleting ES index](https://discuss.elastic.co/t/ilm-error-while-deleting-es-index/304320)

<div class="topic-metadata">

**Author:** [@Aman\_Gupta1](https://discuss.elastic.co/u/Aman_Gupta1)\
**Replies:** 1\
**Last updated:** [May 12, 2022, 3:53pm UTC](https://discuss.elastic.co/t/ilm-error-while-deleting-es-index/304320 "2022-05-12T15:53:20Z")

</div>

Hi Team, I'm facing issue while deleteing index via ILM. description: i have index with name $webservicelogs\* ( where $webservice is name of actual services and after rotation it becomes webservicelogs2022.05.10 simila…

---

## [Mappings types](https://discuss.elastic.co/t/mappings-types/304477)

<div class="topic-metadata">

**Author:** [@hebph001](https://discuss.elastic.co/u/hebph001)\
**Replies:** 10\
**Last updated:** [May 12, 2022, 3:30pm UTC](https://discuss.elastic.co/t/mappings-types/304477 "2022-05-12T15:30:56Z")

</div>

Hi Elastic community, I'm having a hard time figuring out what is wrong with my index template configuration, but Kibana shows me a message of "mapping types for this template uses types, which have been removed". I don…

---

## [Search template can not parser data in geoshape search](https://discuss.elastic.co/t/search-template-can-not-parser-data-in-geoshape-search/304446)

<div class="topic-metadata">

**Author:** [@yeziblo](https://discuss.elastic.co/u/yeziblo)\
**Replies:** 7\
**Last updated:** [May 12, 2022, 2:42pm UTC](https://discuss.elastic.co/t/search-template-can-not-parser-data-in-geoshape-search/304446 "2022-05-12T14:42:51Z")

</div>

Hi everyone. I just set a search template like: POST \_scripts/geoshape\_search { "script": { "lang": "mustache", "source": { "query": { "geo\_shape": { "geo\_json": { "shape": { "type": "point", "coordinates": …

---

## [Escaping commas in \_routing search impossible](https://discuss.elastic.co/t/escaping-commas-in-routing-search-impossible/304578)

<div class="topic-metadata">

**Author:** [@mhamb](https://discuss.elastic.co/u/mhamb)\
**Replies:** 0\
**Last updated:** [May 12, 2022, 1:15pm UTC](https://discuss.elastic.co/t/escaping-commas-in-routing-search-impossible/304578 "2022-05-12T13:15:21Z")

</div>

Hi! I'm running an Elasticsearch production environment with a custom routing field. This has helped search performance significantly, but we just noticed that some routing fields are unsearchable as they were indexed w…

---

## [Async system index through python AsyncElasticsearch prevented by default?](https://discuss.elastic.co/t/async-system-index-through-python-asyncelasticsearch-prevented-by-default/304542)

<div class="topic-metadata">

**Author:** [@martward](https://discuss.elastic.co/u/martward)\
**Replies:** 0\
**Last updated:** [May 12, 2022, 9:09am UTC](https://discuss.elastic.co/t/async-system-index-through-python-asyncelasticsearch-prevented-by-default/304542 "2022-05-12T09:09:19Z")

</div>

Hi all, I'm using the AsyncElasticsearch client in python, recently I started getting the warning that direct access to async-search will be prevented. Does this mean at some point it will no longer be possible to use t…

---

## [\_source 50% bigger after reindex](https://discuss.elastic.co/t/source-50-bigger-after-reindex/303805)

<div class="topic-metadata">

**Author:** [@nisow95612](https://discuss.elastic.co/u/nisow95612)\
**Replies:** 17\
**Last updated:** [May 12, 2022, 9:36am UTC](https://discuss.elastic.co/t/source-50-bigger-after-reindex/303805 "2022-05-12T09:36:30Z")

</div>

Hello. Context: I reindexed a 7.15 index into 7.16 one and suddenly it is taking about +50% space. By Analyze index disk usage API | Elasticsearch Guide \[7.16\] | Elastic I found that \_source field alone is now taking …

---

## [Event.original not searchable](https://discuss.elastic.co/t/event-original-not-searchable/304490)

<div class="topic-metadata">

**Author:** [@grover](https://discuss.elastic.co/u/grover)\
**Replies:** 2\
**Last updated:** [May 12, 2022, 8:40am UTC](https://discuss.elastic.co/t/event-original-not-searchable/304490 "2022-05-12T08:40:58Z")

</div>

Hi I'm new to Elasticsearch and I am trying to get information from a Juniper SRX firewall. The logs are being ingested but the information I would like to search is in event.original which is not indexed or searchable.…

---

## [Grok pattern for optional field in ingest pipeline](https://discuss.elastic.co/t/grok-pattern-for-optional-field-in-ingest-pipeline/304520)

<div class="topic-metadata">

**Author:** [@alfianaf](https://discuss.elastic.co/u/alfianaf)\
**Replies:** 3\
**Last updated:** [May 12, 2022, 8:00am UTC](https://discuss.elastic.co/t/grok-pattern-for-optional-field-in-ingest-pipeline/304520 "2022-05-12T08:00:19Z")

</div>

Hello, I'm working with ingest pipeline and grok processor right now. I need to filter log message with grok processor but there's optional fields, here's the log example \[Nest\] 6448 - 04/26/2022, 3:30:03 PM \[activity…

---

## [Restore historical into data stream](https://discuss.elastic.co/t/restore-historical-into-data-stream/304523)

<div class="topic-metadata">

**Author:** [@Jasper\_Nygaard](https://discuss.elastic.co/u/Jasper_Nygaard)\
**Replies:** 2\
**Last updated:** [May 12, 2022, 7:29am UTC](https://discuss.elastic.co/t/restore-historical-into-data-stream/304523 "2022-05-12T07:29:01Z")

</div>

Just moved to Elastic Cloud from on-onprem for our logging, setting up data streams instead of using date based indices. I now need to restore our historical data from snapshots - anyway to restore these into the data st…

---

## [Accessing nested fields in a script (null\_pointer\_exception)](https://discuss.elastic.co/t/accessing-nested-fields-in-a-script-null-pointer-exception/304521)

<div class="topic-metadata">

**Author:** [@heikis](https://discuss.elastic.co/u/heikis)\
**Replies:** 2\
**Last updated:** [May 12, 2022, 6:41am UTC](https://discuss.elastic.co/t/accessing-nested-fields-in-a-script-null-pointer-exception/304521 "2022-05-12T06:41:00Z")

</div>

Hello. I have a nested document and I would like to do some processing on it before indexing it. The parent document has a "reference\_ts" containing a timestamp. Then come the nested fields that each have their own tim…

---

## [Enrollment agent](https://discuss.elastic.co/t/enrollment-agent/304528)

<div class="topic-metadata">

**Author:** [@alipujaistopo](https://discuss.elastic.co/u/alipujaistopo)\
**Replies:** 0\
**Last updated:** [May 12, 2022, 6:30am UTC](https://discuss.elastic.co/t/enrollment-agent/304528 "2022-05-12T06:30:44Z")

</div>

how to enrollment agent. i follow in Install Fleet-managed Elastic Agents | Fleet and Elastic Agent Guide \[7.17\] | Elastic i got error Error: fail to enroll: fail to execute request to fleet-server: fail to read origina…

---

## [Elasticsearch Watcher error while trying to send email attachment, dashboard.pdf](https://discuss.elastic.co/t/elasticsearch-watcher-error-while-trying-to-send-email-attachment-dashboard-pdf/301048)

<div class="topic-metadata">

**Author:** [@Souvik\_Das](https://discuss.elastic.co/u/Souvik_Das)\
**Replies:** 13\
**Last updated:** [May 12, 2022, 5:53am UTC](https://discuss.elastic.co/t/elasticsearch-watcher-error-while-trying-to-send-email-attachment-dashboard-pdf/301048 "2022-05-12T05:53:09Z")

</div>

Hi, I have created a watcher alert from the advanced option which sends dashboard.pdf as an email attachment when the triggering condition is met. Now when the criteria is matching (threshold is exceeded) then it is thr…

---

## [Date processor ingest pipeline failed to parse](https://discuss.elastic.co/t/date-processor-ingest-pipeline-failed-to-parse/304515)

<div class="topic-metadata">

**Author:** [@alfianaf](https://discuss.elastic.co/u/alfianaf)\
**Replies:** 4\
**Last updated:** [May 12, 2022, 3:45am UTC](https://discuss.elastic.co/t/date-processor-ingest-pipeline-failed-to-parse/304515 "2022-05-12T03:45:41Z")

</div>

Hello, I'm using date processor on ingest pipeline, I've seen the documentation about the date processor, the syntax I wrote seems right, but the result is not. here's my date example 05/11/2022, 7:03:52 AM and here'…

---

## [Is elasticsearch, logstash impacted by opendJDK Vulnerability](https://discuss.elastic.co/t/is-elasticsearch-logstash-impacted-by-opendjdk-vulnerability/304423)

<div class="topic-metadata">

**Author:** [@kannan\_raj](https://discuss.elastic.co/u/kannan_raj)\
**Replies:** 1\
**Last updated:** [May 11, 2022, 11:30pm UTC](https://discuss.elastic.co/t/is-elasticsearch-logstash-impacted-by-opendjdk-vulnerability/304423 "2022-05-11T23:30:06Z")

</div>

is Elasticsearch and logstash got impacted by opendJDK vulnerability? CVE's The versions impacted are: OpenJDK 7 \<= 7u331 OpenJDK 8 \<= 8u322 OpenJDK 11.0.0 \<= 11.0.14 OpenJDK 13.0.0 \<= 13.0.10 OpenJDK 15.0.0 \<= …

---

## [Data stream, ILM and refresh\_interval](https://discuss.elastic.co/t/data-stream-ilm-and-refresh-interval/304456)

<div class="topic-metadata">

**Author:** [@Valentin\_Pletzer](https://discuss.elastic.co/u/Valentin_Pletzer)\
**Replies:** 1\
**Last updated:** [May 11, 2022, 11:22pm UTC](https://discuss.elastic.co/t/data-stream-ilm-and-refresh-interval/304456 "2022-05-11T23:22:08Z")

</div>

Hi, I am using Elasticsearch for a really long time now, mostly for logging data and aggregating. One pattern I am using successfully is the rolling daily indices. Write to the current one and set the older ones to "ref…

---

## [Data Archival in Elastic Search](https://discuss.elastic.co/t/data-archival-in-elastic-search/304442)

<div class="topic-metadata">

**Author:** [@Nikhil\_Ray5](https://discuss.elastic.co/u/Nikhil_Ray5)\
**Replies:** 2\
**Last updated:** [May 11, 2022, 11:18pm UTC](https://discuss.elastic.co/t/data-archival-in-elastic-search/304442 "2022-05-11T23:18:28Z")

</div>

Can you help me with how to archive data in Elasticsearch. that I don't know what is curator and data shrink. I am fresher to Elasticsearch. from where I have to start studying and what all things I have to do?

---

## [Purging the index using curator script](https://discuss.elastic.co/t/purging-the-index-using-curator-script/304478)

<div class="topic-metadata">

**Author:** [@Ganesh2303](https://discuss.elastic.co/u/Ganesh2303)\
**Replies:** 0\
**Last updated:** [May 11, 2022, 2:58pm UTC](https://discuss.elastic.co/t/purging-the-index-using-curator-script/304478 "2022-05-11T14:58:21Z")

</div>

HI, I'm using curator script to purge our data in production. Currently we are having 2 type of format in ES once is for Production index and another one is pre-prod index. Basically we keep last 5 week records of pro…

---

## [SearchRequest source timeout not working for Java HighLevelRESTClient](https://discuss.elastic.co/t/searchrequest-source-timeout-not-working-for-java-highlevelrestclient/304507)

<div class="topic-metadata">

**Author:** [@Constantine\_Cheng](https://discuss.elastic.co/u/Constantine_Cheng)\
**Replies:** 0\
**Last updated:** [May 11, 2022, 9:39pm UTC](https://discuss.elastic.co/t/searchrequest-source-timeout-not-working-for-java-highlevelrestclient/304507 "2022-05-11T21:39:01Z")

</div>

Hello, I am trying to parse a timeout parameter to searchRequest.source().timeout() in Kotlin and run HighLevelRestClient.search(searchRequest). The timeout interval in my case is set to be 1 ms for testing if the timeo…

---

## [Delete\_by\_query not deleting the indices](https://discuss.elastic.co/t/delete-by-query-not-deleting-the-indices/304500)

<div class="topic-metadata">

**Author:** [@Sam1231](https://discuss.elastic.co/u/Sam1231)\
**Replies:** 5\
**Last updated:** [May 11, 2022, 11:07pm UTC](https://discuss.elastic.co/t/delete-by-query-not-deleting-the-indices/304500 "2022-05-11T23:07:58Z")

</div>

hi, i have a python program which needs to delete the indices after 20 days of creation. i have used delete\_by\_query but when i run the program, there is no error but also the indices are not getting deleted. can some…

---

## [Ambiguous documentation for audit logs](https://discuss.elastic.co/t/ambiguous-documentation-for-audit-logs/304505)

<div class="topic-metadata">

**Author:** [@cmendez92](https://discuss.elastic.co/u/cmendez92)\
**Replies:** 0\
**Last updated:** [May 11, 2022, 9:14pm UTC](https://discuss.elastic.co/t/ambiguous-documentation-for-audit-logs/304505 "2022-05-11T21:14:20Z")

</div>

Elasticsearch documentation is ambiguous in audit logs section. Literally says: If configured, auditing settings must be set on every node in the cluster. Is that correct? I think with only 1 node we can get all audi…

---

## [Queue Size and Threadpools](https://discuss.elastic.co/t/queue-size-and-threadpools/304414)

<div class="topic-metadata">

**Author:** [@nyquillus](https://discuss.elastic.co/u/nyquillus)\
**Replies:** 3\
**Last updated:** [May 11, 2022, 10:21pm UTC](https://discuss.elastic.co/t/queue-size-and-threadpools/304414 "2022-05-11T22:21:51Z")

</div>

Hello, I was wondering something about the relation between queue sizes and threadpool sizes. For example, as of the most recent version I think write thread pool has 10000 default queue. Is this queue size for each al…

---

## [Anyone out there keeping a fork of ansible-elasticsearch alive?](https://discuss.elastic.co/t/anyone-out-there-keeping-a-fork-of-ansible-elasticsearch-alive/304498)

<div class="topic-metadata">

**Author:** [@jerrac](https://discuss.elastic.co/u/jerrac)\
**Replies:** 0\
**Last updated:** [May 11, 2022, 6:54pm UTC](https://discuss.elastic.co/t/anyone-out-there-keeping-a-fork-of-ansible-elasticsearch-alive/304498 "2022-05-11T18:54:56Z")

</div>

I just got back from a leave of absence and found that Elastic is no longer supporting GitHub - elastic/ansible-elasticsearch: Ansible playbook for Elasticsearch. Since I rely on that role for upgrades I thought I'd ask …

---

## [Query cache vs search rate](https://discuss.elastic.co/t/query-cache-vs-search-rate/304468)

<div class="topic-metadata">

**Author:** [@hunsw](https://discuss.elastic.co/u/hunsw)\
**Replies:** 1\
**Last updated:** [May 11, 2022, 2:25pm UTC](https://discuss.elastic.co/t/query-cache-vs-search-rate/304468 "2022-05-11T14:25:32Z")

</div>

We had a search spike in our cluster, the search rate almost tripled. But when checking the metrics it shows that query cache increased almost tenfold. What's the explanation for this?

---

## [Fleet server install failed on fresh ELK stack 8.2.0](https://discuss.elastic.co/t/fleet-server-install-failed-on-fresh-elk-stack-8-2-0/304465)

<div class="topic-metadata">

**Author:** [@Peter\_Bodnar](https://discuss.elastic.co/u/Peter_Bodnar)\
**Replies:** 4\
**Last updated:** [May 11, 2022, 1:32pm UTC](https://discuss.elastic.co/t/fleet-server-install-failed-on-fresh-elk-stack-8-2-0/304465 "2022-05-11T13:32:43Z")

</div>

Hello, i have problem to install Fleet server on fresh ELK stack 8.2.0 (RHEL 8) Elasticsearch and kibana working fine, but when tried to install fleet server (enroll agent as fleet server, based on provided instructions…

---

## [Search cretiria with TermSet](https://discuss.elastic.co/t/search-cretiria-with-termset/304459)

<div class="topic-metadata">

**Author:** [@srikanthkadem](https://discuss.elastic.co/u/srikanthkadem)\
**Replies:** 2\
**Last updated:** [May 11, 2022, 12:38pm UTC](https://discuss.elastic.co/t/search-cretiria-with-termset/304459 "2022-05-11T12:38:28Z")

</div>

Hi All, I have requirement to search Elastic with following details . This is part of security implementation you can assume for my website. I have different Grouptypes with each group type having set of Groups . these…

---

## [Pipeline simulation](https://discuss.elastic.co/t/pipeline-simulation/304391)

<div class="topic-metadata">

**Author:** [@hebph001](https://discuss.elastic.co/u/hebph001)\
**Replies:** 5\
**Last updated:** [May 11, 2022, 12:33pm UTC](https://discuss.elastic.co/t/pipeline-simulation/304391 "2022-05-11T12:33:15Z")

</div>

Hi Elastic community, I'm having a hard time figuring out what is wrong with my pipeline simulation. I'm trying to simulate this way GET /\_ingest/pipeline/test-pipeline/\_simulate { "docs": \[ { "\_source": { …

---

## [Convert two repeated values in array into a string](https://discuss.elastic.co/t/convert-two-repeated-values-in-array-into-a-string/304429)

<div class="topic-metadata">

**Author:** [@adrianfusco](https://discuss.elastic.co/u/adrianfusco)\
**Replies:** 1\
**Last updated:** [May 11, 2022, 12:21pm UTC](https://discuss.elastic.co/t/convert-two-repeated-values-in-array-into-a-string/304429 "2022-05-11T12:21:49Z")

</div>

Hello, I have some old documents where a field has an array of two vales repeated, something like this: "task" : \[ "first\_task", "first\_task" \], I'm trying to convert this a…

---

## [Can not extract the "value" from the Aggregation](https://discuss.elastic.co/t/can-not-extract-the-value-from-the-aggregation/304281)

<div class="topic-metadata">

**Author:** [@cugo](https://discuss.elastic.co/u/cugo)\
**Replies:** 3\
**Last updated:** [May 11, 2022, 11:51am UTC](https://discuss.elastic.co/t/can-not-extract-the-value-from-the-aggregation/304281 "2022-05-11T11:51:22Z")

</div>

I have a list of Buckets (parentSalaries) that has a list of Aggregations of size 2. One of the Aggregations (average\_salary) has the following fields; value, name, valueAsString and metadata. I am trying to extract the …

---

## [Elasticsearch Term suggester is not returning correct suggestions when one character is missing (instead of misspelling)](https://discuss.elastic.co/t/elasticsearch-term-suggester-is-not-returning-correct-suggestions-when-one-character-is-missing-instead-of-misspelling/304369)

<div class="topic-metadata">

**Author:** [@hesamrasouli](https://discuss.elastic.co/u/hesamrasouli)\
**Replies:** 4\
**Last updated:** [May 11, 2022, 11:24am UTC](https://discuss.elastic.co/t/elasticsearch-term-suggester-is-not-returning-correct-suggestions-when-one-character-is-missing-instead-of-misspelling/304369 "2022-05-11T11:24:19Z")

</div>

I'm using Elasticsearch term suggester for spell correction. my index contains huge list of ads. Each ad has subject and body fields. I've found a problematic example for which the suggester is not suggesting correct sug…

---

## [Explain diff\_from\_typical meaning in custom rules](https://discuss.elastic.co/t/explain-diff-from-typical-meaning-in-custom-rules/304419)

<div class="topic-metadata">

**Author:** [@ixperdomo](https://discuss.elastic.co/u/ixperdomo)\
**Replies:** 1\
**Last updated:** [May 11, 2022, 11:19am UTC](https://discuss.elastic.co/t/explain-diff-from-typical-meaning-in-custom-rules/304419 "2022-05-11T11:19:40Z")

</div>

Hi, When configuring Machine Learning jobs in ES, you can customise your detectors by using custom\_rules. I'm wondering about the actual meaning of the applies\_to value diff\_from\_typical. My main question is if diff\_fr…

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=441)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=443)
