# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=875

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 876

---

## [CPAN ES7.8](https://discuss.elastic.co/t/cpan-es7-8/239328)

<div class="topic-metadata">

**Author:** [@R7H9H1A8K7P2R2O7](https://discuss.elastic.co/u/R7H9H1A8K7P2R2O7)\
**Replies:** 2\
**Last updated:** [July 1, 2020, 6:32am UTC](https://discuss.elastic.co/t/cpan-es7-8/239328 "2020-07-01T06:32:29Z")

</div>

Hi out there Do you know about any problems between Perl CPAN Lib for ES (https://metacpan.org/release/Search-Elasticsearch) and the new ES7.8? Last: Changes for version 6.80\_1 - 2020-03-11 Updated API and XPack endp…

---

## [How can I add the request IP address to every document?](https://discuss.elastic.co/t/how-can-i-add-the-request-ip-address-to-every-document/239112)

<div class="topic-metadata">

**Author:** [@alphalol](https://discuss.elastic.co/u/alphalol)\
**Replies:** 6\
**Last updated:** [July 1, 2020, 5:24am UTC](https://discuss.elastic.co/t/how-can-i-add-the-request-ip-address-to-every-document/239112 "2020-07-01T05:24:17Z")

</div>

Is it possible to add the IP addressed used (in the HTTP request) to the document? I want to do this to then use the geoip processor in a pipeline to add location information?

---

## [\[illegal\_argument\_exception\] Fielddata is disabled on text fields by default](https://discuss.elastic.co/t/illegal-argument-exception-fielddata-is-disabled-on-text-fields-by-default/237891)

<div class="topic-metadata">

**Author:** [@wajika](https://discuss.elastic.co/u/wajika)\
**Replies:** 1\
**Last updated:** [July 1, 2020, 3:21am UTC](https://discuss.elastic.co/t/illegal-argument-exception-fielddata-is-disabled-on-text-fields-by-default/237891 "2020-07-01T03:21:23Z")

</div>

I click on kibana apm ui and some errors will appear. I checked the log of kibana and found the following \> "message":"\[illegal\_argument\_exception\] Fielddata is disabled on text fields by default. Set fielddata=true on …

---

## [I am having difficulty trying to use ELK-stack with suricata](https://discuss.elastic.co/t/i-am-having-difficulty-trying-to-use-elk-stack-with-suricata/239385)

<div class="topic-metadata">

**Author:** [@noobnoob](https://discuss.elastic.co/u/noobnoob)\
**Replies:** 0\
**Last updated:** [July 1, 2020, 1:18am UTC](https://discuss.elastic.co/t/i-am-having-difficulty-trying-to-use-elk-stack-with-suricata/239385 "2020-07-01T01:18:11Z")

</div>

First, I am not good at English, so I am writing a question with the help of Google Translator. Please understand if the grammar is wrong or strange. I'm trying to visualize IDS detections by linking ELK and suricata as…

---

## [Benchmarking search performance with randomised queries](https://discuss.elastic.co/t/benchmarking-search-performance-with-randomised-queries/239388)

<div class="topic-metadata">

**Author:** [@manud](https://discuss.elastic.co/u/manud)\
**Replies:** 1\
**Last updated:** [July 1, 2020, 2:18am UTC](https://discuss.elastic.co/t/benchmarking-search-performance-with-randomised-queries/239388 "2020-07-01T02:18:12Z")

</div>

I want to use Rally purely to benchmark search performance as is described here. In order to simulate realistic search conditions I'd like to vary my query during the search operation, for example if my operation looked…

---

## [Hyphenation Patterns XML file in Cloud?](https://discuss.elastic.co/t/hyphenation-patterns-xml-file-in-cloud/149687)

<div class="topic-metadata">

**Author:** [@Kim\_Rauff\_Schurmann](https://discuss.elastic.co/u/Kim_Rauff_Schurmann)\
**Replies:** 1\
**Last updated:** [June 30, 2020, 11:06pm UTC](https://discuss.elastic.co/t/hyphenation-patterns-xml-file-in-cloud/149687 "2020-06-30T23:06:50Z")

</div>

Hi guys How do I add a Hyphenation Patterns XML file when working in elastic cloud? The API only have the option for a Path (HyphenationPatternsPath). I should be able to upload and use a bundle with the file - but the…

---

## [Elastic search 7.8.0 and multiple geoshapes](https://discuss.elastic.co/t/elastic-search-7-8-0-and-multiple-geoshapes/239350)

<div class="topic-metadata">

**Author:** [@pandzel](https://discuss.elastic.co/u/pandzel)\
**Replies:** 1\
**Last updated:** [June 30, 2020, 9:22pm UTC](https://discuss.elastic.co/t/elastic-search-7-8-0-and-multiple-geoshapes/239350 "2020-06-30T21:22:08Z")

</div>

Hi, I have created an index and I put the following mapping: { "dynamic\_templates": \[ { "\_geo": { "match": "\*\_geo", "mapping": { "type": "geo…

---

## [Java API - trying to fetch data from Index](https://discuss.elastic.co/t/java-api-trying-to-fetch-data-from-index/238971)

<div class="topic-metadata">

**Author:** [@Venkat\_Raj](https://discuss.elastic.co/u/Venkat_Raj)\
**Replies:** 3\
**Last updated:** [June 30, 2020, 8:34pm UTC](https://discuss.elastic.co/t/java-api-trying-to-fetch-data-from-index/238971 "2020-06-30T20:34:25Z")

</div>

I am trying to fetch data from index using java API to generate a report using jasper reports. I have added the maven dependency and able to make connection to ES. While trying to fetch the data corresponding to the pa…

---

## [Elasticsearch 7.x data allocation?](https://discuss.elastic.co/t/elasticsearch-7-x-data-allocation/239196)

<div class="topic-metadata">

**Author:** [@ryebread157](https://discuss.elastic.co/u/ryebread157)\
**Replies:** 2\
**Last updated:** [June 30, 2020, 2:43pm UTC](https://discuss.elastic.co/t/elasticsearch-7-x-data-allocation/239196 "2020-06-30T14:43:20Z")

</div>

I have been using the ELK stack for years, and upgraded to ELK 7 last month and updated to 7.8 last week. Previous to 7.x data allocation to my Elastic data nodes was automatically distributed among nodes to be similar. …

---

## [Understanding skipped documents in Data Frame Analytics](https://discuss.elastic.co/t/understanding-skipped-documents-in-data-frame-analytics/238760)

<div class="topic-metadata">

**Author:** [@davemoore](https://discuss.elastic.co/u/davemoore)\
**Replies:** 2\
**Last updated:** [June 30, 2020, 4:28pm UTC](https://discuss.elastic.co/t/understanding-skipped-documents-in-data-frame-analytics/238760 "2020-06-30T16:28:41Z")

</div>

When running a Data Frame Analytics job in 7.8.0, documents with unsupported values are skipped (source). Suppose I run a job that fails after the loading\_data phase because every document was skipped, and the data\_coun…

---

## [Upgraded to Elasticsearch 7.8.0 and now date fields are in fields key instead of \_source](https://discuss.elastic.co/t/upgraded-to-elasticsearch-7-8-0-and-now-date-fields-are-in-fields-key-instead-of-source/239137)

<div class="topic-metadata">

**Author:** [@Federico\_Foschini](https://discuss.elastic.co/u/Federico_Foschini)\
**Replies:** 1\
**Last updated:** [June 30, 2020, 4:15pm UTC](https://discuss.elastic.co/t/upgraded-to-elasticsearch-7-8-0-and-now-date-fields-are-in-fields-key-instead-of-source/239137 "2020-06-30T16:15:30Z")

</div>

Hello, I've upgraded my cluster from 6.8.0 to 7.8.0. This is my template: { "index\_patterns": \[ "example-\*" \], "settings": { "number\_of\_shards": 1, "number\_of\_replicas": 0, "…

---

## [Regex in Painless script](https://discuss.elastic.co/t/regex-in-painless-script/239344)

<div class="topic-metadata">

**Author:** [@Jalpesh1](https://discuss.elastic.co/u/Jalpesh1)\
**Replies:** 0\
**Last updated:** [June 30, 2020, 4:11pm UTC](https://discuss.elastic.co/t/regex-in-painless-script/239344 "2020-06-30T16:11:27Z")

</div>

Hi Team, Need help to regex below doc to find "ERR\_ADM\_MAKER\_NOT\_FOUND " "value": "{\\"errorCode\\":\\"ERR\_ADM\_MAKER\_NOT\_FOUND\\",\\"errorMessage\\":\\"Maker not found\\"}", Regards, Jalpesh

---

## [Unable to use painless script in group\_by term in transform](https://discuss.elastic.co/t/unable-to-use-painless-script-in-group-by-term-in-transform/239294)

<div class="topic-metadata">

**Author:** [@ayazahmed](https://discuss.elastic.co/u/ayazahmed)\
**Replies:** 3\
**Last updated:** [June 30, 2020, 2:38pm UTC](https://discuss.elastic.co/t/unable-to-use-painless-script-in-group-by-term-in-transform/239294 "2020-06-30T14:38:07Z")

</div>

following the tutorial from https://www.elastic.co/guide/en/elasticsearch/reference/current/transform-painless-examples.html#painless-group-by POST \_transform/\_preview { "source": { "index": \[ "kibana\_sampl…

---

## [Remove old index automatically](https://discuss.elastic.co/t/remove-old-index-automatically/239321)

<div class="topic-metadata">

**Author:** [@jgonzalez](https://discuss.elastic.co/u/jgonzalez)\
**Replies:** 2\
**Last updated:** [June 30, 2020, 2:23pm UTC](https://discuss.elastic.co/t/remove-old-index-automatically/239321 "2020-06-30T14:23:49Z")

</div>

Hello All, I need to remove all the indexes older than 6 days automatically, I tried to create a lifecycle in Kibana but it didn't work fine, so i saw an option called Curator but for some reason, the curator can't fin…

---

## [ML job update](https://discuss.elastic.co/t/ml-job-update/239220)

<div class="topic-metadata">

**Author:** [@saraKM](https://discuss.elastic.co/u/saraKM)\
**Replies:** 1\
**Last updated:** [June 30, 2020, 2:19pm UTC](https://discuss.elastic.co/t/ml-job-update/239220 "2020-06-30T14:19:25Z")

</div>

Hi Is there a way to update job id (or some other attribute which is not supported in \_update API) while keeping previous results/models for a long-running job? or a way to clone a job, but also including model/results? …

---

## [Query for a new entry on a field](https://discuss.elastic.co/t/query-for-a-new-entry-on-a-field/239296)

<div class="topic-metadata">

**Author:** [@ginu](https://discuss.elastic.co/u/ginu)\
**Replies:** 2\
**Last updated:** [June 30, 2020, 2:10pm UTC](https://discuss.elastic.co/t/query-for-a-new-entry-on-a-field/239296 "2020-06-30T14:10:28Z")

</div>

Hi I have an index which contains a field network\_device\_ID I want to alert whenever there a new entry coming into the Index. what is the best way to achieve this? Cheers, Ginu

---

## [ECK YAML examples for production-grade deployment](https://discuss.elastic.co/t/eck-yaml-examples-for-production-grade-deployment/238603)

<div class="topic-metadata">

**Author:** [@Nikhil\_Utane](https://discuss.elastic.co/u/Nikhil_Utane)\
**Replies:** 1\
**Last updated:** [June 30, 2020, 12:12pm UTC](https://discuss.elastic.co/t/eck-yaml-examples-for-production-grade-deployment/238603 "2020-06-30T12:12:52Z")

</div>

Hello, I have an on-prem setup that I want to move to the cloud. I want to run it on Kubernetes for portability. I have selected AWS EKS (since I have credits). I am able to follow the ECK document and get basic nodes up…

---

## [Reindex not copying every document that exists on the source index](https://discuss.elastic.co/t/reindex-not-copying-every-document-that-exists-on-the-source-index/239313)

<div class="topic-metadata">

**Author:** [@egibrajshori](https://discuss.elastic.co/u/egibrajshori)\
**Replies:** 0\
**Last updated:** [June 30, 2020, 1:27pm UTC](https://discuss.elastic.co/t/reindex-not-copying-every-document-that-exists-on-the-source-index/239313 "2020-06-30T13:27:32Z")

</div>

I have around 20 indexes to reindex after some mapping changes but on any index that has a high number of documents e.g 500.000 the reindexing process stops abruptly and only a random number of document is reindexed. Le…

---

## [Is ILM ia available in basic subscription of elasticsearch 7.8?](https://discuss.elastic.co/t/is-ilm-ia-available-in-basic-subscription-of-elasticsearch-7-8/239304)

<div class="topic-metadata">

**Author:** [@gokulnath112](https://discuss.elastic.co/u/gokulnath112)\
**Replies:** 1\
**Last updated:** [June 30, 2020, 1:26pm UTC](https://discuss.elastic.co/t/is-ilm-ia-available-in-basic-subscription-of-elasticsearch-7-8/239304 "2020-06-30T13:26:26Z")

</div>

Hi Friends...! Hope everyone doing good. Please let me know ILM is available for free in elasticsearch 7.8. Currently I'm using the elastic version of 7.2.1. I want to create index for every 3 months. But the thing is…

---

## [Enabling Pagination using spring-data-elasticsearch](https://discuss.elastic.co/t/enabling-pagination-using-spring-data-elasticsearch/239267)

<div class="topic-metadata">

**Author:** [@Punj\_Shah](https://discuss.elastic.co/u/Punj_Shah)\
**Replies:** 3\
**Last updated:** [June 30, 2020, 12:57pm UTC](https://discuss.elastic.co/t/enabling-pagination-using-spring-data-elasticsearch/239267 "2020-06-30T12:57:49Z")

</div>

Hello! I've integrated Spring-elastic-data into Spring Boot Project to achieve the Pagination functionality in ES. Previously I was using query and response into List as below, SearchResponse searchResponse = client.s…

---

## [Obtaining a list of filtered document properties](https://discuss.elastic.co/t/obtaining-a-list-of-filtered-document-properties/238829)

<div class="topic-metadata">

**Author:** [@alcalin](https://discuss.elastic.co/u/alcalin)\
**Replies:** 5\
**Last updated:** [June 30, 2020, 9:02am UTC](https://discuss.elastic.co/t/obtaining-a-list-of-filtered-document-properties/238829 "2020-06-30T09:02:12Z")

</div>

Hello, I have the following index mappings: { "mappings": { "properties": { "library": { "type": "keyword" }, "books": { "properties": { …

---

## [Internal Server Error at Fetch.\_callee3$](https://discuss.elastic.co/t/internal-server-error-at-fetch-callee3/239298)

<div class="topic-metadata">

**Author:** [@Alvaro\_Sanz](https://discuss.elastic.co/u/Alvaro_Sanz)\
**Replies:** 0\
**Last updated:** [June 30, 2020, 12:37pm UTC](https://discuss.elastic.co/t/internal-server-error-at-fetch-callee3/239298 "2020-06-30T12:37:06Z")

</div>

Hello, The following error keeps appearing and I dont know why it is happening. I am not cabable to find anything online that can help me with this issue: Error: Internal Server Error at Fetch.\_callee3$ (https://ki…

---

## [Remove 'field.keyword' from index](https://discuss.elastic.co/t/remove-field-keyword-from-index/239271)

<div class="topic-metadata">

**Author:** [@ajayraghuraj](https://discuss.elastic.co/u/ajayraghuraj)\
**Replies:** 1\
**Last updated:** [June 30, 2020, 12:30pm UTC](https://discuss.elastic.co/t/remove-field-keyword-from-index/239271 "2020-06-30T12:30:26Z")

</div>

How do I remove 'field.keyword' from my index ? I should be able to see 'field' only here is my GET \_mapping output { "collectd-2020.06.29" : { "mappings" : { "doc" : { "properties" : { …

---

## [Calculate increase in queue size](https://discuss.elastic.co/t/calculate-increase-in-queue-size/239291)

<div class="topic-metadata">

**Author:** [@spike83](https://discuss.elastic.co/u/spike83)\
**Replies:** 0\
**Last updated:** [June 30, 2020, 12:08pm UTC](https://discuss.elastic.co/t/calculate-increase-in-queue-size/239291 "2020-06-30T12:08:33Z")

</div>

Hi, Im monitoring activemq queue data, I would like to have a graph to show may many messages were enqueued since the last check. I can capture the enqueued number which will always be increasing , but is it possible t…

---

## [Flag a result based on a ES "sub" query](https://discuss.elastic.co/t/flag-a-result-based-on-a-es-sub-query/239269)

<div class="topic-metadata">

**Author:** [@PeteAllison](https://discuss.elastic.co/u/PeteAllison)\
**Replies:** 0\
**Last updated:** [June 30, 2020, 10:06am UTC](https://discuss.elastic.co/t/flag-a-result-based-on-a-es-sub-query/239269 "2020-06-30T10:06:54Z")

</div>

Hi all! Hopefully somebody is able to assist or point me in the right direction with this. I look after an online store and we use Elasticsearch (v 5.5) for all of our product lookups. We want to implement functionali…

---

## [Querying syslog data to fetch unique error messages](https://discuss.elastic.co/t/querying-syslog-data-to-fetch-unique-error-messages/239259)

<div class="topic-metadata">

**Author:** [@N220](https://discuss.elastic.co/u/N220)\
**Replies:** 0\
**Last updated:** [June 30, 2020, 9:07am UTC](https://discuss.elastic.co/t/querying-syslog-data-to-fetch-unique-error-messages/239259 "2020-06-30T09:07:35Z")

</div>

Here is the query I have tried.... Although I have kept filter\_duplicate\_text as true still I get messages of the form {"............June 3 time stamp ...log message.............."} I want to filter out all these duplica…

---

## [Elastsicsearch: Odd Behaviour on Index Deletion](https://discuss.elastic.co/t/elastsicsearch-odd-behaviour-on-index-deletion/237747)

<div class="topic-metadata">

**Author:** [@dawiro](https://discuss.elastic.co/u/dawiro)\
**Replies:** 7\
**Last updated:** [June 30, 2020, 9:04am UTC](https://discuss.elastic.co/t/elastsicsearch-odd-behaviour-on-index-deletion/237747 "2020-06-30T09:04:50Z")

</div>

Hi, I'm running elasticsearch 6.8.6 and am seeing this odd behaviour on deleting an old filebeat index. Here is the log from the master node which shows what's happening: \[2020-06-19T07:06:30,899\]\[INFO \]\[o.e.c.m.MetaDa…

---

## [Highlights not returned for multiple queries on the same JSON object field](https://discuss.elastic.co/t/highlights-not-returned-for-multiple-queries-on-the-same-json-object-field/239140)

<div class="topic-metadata">

**Author:** [@CPot](https://discuss.elastic.co/u/CPot)\
**Replies:** 2\
**Last updated:** [June 30, 2020, 9:00am UTC](https://discuss.elastic.co/t/highlights-not-returned-for-multiple-queries-on-the-same-json-object-field/239140 "2020-06-30T09:00:09Z")

</div>

Hi all, I have the following query: With ES 7.5 "query": { "bool": { "must": \[ { "term": { "siren": "493754261" } } \], "should": \[ { …

---

## [Iterate watcher hits and perform action on each hit](https://discuss.elastic.co/t/iterate-watcher-hits-and-perform-action-on-each-hit/236702)

<div class="topic-metadata">

**Author:** [@Jeroen2](https://discuss.elastic.co/u/Jeroen2)\
**Replies:** 1\
**Last updated:** [June 30, 2020, 8:13am UTC](https://discuss.elastic.co/t/iterate-watcher-hits-and-perform-action-on-each-hit/236702 "2020-06-30T08:13:35Z")

</div>

Hi, in the example below I have a condition where I send an alert if the first hit contains the query 'some\_query'. Is it possible to iterate all hits and sent/stack all hits in an action? "condition": { "script": …

---

## [About the installed plugins when upgrade Java (8 - \> 11)](https://discuss.elastic.co/t/about-the-installed-plugins-when-upgrade-java-8-11/239236)

<div class="topic-metadata">

**Author:** [@Hyunsoo\_Shim](https://discuss.elastic.co/u/Hyunsoo_Shim)\
**Replies:** 1\
**Last updated:** [June 30, 2020, 8:11am UTC](https://discuss.elastic.co/t/about-the-installed-plugins-when-upgrade-java-8-11/239236 "2020-06-30T08:11:01Z")

</div>

Hello, We are using Elasticsearch 6.5.2 on Java 8 currently, and have a plan to upgrade Java 11 for using G1GC safely. But, we have already installed many custom plugins made of Java 8. Do we need to install them aga…

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=874)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=876)
