# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=961

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 962

---

## [Logrotate delete old files](https://discuss.elastic.co/t/logrotate-delete-old-files/227279)

<div class="topic-metadata">

**Author:** [@asp](https://discuss.elastic.co/u/asp)\
**Replies:** 0\
**Last updated:** [April 9, 2020, 8:43am UTC](https://discuss.elastic.co/t/logrotate-delete-old-files/227279 "2020-04-09T08:43:57Z")

</div>

Hi, I am using elasticsearch 7.5.2. Elasticsearch is rotating its logs each day by default. How can I configure elasticsearch to keep only the last 7 days for example? What is best practice? If possible I don't want t…

---

## [ES5 -\> ES6 -\> ES7, Snapshot Restore, Reindex, Index Size increase](https://discuss.elastic.co/t/es5-es6-es7-snapshot-restore-reindex-index-size-increase/227263)

<div class="topic-metadata">

**Author:** [@thoro\_cf](https://discuss.elastic.co/u/thoro_cf)\
**Replies:** 1\
**Last updated:** [April 9, 2020, 8:28am UTC](https://discuss.elastic.co/t/es5-es6-es7-snapshot-restore-reindex-index-size-increase/227263 "2020-04-09T08:28:07Z")

</div>

Hi, so I'm migrating ES5 to ES7 by loading indices in ES6, then reindexing them, doing a snapshot, and then loading the snapshot in ES7 and doing another reindex. I have noticed that the index size varies dramatically. …

---

## ['Cannot find /home/node/.rally/benchmarks/data/http\_logs/documents-191998.json.bz2. Please disable offline mode and retry again.'](https://discuss.elastic.co/t/cannot-find-home-node-rally-benchmarks-data-http-logs-documents-191998-json-bz2-please-disable-offline-mode-and-retry-again/226314)

<div class="topic-metadata">

**Author:** [@xilei](https://discuss.elastic.co/u/xilei)\
**Replies:** 5\
**Last updated:** [April 9, 2020, 8:23am UTC](https://discuss.elastic.co/t/cannot-find-home-node-rally-benchmarks-data-http-logs-documents-191998-json-bz2-please-disable-offline-mode-and-retry-again/226314 "2020-04-09T08:23:53Z")

</div>

Hi, When i run ./esrally race --pipeline=benchmark-only --target-hosts=192.168.2.28:9200 --offline --track=http\_logs --challenge=append-no-conflicts-index-only --distribution-version=5.6.10, show error as \[ERROR\] Cannot…

---

## [Retrieve more than 10000 records for search request in Watcher](https://discuss.elastic.co/t/retrieve-more-than-10000-records-for-search-request-in-watcher/227091)

<div class="topic-metadata">

**Author:** [@shubhamshd99](https://discuss.elastic.co/u/shubhamshd99)\
**Replies:** 4\
**Last updated:** [April 9, 2020, 8:14am UTC](https://discuss.elastic.co/t/retrieve-more-than-10000-records-for-search-request-in-watcher/227091 "2020-04-09T08:14:34Z")

</div>

Hi Guys, I am trying to retrieve records more than 10k through search request in Watcher, but due to its max-limit, it is rejecting all the records over and above 10k number. There is already a discussion here on how…

---

## [Best Approach for Processing Search Queries through Stored Database](https://discuss.elastic.co/t/best-approach-for-processing-search-queries-through-stored-database/227268)

<div class="topic-metadata">

**Author:** [@Prajakta\_Memane](https://discuss.elastic.co/u/Prajakta_Memane)\
**Replies:** 0\
**Last updated:** [April 9, 2020, 7:49am UTC](https://discuss.elastic.co/t/best-approach-for-processing-search-queries-through-stored-database/227268 "2020-04-09T07:49:00Z")

</div>

If I am not using real time data for querying and processing my search results , For Example i have 2 3 files (csv or excel or json) which contains millions of records . Now i want to search my input query result with my…

---

## [Date extract in elastic is showing as String Type and NOT Date](https://discuss.elastic.co/t/date-extract-in-elastic-is-showing-as-string-type-and-not-date/227075)

<div class="topic-metadata">

**Author:** [@Praveen\_V](https://discuss.elastic.co/u/Praveen_V)\
**Replies:** 3\
**Last updated:** [April 9, 2020, 7:14am UTC](https://discuss.elastic.co/t/date-extract-in-elastic-is-showing-as-string-type-and-not-date/227075 "2020-04-09T07:14:20Z")

</div>

Extract is working fine , however this is still represented as String rather than Date.. Any help here would be much appreciated Sample data : 2020-04-06 05:16:36: test again curl -X PUT "localhost:9200/\_ingest/pipeli…

---

## [Watcher alert telegram count fields](https://discuss.elastic.co/t/watcher-alert-telegram-count-fields/227247)

<div class="topic-metadata">

**Author:** [@Silver](https://discuss.elastic.co/u/Silver)\
**Replies:** 0\
**Last updated:** [April 9, 2020, 6:14am UTC](https://discuss.elastic.co/t/watcher-alert-telegram-count-fields/227247 "2020-04-09T06:14:15Z")

</div>

The watcher script should be able to calculate the total.hits for each user and show the count based on it. Right now my query is flooding with too many duplicate entries. "trigger": { "schedule": { "interva…

---

## [OSS repo is not working](https://discuss.elastic.co/t/oss-repo-is-not-working/226730)

<div class="topic-metadata">

**Author:** [@jovan](https://discuss.elastic.co/u/jovan)\
**Replies:** 7\
**Last updated:** [April 9, 2020, 6:48am UTC](https://discuss.elastic.co/t/oss-repo-is-not-working/226730 "2020-04-09T06:48:39Z")

</div>

Hi team, I wanted to report that OSS repo is not working properly, it has non oss packages instead of oss packages: https://artifacts.elastic.co/packages/oss-7.x/yum We need it, as we use the OSS packages through repo…

---

## [Elasticsearch Bulk API problems](https://discuss.elastic.co/t/elasticsearch-bulk-api-problems/227068)

<div class="topic-metadata">

**Author:** [@zebulyon](https://discuss.elastic.co/u/zebulyon)\
**Replies:** 10\
**Last updated:** [April 9, 2020, 5:48am UTC](https://discuss.elastic.co/t/elasticsearch-bulk-api-problems/227068 "2020-04-09T05:48:24Z")

</div>

Hello, I'm in the possession of some JSON files that i would like to send to Elasticsearch so that they can be viewed in Kibana. To do this I'm using a cUrl commando as found here in the Bulk API: https://www.elastic.…

---

## [Question about some details for Query Phase](https://discuss.elastic.co/t/question-about-some-details-for-query-phase/227232)

<div class="topic-metadata">

**Author:** [@Hyunsoo\_Shim](https://discuss.elastic.co/u/Hyunsoo_Shim)\
**Replies:** 3\
**Last updated:** [April 9, 2020, 5:46am UTC](https://discuss.elastic.co/t/question-about-some-details-for-query-phase/227232 "2020-04-09T05:46:25Z")

</div>

Dear All, Could you let me know how to process "Query Phase" exactly when an index has replicas? For all I know, The coordinating node sends Query to every shard for Query Phase. I want to understand the exact meaning…

---

## [An REST API which can Filter Based on field](https://discuss.elastic.co/t/an-rest-api-which-can-filter-based-on-field/227058)

<div class="topic-metadata">

**Author:** [@nikhilmahipathi555](https://discuss.elastic.co/u/nikhilmahipathi555)\
**Replies:** 3\
**Last updated:** [April 9, 2020, 5:42am UTC](https://discuss.elastic.co/t/an-rest-api-which-can-filter-based-on-field/227058 "2020-04-09T05:42:03Z")

</div>

Hi, I need a Search API that can filter based on a field value in the response body. e.g: I need to filter based on TYPE value { "took": 12, "responses": \[ { "took": 12, "t…

---

## [Match phrase prefix query not working as expected](https://discuss.elastic.co/t/match-phrase-prefix-query-not-working-as-expected/227233)

<div class="topic-metadata">

**Author:** [@oneoneonepig](https://discuss.elastic.co/u/oneoneonepig)\
**Replies:** 0\
**Last updated:** [April 9, 2020, 5:15am UTC](https://discuss.elastic.co/t/match-phrase-prefix-query-not-working-as-expected/227233 "2020-04-09T05:15:56Z")

</div>

According to the documents: Match phrase prefix query Returns documents that contain the words of a provided text, in the same order as provided. The last term of the provided text is treated as a prefix, matching a…

---

## [How to scroll back in Elasticsearch Search Scroll API](https://discuss.elastic.co/t/how-to-scroll-back-in-elasticsearch-search-scroll-api/227149)

<div class="topic-metadata">

**Author:** [@Amine\_Maalfi](https://discuss.elastic.co/u/Amine_Maalfi)\
**Replies:** 5\
**Last updated:** [April 9, 2020, 3:50am UTC](https://discuss.elastic.co/t/how-to-scroll-back-in-elasticsearch-search-scroll-api/227149 "2020-04-09T03:50:51Z")

</div>

Hello everyone is there a way to scroll up and down in the search scroll API of Elasticsearch? i mean, if i reach the end and nothing shows i want to go back in the opposite direction. if it's not possible is there a wo…

---

## [Query + composite + top\_hits = exception](https://discuss.elastic.co/t/query-composite-top-hits-exception/227225)

<div class="topic-metadata">

**Author:** [@jjacob](https://discuss.elastic.co/u/jjacob)\
**Replies:** 0\
**Last updated:** [April 9, 2020, 2:39am UTC](https://discuss.elastic.co/t/query-composite-top-hits-exception/227225 "2020-04-09T02:39:51Z")

</div>

I have a query that throws an exception, and I can't seem to work around it. My actual configuration is a bit more complex than what I have below, but I've managed to cook up an example that still produces the error. Ru…

---

## [Deleting Indexes](https://discuss.elastic.co/t/deleting-indexes/227213)

<div class="topic-metadata">

**Author:** [@patrickr](https://discuss.elastic.co/u/patrickr)\
**Replies:** 2\
**Last updated:** [April 9, 2020, 12:56am UTC](https://discuss.elastic.co/t/deleting-indexes/227213 "2020-04-09T00:56:31Z")

</div>

I am relatively new to ELK and have noticed that our server isn't deleting old Logstash indexes. If I need to create a Lifecycle policy I can't seem to find instructions for doing that with these records. If I attempt …

---

## [Multipath and 3 several disks](https://discuss.elastic.co/t/multipath-and-3-several-disks/227202)

<div class="topic-metadata">

**Author:** [@elastic\_user1](https://discuss.elastic.co/u/elastic_user1)\
**Replies:** 1\
**Last updated:** [April 9, 2020, 12:45am UTC](https://discuss.elastic.co/t/multipath-and-3-several-disks/227202 "2020-04-09T00:45:48Z")

</div>

I am using a single node for logging purposes. I have got 3 disks of different size, the first one smaller than the other ones. The first one has capacity of 1 Tb and the others 3 Tb. I want to use them in multipath. Can…

---

## [When trying to percolate: Unhandled rejection NoLivingConnectionsError: There are no living connections](https://discuss.elastic.co/t/when-trying-to-percolate-unhandled-rejection-nolivingconnectionserror-there-are-no-living-connections/227218)

<div class="topic-metadata">

**Author:** [@jmwilkinson](https://discuss.elastic.co/u/jmwilkinson)\
**Replies:** 0\
**Last updated:** [April 9, 2020, 12:02am UTC](https://discuss.elastic.co/t/when-trying-to-percolate-unhandled-rejection-nolivingconnectionserror-there-are-no-living-connections/227218 "2020-04-09T00:02:17Z")

</div>

Using the @elastic/elasticsearch npm library, I see the following error when running a percolate query: Unhandled rejection NoLivingConnectionsError: There are no living connections at makeRequest (.../node\_modules/…

---

## [Cluster not reporting actual available space](https://discuss.elastic.co/t/cluster-not-reporting-actual-available-space/226785)

<div class="topic-metadata">

**Author:** [@supremepizza](https://discuss.elastic.co/u/supremepizza)\
**Replies:** 3\
**Last updated:** [April 8, 2020, 10:21pm UTC](https://discuss.elastic.co/t/cluster-not-reporting-actual-available-space/226785 "2020-04-08T22:21:52Z")

</div>

I'm running 16 containers as data nodes, each has it's own 7 TB drive, there are 4 containers per physical host. Individually, the containers see the available space fine, but the total "Disk Available" for the cluster …

---

## [Geo-point turns into text after rollover](https://discuss.elastic.co/t/geo-point-turns-into-text-after-rollover/227101)

<div class="topic-metadata">

**Author:** [@Mahmood\_Al-Imam](https://discuss.elastic.co/u/Mahmood_Al-Imam)\
**Replies:** 6\
**Last updated:** [April 8, 2020, 10:18pm UTC](https://discuss.elastic.co/t/geo-point-turns-into-text-after-rollover/227101 "2020-04-08T22:18:45Z")

</div>

Hi, During my work with roll-over, I applied a policy in the ILM. This has been used with an index template. I created an index based on that template and it maps to one field type geo-point. I noticed that as soon as a…

---

## [ES 7.4 rollups jobs for new created indexes](https://discuss.elastic.co/t/es-7-4-rollups-jobs-for-new-created-indexes/226287)

<div class="topic-metadata">

**Author:** [@marianok](https://discuss.elastic.co/u/marianok)\
**Replies:** 1\
**Last updated:** [April 8, 2020, 8:58pm UTC](https://discuss.elastic.co/t/es-7-4-rollups-jobs-for-new-created-indexes/226287 "2020-04-08T20:58:19Z")

</div>

Hi, we're looking to use the rollups functionality (on ES 7.4) in order the reduce size of the data for our search queries. We have a monthly lifecycle strategy for our data: each month data is stored in a separated in…

---

## [Why is RandomizedRunner required to use ES test framework?](https://discuss.elastic.co/t/why-is-randomizedrunner-required-to-use-es-test-framework/227197)

<div class="topic-metadata">

**Author:** [@ppine7](https://discuss.elastic.co/u/ppine7)\
**Replies:** 0\
**Last updated:** [April 8, 2020, 7:06pm UTC](https://discuss.elastic.co/t/why-is-randomizedrunner-required-to-use-es-test-framework/227197 "2020-04-08T19:06:59Z")

</div>

I'm upgrading a legacy app that uses both Elasticsearch test framework (MockNode and cluster from the org.elasticsearch.test:framework:6.5.3) and EmbeddedKafka/Zookeeper frameworks. I'm facing an issue with upgrading fro…

---

## [Elasticsearch curator not found how is this possible?](https://discuss.elastic.co/t/elasticsearch-curator-not-found-how-is-this-possible/227167)

<div class="topic-metadata">

**Author:** [@calanon](https://discuss.elastic.co/u/calanon)\
**Replies:** 1\
**Last updated:** [April 8, 2020, 6:54pm UTC](https://discuss.elastic.co/t/elasticsearch-curator-not-found-how-is-this-possible/227167 "2020-04-08T18:54:00Z")

</div>

Hi I get this message: W: Failed to fetch https://packages.elastic.co/curator/5/debian9/dists/stable/InRelease Reading from proxy failed - read (115: Operation now in progress) I am trying to install curator at this u…

---

## [ElasticSearch Path Hierarchy Tokenizer Aggregation](https://discuss.elastic.co/t/elasticsearch-path-hierarchy-tokenizer-aggregation/227191)

<div class="topic-metadata">

**Author:** [@oemer](https://discuss.elastic.co/u/oemer)\
**Replies:** 0\
**Last updated:** [April 8, 2020, 6:14pm UTC](https://discuss.elastic.co/t/elasticsearch-path-hierarchy-tokenizer-aggregation/227191 "2020-04-08T18:14:56Z")

</div>

I'm going with the this example here. https://www.elastic.co/guide/en/elasticsearch/reference/current/analysis-pathhierarchy-tokenizer-examples.html#analysis-pathhierarchy-tokenizer-examples My mapping code is below: …

---

## [Parse JSON aggs into AggregationBuilder in ES 7.1](https://discuss.elastic.co/t/parse-json-aggs-into-aggregationbuilder-in-es-7-1/227189)

<div class="topic-metadata">

**Author:** [@nsaxena](https://discuss.elastic.co/u/nsaxena)\
**Replies:** 0\
**Last updated:** [April 8, 2020, 5:53pm UTC](https://discuss.elastic.co/t/parse-json-aggs-into-aggregationbuilder-in-es-7-1/227189 "2020-04-08T17:53:21Z")

</div>

Hello, This question has been asked before and has been answered but for an older version of ElasticSearch which does not work for 7.1 version. My requirement is to be able to parse JSON search request containing aggs …

---

## [NEST - IndexMany with Version Type External?](https://discuss.elastic.co/t/nest-indexmany-with-version-type-external/226381)

<div class="topic-metadata">

**Author:** [@Pikabanga](https://discuss.elastic.co/u/Pikabanga)\
**Replies:** 2\
**Last updated:** [April 8, 2020, 5:28pm UTC](https://discuss.elastic.co/t/nest-indexmany-with-version-type-external/226381 "2020-04-08T17:28:02Z")

</div>

Hi! I am looking for a way to use the External Version Type when using NEST's "IndexMany" API, but I can't find it. When doing a simple index single it works just fine: public Task IndexDocumentAsync\<T\>(T document, lo…

---

## [Any plugin available for Elasticsearch on par with Velocity Response Writer for Solr?](https://discuss.elastic.co/t/any-plugin-available-for-elasticsearch-on-par-with-velocity-response-writer-for-solr/226993)

<div class="topic-metadata">

**Author:** [@zxhmike](https://discuss.elastic.co/u/zxhmike)\
**Replies:** 1\
**Last updated:** [April 8, 2020, 5:15pm UTC](https://discuss.elastic.co/t/any-plugin-available-for-elasticsearch-on-par-with-velocity-response-writer-for-solr/226993 "2020-04-08T17:15:50Z")

</div>

Hi there, We are trying for find a plugin for Elasticsearch on par with Velocity Response Writer for Solr? https://lucene.apache.org/solr/guide/8\_5/velocity-response-writer.html#velocity-response-writer Basically, we w…

---

## [Is it possible to "normalize" a boolean field upon ingest when it may appear as a string or a boolean?](https://discuss.elastic.co/t/is-it-possible-to-normalize-a-boolean-field-upon-ingest-when-it-may-appear-as-a-string-or-a-boolean/227178)

<div class="topic-metadata">

**Author:** [@tomj](https://discuss.elastic.co/u/tomj)\
**Replies:** 0\
**Last updated:** [April 8, 2020, 4:36pm UTC](https://discuss.elastic.co/t/is-it-possible-to-normalize-a-boolean-field-upon-ingest-when-it-may-appear-as-a-string-or-a-boolean/227178 "2020-04-08T16:36:59Z")

</div>

I tested this behavior on ES 6.7 and 7.6. The example below is using 6.7. I would like to be able to convert the string literals "true" and "false" to the associated boolean values. My reasoning is that I have tools q…

---

## [Source ip field is not getting enable while i am able to get host.ip from log file](https://discuss.elastic.co/t/source-ip-field-is-not-getting-enable-while-i-am-able-to-get-host-ip-from-log-file/227177)

<div class="topic-metadata">

**Author:** [@farhana\_begum](https://discuss.elastic.co/u/farhana_begum)\
**Replies:** 0\
**Last updated:** [April 8, 2020, 4:27pm UTC](https://discuss.elastic.co/t/source-ip-field-is-not-getting-enable-while-i-am-able-to-get-host-ip-from-log-file/227177 "2020-04-08T16:27:32Z")

</div>

Source ip field is not getting enable while i am able to get host.ip from log file And Im unable to get ldap.dn(Application account) and source.ip together. Please help Field: source.ip

---

## [ERROR: Failed to set password for user \[apm\_system\]](https://discuss.elastic.co/t/error-failed-to-set-password-for-user-apm-system/227172)

<div class="topic-metadata">

**Author:** [@Ludovic9](https://discuss.elastic.co/u/Ludovic9)\
**Replies:** 0\
**Last updated:** [April 8, 2020, 4:01pm UTC](https://discuss.elastic.co/t/error-failed-to-set-password-for-user-apm-system/227172 "2020-04-08T16:01:46Z")

</div>

hi, I'm trying to setup authentication on my elk stack. I have done a test with my test environnment, it was OK but in production, I can't do the first step. I am in 6.8.3 and I have 4 nodes. And basic licence. I have…

---

## [Index template - adding multiple aliases](https://discuss.elastic.co/t/index-template-adding-multiple-aliases/227171)

<div class="topic-metadata">

**Author:** [@wedkarz014](https://discuss.elastic.co/u/wedkarz014)\
**Replies:** 0\
**Last updated:** [April 8, 2020, 4:01pm UTC](https://discuss.elastic.co/t/index-template-adding-multiple-aliases/227171 "2020-04-08T16:01:08Z")

</div>

Hi, I have ES 6.8.3, I want to set multiple aliases in index template but i have an error: { "error": { "root\_cause": \[ { "type": "mapper\_parsing\_exception", "reason": "Root mapping definiti…

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=960)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=962)
