# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=716

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 717

---

## ['Lock' in Persistent Volumes on Openshift when deploys blue-green ELK Stack](https://discuss.elastic.co/t/lock-in-persistent-volumes-on-openshift-when-deploys-blue-green-elk-stack/262377)

<div class="topic-metadata">

**Author:** [@jonhmb](https://discuss.elastic.co/u/jonhmb)\
**Replies:** 4\
**Last updated:** [January 28, 2021, 1:17pm UTC](https://discuss.elastic.co/t/lock-in-persistent-volumes-on-openshift-when-deploys-blue-green-elk-stack/262377 "2021-01-28T13:17:57Z")

</div>

I have an ELK Stack running in a Openshift POD as 'Blue' using Persistent Volumes to storage data. When I try to deploy a second ELK Stack in a second POD using the same Persistent Volumes, i get an error because ELK Vo…

---

## [Return multiple fields when performing aggregations](https://discuss.elastic.co/t/return-multiple-fields-when-performing-aggregations/262502)

<div class="topic-metadata">

**Author:** [@ArifAlili](https://discuss.elastic.co/u/ArifAlili)\
**Replies:** 0\
**Last updated:** [January 28, 2021, 1:13pm UTC](https://discuss.elastic.co/t/return-multiple-fields-when-performing-aggregations/262502 "2021-01-28T13:13:57Z")

</div>

Hi all, Is there a way to return other fields besides "key" and "doc\_count" when performing aggregations? I don't want to do aggregation on multiple fields, I just want multiple fields to be returned in Aggregation res…

---

## [ImportError: cannot import name ‘decodestring’ from ‘base64’ (/usr/lib64/python3.9/base64.py)](https://discuss.elastic.co/t/importerror-cannot-import-name-decodestring-from-base64-usr-lib64-python3-9-base64-py/262248)

<div class="topic-metadata">

**Author:** [@Green\_Max](https://discuss.elastic.co/u/Green_Max)\
**Replies:** 4\
**Last updated:** [January 27, 2021, 12:53pm UTC](https://discuss.elastic.co/t/importerror-cannot-import-name-decodestring-from-base64-usr-lib64-python3-9-base64-py/262248 "2021-01-27T12:53:49Z")

</div>

can you help me to fix bug that says Traceback (most recent call last): File "/home/fofive/PycharmProjects/pythonProject/main.py", line 1, in \<module\> from elasticsearch import Elasticsearch, RequestsH…

---

## [Sorting @timestamp while exporting from elasticsearch and writing into csv](https://discuss.elastic.co/t/sorting-timestamp-while-exporting-from-elasticsearch-and-writing-into-csv/262496)

<div class="topic-metadata">

**Author:** [@ritusingh](https://discuss.elastic.co/u/ritusingh)\
**Replies:** 0\
**Last updated:** [January 28, 2021, 12:35pm UTC](https://discuss.elastic.co/t/sorting-timestamp-while-exporting-from-elasticsearch-and-writing-into-csv/262496 "2021-01-28T12:35:04Z")

</div>

Hi, Problem Statement: To export the logs from elasticsearch and write into csv in timewise order(either increasing or decreasing) Solution: I am using logstash , configuration is given below, input { elasticsearch {…

---

## [Configure TLS/SSL for elasticsearch using Letsencrypt issue](https://discuss.elastic.co/t/configure-tls-ssl-for-elasticsearch-using-letsencrypt-issue/262352)

<div class="topic-metadata">

**Author:** [@gvx3](https://discuss.elastic.co/u/gvx3)\
**Replies:** 1\
**Last updated:** [January 28, 2021, 10:21am UTC](https://discuss.elastic.co/t/configure-tls-ssl-for-elasticsearch-using-letsencrypt-issue/262352 "2021-01-28T10:21:24Z")

</div>

Hi all, I'm trying to configure TLS connection for elasticsearch using helm package, here is current configuration: protocol: https secretMounts: - name: certall secretName: certall path: /…

---

## [405 error when calling /\_cluster/health?level=indices from a watcher](https://discuss.elastic.co/t/405-error-when-calling-cluster-health-level-indices-from-a-watcher/262457)

<div class="topic-metadata">

**Author:** [@mkadiri](https://discuss.elastic.co/u/mkadiri)\
**Replies:** 2\
**Last updated:** [January 28, 2021, 8:30am UTC](https://discuss.elastic.co/t/405-error-when-calling-cluster-health-level-indices-from-a-watcher/262457 "2021-01-28T08:30:19Z")

</div>

I'm trying to setup a watcher to display indices health using the endpoint mentioned but keep getting a 405 error. This error goes away when I just use the following /\_cluster/health dropping the params ?level=indices, …

---

## [Elasticsearch python async client multiple requests](https://discuss.elastic.co/t/elasticsearch-python-async-client-multiple-requests/262460)

<div class="topic-metadata">

**Author:** [@NerdSec](https://discuss.elastic.co/u/NerdSec)\
**Replies:** 0\
**Last updated:** [January 28, 2021, 7:07am UTC](https://discuss.elastic.co/t/elasticsearch-python-async-client-multiple-requests/262460 "2021-01-28T07:07:18Z")

</div>

Hi, I was trying to use the Elasticsearch python client to make async queries to Elasticsearch. I'm trying to run aggs, and have a few partitions that I want to fetch results from. Here is my query: { 'query': { 'bo…

---

## [Search based on aggregation result](https://discuss.elastic.co/t/search-based-on-aggregation-result/262431)

<div class="topic-metadata">

**Author:** [@Julian\_Ganzabal](https://discuss.elastic.co/u/Julian_Ganzabal)\
**Replies:** 2\
**Last updated:** [January 28, 2021, 1:37am UTC](https://discuss.elastic.co/t/search-based-on-aggregation-result/262431 "2021-01-28T01:37:48Z")

</div>

I am actually doing a query with an aggregation that returns a list from which I need to re-search. So, I get the aggregated data and then do a search on this aggregated data. That means 2 requests to Elasticsearch Is …

---

## [All data nodes oom down during heavily indexing periods](https://discuss.elastic.co/t/all-data-nodes-oom-down-during-heavily-indexing-periods/262376)

<div class="topic-metadata">

**Author:** [@wangxr1985](https://discuss.elastic.co/u/wangxr1985)\
**Replies:** 2\
**Last updated:** [January 28, 2021, 3:19am UTC](https://discuss.elastic.co/t/all-data-nodes-oom-down-during-heavily-indexing-periods/262376 "2021-01-28T03:19:34Z")

</div>

ES version: 7.5.2 JDK version: bundled openjdk 13 GC settings: -XX:+UseG1GC -XX:MaxGCPauseMillis=20 -XX:+UnlockExperimentalVMOptions -XX:G1NewSizePercent=2 We do heavily indexing(enable sniffing and all data node…

---

## [Curator date match does not meet provided criteria](https://discuss.elastic.co/t/curator-date-match-does-not-meet-provided-criteria/262300)

<div class="topic-metadata">

**Author:** [@kyle\_che](https://discuss.elastic.co/u/kyle_che)\
**Replies:** 2\
**Last updated:** [January 28, 2021, 12:09am UTC](https://discuss.elastic.co/t/curator-date-match-does-not-meet-provided-criteria/262300 "2021-01-28T00:09:05Z")

</div>

I'm trying to run curator and getting "does not meet provided criteria. Removing from list." Any idea on why the pattern below is not matching the index name? 3: action: delete\_indices description: \>- De…

---

## [Writing API update for setting number of replicas to 0](https://discuss.elastic.co/t/writing-api-update-for-setting-number-of-replicas-to-0/261595)

<div class="topic-metadata">

**Author:** [@txmrlevine](https://discuss.elastic.co/u/txmrlevine)\
**Replies:** 5\
**Last updated:** [January 27, 2021, 11:13pm UTC](https://discuss.elastic.co/t/writing-api-update-for-setting-number-of-replicas-to-0/261595 "2021-01-27T23:13:42Z")

</div>

We are trying to eliminate replicas in our non-prod environment to save space and we do not need the replicas. we know this is counter to the fault tolerance but it is something we must do. I found this on the document…

---

## [Nested Document Search Query (searching across filtered nested documents)](https://discuss.elastic.co/t/nested-document-search-query-searching-across-filtered-nested-documents/262420)

<div class="topic-metadata">

**Author:** [@suy1993](https://discuss.elastic.co/u/suy1993)\
**Replies:** 0\
**Last updated:** [January 27, 2021, 9:38pm UTC](https://discuss.elastic.co/t/nested-document-search-query-searching-across-filtered-nested-documents/262420 "2021-01-27T21:38:43Z")

</div>

I have nested document like {id:123, name:"abc", attendance\[{class: "physics", Joined: "2021-01- 21", "grade": "pass"} , {class: "chemistry", Joined: "2021-01- 13", "grade": "NA"}, {class: "maths", Joined: "2021-01- …

---

## [Roll up index](https://discuss.elastic.co/t/roll-up-index/262010)

<div class="topic-metadata">

**Author:** [@elasticforme](https://discuss.elastic.co/u/elasticforme)\
**Replies:** 4\
**Last updated:** [January 27, 2021, 9:30pm UTC](https://discuss.elastic.co/t/roll-up-index/262010 "2021-01-27T21:30:55Z")

</div>

I have turn on roll up job for testing when I do GET /\_rollup/job/\_all I can see it is running. it says started but I don't see any rollup index. I don't see any index named metricbeat-rollup how do I confirm that it…

---

## [Python read all index pattern](https://discuss.elastic.co/t/python-read-all-index-pattern/262293)

<div class="topic-metadata">

**Author:** [@elasticforme](https://discuss.elastic.co/u/elasticforme)\
**Replies:** 4\
**Last updated:** [January 27, 2021, 9:30pm UTC](https://discuss.elastic.co/t/python-read-all-index-pattern/262293 "2021-01-27T21:30:02Z")

</div>

is there a python call to read all index patterns I can read all indexes but I want to read patterns name for example I have index-1, index-2, index-3 and index pattern is index-\* and I use that for all visulization. …

---

## [How to distribute search requests by date](https://discuss.elastic.co/t/how-to-distribute-search-requests-by-date/262405)

<div class="topic-metadata">

**Author:** [@ozgun](https://discuss.elastic.co/u/ozgun)\
**Replies:** 2\
**Last updated:** [January 27, 2021, 8:54pm UTC](https://discuss.elastic.co/t/how-to-distribute-search-requests-by-date/262405 "2021-01-27T20:54:27Z")

</div>

Hello, I have daily indexes in the format of "payments-2021-01-27". When I search documents I send a time based query and I want to distribute search requests to the matched indexes by date. For example when I search l…

---

## [Composite aggs with an after key in a large index take forever](https://discuss.elastic.co/t/composite-aggs-with-an-after-key-in-a-large-index-take-forever/262412)

<div class="topic-metadata">

**Author:** [@benlin](https://discuss.elastic.co/u/benlin)\
**Replies:** 0\
**Last updated:** [January 27, 2021, 7:48pm UTC](https://discuss.elastic.co/t/composite-aggs-with-an-after-key-in-a-large-index-take-forever/262412 "2021-01-27T19:48:34Z")

</div>

I'm running into an issue where composite aggs with an after key seem to run forever on large indices (several 100m docs) when the same agg without an after key runs just fine. So this runs in seconds: { "size": 0, …

---

## [ElasticSearch 6.8 Slow on Apple Silicon](https://discuss.elastic.co/t/elasticsearch-6-8-slow-on-apple-silicon/262379)

<div class="topic-metadata">

**Author:** [@gjaldon](https://discuss.elastic.co/u/gjaldon)\
**Replies:** 0\
**Last updated:** [January 27, 2021, 2:42pm UTC](https://discuss.elastic.co/t/elasticsearch-6-8-slow-on-apple-silicon/262379 "2021-01-27T14:42:49Z")

</div>

Hi everyone! I'm running ElasticSearch 6.8 on my Mac Air M1 which I downloaded from https://www.elastic.co/guide/en/elasticsearch/reference/6.8/zip-targz.html. I noticed that our test suite runs much slower on Elasticsea…

---

## [Fscrawler](https://discuss.elastic.co/t/fscrawler/260467)

<div class="topic-metadata">

**Author:** [@vikram\_singh](https://discuss.elastic.co/u/vikram_singh)\
**Replies:** 14\
**Last updated:** [January 27, 2021, 2:25pm UTC](https://discuss.elastic.co/t/fscrawler/260467 "2021-01-27T14:25:25Z")

</div>

Hi I am running elasticsearch cluster in docker. Setup fscrawler, but when I am running it is giving error We can not start Elasticsearch Client. Exiting. Here are complete error Recreating fscrawler ... done Attachin…

---

## [Logstash and Mysql logs](https://discuss.elastic.co/t/logstash-and-mysql-logs/262374)

<div class="topic-metadata">

**Author:** [@cwt](https://discuss.elastic.co/u/cwt)\
**Replies:** 0\
**Last updated:** [January 27, 2021, 2:04pm UTC](https://discuss.elastic.co/t/logstash-and-mysql-logs/262374 "2021-01-27T14:04:41Z")

</div>

Hi. I have a problem with a JSON logs from mysql servers. I send such logs to logstash but they don't get into elastic and give no error. If I change single quotes for 'alerts test' to double quotes "alerts test" everyth…

---

## [Deleting data deleted from the source in Elasticsearch](https://discuss.elastic.co/t/deleting-data-deleted-from-the-source-in-elasticsearch/262366)

<div class="topic-metadata">

**Author:** [@RusseL](https://discuss.elastic.co/u/RusseL)\
**Replies:** 1\
**Last updated:** [January 27, 2021, 1:48pm UTC](https://discuss.elastic.co/t/deleting-data-deleted-from-the-source-in-elasticsearch/262366 "2021-01-27T13:48:32Z")

</div>

Hi guys, I transfer data between MSSQL and Elasticsearch using LogStash. I want the data deleted on the MSSQL side to be deleted in Elasticsearch. Is it possible? Please say if more details are required.

---

## [Error reindex some data](https://discuss.elastic.co/t/error-reindex-some-data/262284)

<div class="topic-metadata">

**Author:** [@higor.grilo](https://discuss.elastic.co/u/higor.grilo)\
**Replies:** 1\
**Last updated:** [January 27, 2021, 12:27pm UTC](https://discuss.elastic.co/t/error-reindex-some-data/262284 "2021-01-27T12:27:09Z")

</div>

Hi, I've been trying to migrate my ELK from v6.8 to v7.10, but prior to this i have to solve some issues pointed by 7.0 Upgrade Assistant. I have some fields with the format: yyyy-MM-dd HH:mm:ss, i've already created a…

---

## [ILM phase don't delete indexes, only clean up](https://discuss.elastic.co/t/ilm-phase-dont-delete-indexes-only-clean-up/261440)

<div class="topic-metadata">

**Author:** [@zakabluk](https://discuss.elastic.co/u/zakabluk)\
**Replies:** 7\
**Last updated:** [January 27, 2021, 12:12pm UTC](https://discuss.elastic.co/t/ilm-phase-dont-delete-indexes-only-clean-up/261440 "2021-01-27T12:12:09Z")

</div>

I cretaed ILM policy for two steps. It's hot and delete. full template PUT \_ilm/policy/logstash-f-lb { "policy": { "phases": { "hot": { "min\_age": "0ms", "actions": { "rollover": {…

---

## [Delaying Tasks](https://discuss.elastic.co/t/delaying-tasks/261949)

<div class="topic-metadata">

**Author:** [@Emiliano\_Baum](https://discuss.elastic.co/u/Emiliano_Baum)\
**Replies:** 2\
**Last updated:** [January 27, 2021, 11:20am UTC](https://discuss.elastic.co/t/delaying-tasks/261949 "2021-01-27T11:20:59Z")

</div>

Hi, i try to set the delayed\_timeout variable and have an 503 master timout error. Before that the cluster start to delay tasks: "number\_of\_pending\_tasks" : 127, the command I ran was: curl -X PUT "localhost:9200/\_al…

---

## [Nodes constantly losing connection](https://discuss.elastic.co/t/nodes-constantly-losing-connection/262331)

<div class="topic-metadata">

**Author:** [@borna\_talebi](https://discuss.elastic.co/u/borna_talebi)\
**Replies:** 3\
**Last updated:** [January 27, 2021, 10:30am UTC](https://discuss.elastic.co/t/nodes-constantly-losing-connection/262331 "2021-01-27T10:30:37Z")

</div>

I have a 2-node cluster(archive and main) and today they start losing connection. These are the two logs that keep appearing: \[2021-01-27T10:26:55,816\]\[WARN \]\[o.e.g.PersistedClusterStateService\] \[XXXarchive.XXX.local\] …

---

## [Sync many nodes into one](https://discuss.elastic.co/t/sync-many-nodes-into-one/262340)

<div class="topic-metadata">

**Author:** [@manyahin](https://discuss.elastic.co/u/manyahin)\
**Replies:** 0\
**Last updated:** [January 27, 2021, 8:51am UTC](https://discuss.elastic.co/t/sync-many-nodes-into-one/262340 "2021-01-27T08:51:58Z")

</div>

Hello, This is a theoretical problem. I have 100+ servers in the world connected to the Internet. Sometimes they are offline but continue to work and collect data. I would like to sync all those servers when they are…

---

## [How to change data mapping to include 'suggest type' for an existing index](https://discuss.elastic.co/t/how-to-change-data-mapping-to-include-suggest-type-for-an-existing-index/261930)

<div class="topic-metadata">

**Author:** [@nadyahmed123](https://discuss.elastic.co/u/nadyahmed123)\
**Replies:** 1\
**Last updated:** [January 27, 2021, 8:21am UTC](https://discuss.elastic.co/t/how-to-change-data-mapping-to-include-suggest-type-for-an-existing-index/261930 "2021-01-27T08:21:52Z")

</div>

Hi, I am new to ES. I have already created an index index1 which has some data. I need to implement autocomplete for one of the field, so for that I need to have the suggest type added in mappings (From what I read... d…

---

## [Masternode not being discovered in the workernode server and vice versa](https://discuss.elastic.co/t/masternode-not-being-discovered-in-the-workernode-server-and-vice-versa/262148)

<div class="topic-metadata">

**Author:** [@emem](https://discuss.elastic.co/u/emem)\
**Replies:** 1\
**Last updated:** [January 27, 2021, 8:05am UTC](https://discuss.elastic.co/t/masternode-not-being-discovered-in-the-workernode-server-and-vice-versa/262148 "2021-01-27T08:05:49Z")

</div>

\[2021-01-25T13:45:26,577\]\[INFO \]\[o.e.b.BootstrapChecks \] \[data-1\] bound or publishing to a non-loopback address, enforcing bootstrap checks \[2021-01-25T13:45:26,603\]\[INFO \]\[o.e.c.c.ClusterBootstrapService\] \[data-1\] sk…

---

## [Understanding segments: are segments queried concurrently?](https://discuss.elastic.co/t/understanding-segments-are-segments-queried-concurrently/262239)

<div class="topic-metadata">

**Author:** [@gkman](https://discuss.elastic.co/u/gkman)\
**Replies:** 1\
**Last updated:** [January 27, 2021, 8:03am UTC](https://discuss.elastic.co/t/understanding-segments-are-segments-queried-concurrently/262239 "2021-01-27T08:03:51Z")

</div>

I was reading about shard sizing and best practices (How many shards should I have in my Elasticsearch cluster? | Elastic Blog) , and understood that having fewer, larger segments, can improve query performance: TIP: A…

---

## [Scaling down ElasticSearch: what happens with closed indices?](https://discuss.elastic.co/t/scaling-down-elasticsearch-what-happens-with-closed-indices/262264)

<div class="topic-metadata">

**Author:** [@caarlos0](https://discuss.elastic.co/u/caarlos0)\
**Replies:** 5\
**Last updated:** [January 27, 2021, 7:56am UTC](https://discuss.elastic.co/t/scaling-down-elasticsearch-what-happens-with-closed-indices/262264 "2021-01-27T07:56:46Z")

</div>

To scale down ElasticSearch, I usually disable allocation on a node, wait for shards to relocate, and then remove the node, e.g.: curl -X PUT "localhost:9200/\_cluster/settings" -d'{ "transient" : { "cluster.routin…

---

## [Elasticsearch Not Processing Messages](https://discuss.elastic.co/t/elasticsearch-not-processing-messages/262299)

<div class="topic-metadata">

**Author:** [@Michael\_Anderson](https://discuss.elastic.co/u/Michael_Anderson)\
**Replies:** 1\
**Last updated:** [January 27, 2021, 7:52am UTC](https://discuss.elastic.co/t/elasticsearch-not-processing-messages/262299 "2021-01-27T07:52:23Z")

</div>

Hello, I have a 4 server Elasticsearch server cluster supporting graylog, and all of a sudden things have stopped working. Elasticsearch logs do not show any overt issues. The cluster is green, etc. However, graylog h…

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=715)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=717)
