# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=556

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 557

---

## [Number of indices / shards in a cluster](https://discuss.elastic.co/t/number-of-indices-shards-in-a-cluster/287076)

<div class="topic-metadata">

**Author:** [@mmoreram](https://discuss.elastic.co/u/mmoreram)\
**Replies:** 2\
**Last updated:** [October 19, 2021, 12:11pm UTC](https://discuss.elastic.co/t/number-of-indices-shards-in-a-cluster/287076 "2021-10-19T12:11:02Z")

</div>

What is the number of indices and shards "allowed" in a cluster? How big should be a cluster to have 1000 indices, having each 1 shard and 1 replica, being each a ~2000 items index? Even a small one is recommended a 1Gb …

---

## [Expose transport 9300 as Openshift route](https://discuss.elastic.co/t/expose-transport-9300-as-openshift-route/287086)

<div class="topic-metadata">

**Author:** [@fabry](https://discuss.elastic.co/u/fabry)\
**Replies:** 0\
**Last updated:** [October 19, 2021, 11:56am UTC](https://discuss.elastic.co/t/expose-transport-9300-as-openshift-route/287086 "2021-10-19T11:56:03Z")

</div>

Hi, Is it possible to expose the transport tsl connection (port 9300) as Openshift route? e.g to implement CCR. So far I couldn't get it working, I succeeded to expose it using NodePort and I can add a remote cluster b…

---

## [BitSet.or consumes almost 60% cpu](https://discuss.elastic.co/t/bitset-or-consumes-almost-60-cpu/286763)

<div class="topic-metadata">

**Author:** [@chembohuang](https://discuss.elastic.co/u/chembohuang)\
**Replies:** 23\
**Last updated:** [October 19, 2021, 11:25am UTC](https://discuss.elastic.co/t/bitset-or-consumes-almost-60-cpu/286763 "2021-10-19T11:25:40Z")

</div>

ES 7.7.1, jdk 14. We have two nodes with the same hardware(physical machine) under the same cluster which only hosts one index with 1 replica. Each node has the same shard. The weird thing is that, one of the machine'…

---

## [Snapshot index compatibility](https://discuss.elastic.co/t/snapshot-index-compatibility/287067)

<div class="topic-metadata">

**Author:** [@str8y](https://discuss.elastic.co/u/str8y)\
**Replies:** 1\
**Last updated:** [October 19, 2021, 10:06am UTC](https://discuss.elastic.co/t/snapshot-index-compatibility/287067 "2021-10-19T10:06:55Z")

</div>

Hi, I found in the snapshot documentation the compatibility matrix and the following hint Each snapshot can contain indices created in various versions of Elasticsearch. This includes backing indices created for data…

---

## [How to monitor cause of deletion of documents in index?](https://discuss.elastic.co/t/how-to-monitor-cause-of-deletion-of-documents-in-index/287052)

<div class="topic-metadata">

**Author:** [@d.silwon](https://discuss.elastic.co/u/d.silwon)\
**Replies:** 3\
**Last updated:** [October 19, 2021, 9:36am UTC](https://discuss.elastic.co/t/how-to-monitor-cause-of-deletion-of-documents-in-index/287052 "2021-10-19T09:36:53Z")

</div>

Dears, Is there any way to monitor process of deletion of documents from index? I'm asking about it because of from few days I observed this odd behavior. Similar situation I had when doc id was the same for few docume…

---

## [Ubuntu 20.04 tar/zip installed - systemd timeout](https://discuss.elastic.co/t/ubuntu-20-04-tar-zip-installed-systemd-timeout/287000)

<div class="topic-metadata">

**Author:** [@imper86](https://discuss.elastic.co/u/imper86)\
**Replies:** 3\
**Last updated:** [October 19, 2021, 9:04am UTC](https://discuss.elastic.co/t/ubuntu-20-04-tar-zip-installed-systemd-timeout/287000 "2021-10-19T09:04:09Z")

</div>

Hello, I have a strange issue with a fresh tar/zip installation of Elasticsearch. When I use Elasticsearch v6 this way - there is no problem. Also apt installation works fine. But when I want to use systemd with Elastic…

---

## [Optimizing agg on collapse](https://discuss.elastic.co/t/optimizing-agg-on-collapse/287058)

<div class="topic-metadata">

**Author:** [@CarloKok](https://discuss.elastic.co/u/CarloKok)\
**Replies:** 0\
**Last updated:** [October 19, 2021, 8:24am UTC](https://discuss.elastic.co/t/optimizing-agg-on-collapse/287058 "2021-10-19T08:24:53Z")

</div>

I have an index with "availability" of rooms in a set of hotels. Each record has among other things: HotelCode RoomType arrival Date Departure Date Price for stay Bunch of room features to filter on The nr of records …

---

## [How to apply combination of filters on array of objects?](https://discuss.elastic.co/t/how-to-apply-combination-of-filters-on-array-of-objects/286946)

<div class="topic-metadata">

**Author:** [@nsharma2412](https://discuss.elastic.co/u/nsharma2412)\
**Replies:** 3\
**Last updated:** [October 19, 2021, 7:30am UTC](https://discuss.elastic.co/t/how-to-apply-combination-of-filters-on-array-of-objects/286946 "2021-10-19T07:30:47Z")

</div>

Hi Please help me to write a suitable query for my task, I have list of products with different categories and associated attribute and tags. Here is two documents for two categories along with associated attribute list.…

---

## [Curator failed to delete snapshot: No space left on device](https://discuss.elastic.co/t/curator-failed-to-delete-snapshot-no-space-left-on-device/285189)

<div class="topic-metadata">

**Author:** [@chaitra\_hegde](https://discuss.elastic.co/u/chaitra_hegde)\
**Replies:** 2\
**Last updated:** [October 19, 2021, 5:29am UTC](https://discuss.elastic.co/t/curator-failed-to-delete-snapshot-no-space-left-on-device/285189 "2021-10-19T05:29:09Z")

</div>

Hi, I am facing below issue in Curator snapshot deletion. Curator version- 5.8.1, ES- 7.10.2 2021-09-19 02:01:01,159 ERROR Failed to complete action: delete\_snapshots. \<class 'curator.exceptions.FailedExecution'\>:…

---

## [Certificates between Elasticsearch/Kibana RHEL VM and certificate authority Windows server](https://discuss.elastic.co/t/certificates-between-elasticsearch-kibana-rhel-vm-and-certificate-authority-windows-server/287012)

<div class="topic-metadata">

**Author:** [@rebellionne](https://discuss.elastic.co/u/rebellionne)\
**Replies:** 1\
**Last updated:** [October 19, 2021, 1:23am UTC](https://discuss.elastic.co/t/certificates-between-elasticsearch-kibana-rhel-vm-and-certificate-authority-windows-server/287012 "2021-10-19T01:23:56Z")

</div>

Hi everybody After days of research, I finally decided to ask for help. I must precise that working with certificates is quite new to me especially on Linux environment. I run Elasticsearch and Kibana 7.15.0 on the sa…

---

## [Elasticsearch can not started：failed to find global metadata](https://discuss.elastic.co/t/elasticsearch-can-not-started-failed-to-find-global-metadata/287037)

<div class="topic-metadata">

**Author:** [@wangdwcsd](https://discuss.elastic.co/u/wangdwcsd)\
**Replies:** 9\
**Last updated:** [October 19, 2021, 1:02am UTC](https://discuss.elastic.co/t/elasticsearch-can-not-started-failed-to-find-global-metadata/287037 "2021-10-19T01:02:15Z")

</div>

After the master node is restarted, it cannot be started. The following errors are always reported in the log，Is there any way to enable the Elasticsearch instance to load metadata？ error log： \[2021-10-19T02:32:17,262\]…

---

## [Can't connect to ElasticSearch from python API in Docker-Compose setup](https://discuss.elastic.co/t/cant-connect-to-elasticsearch-from-python-api-in-docker-compose-setup/287031)

<div class="topic-metadata">

**Author:** [@amace](https://discuss.elastic.co/u/amace)\
**Replies:** 4\
**Last updated:** [October 18, 2021, 10:33pm UTC](https://discuss.elastic.co/t/cant-connect-to-elasticsearch-from-python-api-in-docker-compose-setup/287031 "2021-10-18T22:33:36Z")

</div>

Here is how I create the ES container in Docker-Compose: db: image: docker.elastic.co/elasticsearch/elasticsearch:7.15.1 restart: always ports: - 9200:9200 - 9300:9300 ulimits: memlock:…

---

## [Elasticsearch s3 plugin error "repository\_verification\_exception"](https://discuss.elastic.co/t/elasticsearch-s3-plugin-error-repository-verification-exception/286781)

<div class="topic-metadata">

**Author:** [@Mark\_Laff](https://discuss.elastic.co/u/Mark_Laff)\
**Replies:** 10\
**Last updated:** [October 18, 2021, 8:24pm UTC](https://discuss.elastic.co/t/elasticsearch-s3-plugin-error-repository-verification-exception/286781 "2021-10-18T20:24:17Z")

</div>

I'm running ES 6.8 locally (on Mac OS X installed via Homebrew) $ curl -sS -XGET 127.0.0.1:9200 { "name" : "JdRGfj8", "cluster\_name" : "elasticsearch\_brew", "cluster\_uuid" : "PahjUQpJTpy40myvs-sKMg", "version" :…

---

## [Cardinality of 1 vs. 0](https://discuss.elastic.co/t/cardinality-of-1-vs-0/287010)

<div class="topic-metadata">

**Author:** [@wolfhoundjesse](https://discuss.elastic.co/u/wolfhoundjesse)\
**Replies:** 1\
**Last updated:** [October 18, 2021, 3:17pm UTC](https://discuss.elastic.co/t/cardinality-of-1-vs-0/287010 "2021-10-18T15:17:51Z")

</div>

I'm curious, if cardinality returns the count of distinct values, what does 0 mean? If there are two distinct values, you get 2. If they're all the same, you get 1. My best guess is that a zero means there was nothing to…

---

## [Regex query in 7.13.4](https://discuss.elastic.co/t/regex-query-in-7-13-4/286884)

<div class="topic-metadata">

**Author:** [@junhuangli](https://discuss.elastic.co/u/junhuangli)\
**Replies:** 1\
**Last updated:** [October 18, 2021, 2:24pm UTC](https://discuss.elastic.co/t/regex-query-in-7-13-4/286884 "2021-10-18T14:24:57Z")

</div>

After upgrading Elasticsearch from 6.6.2 to 7.13.4, we found the regex query is much slower(10 times slower). We are doing a pretty expensive regex search like ".(\["\]fieldName\["\]:\["\]my-value-\[A-Za-z\]\[A-Za-z\]\[A-Za-z0-9\]\[…

---

## [Best practices to handle jdbc (Postgresql) contents?](https://discuss.elastic.co/t/best-practices-to-handle-jdbc-postgresql-contents/286506)

<div class="topic-metadata">

**Author:** [@lucien.guillermin](https://discuss.elastic.co/u/lucien.guillermin)\
**Replies:** 6\
**Last updated:** [October 18, 2021, 2:24pm UTC](https://discuss.elastic.co/t/best-practices-to-handle-jdbc-postgresql-contents/286506 "2021-10-18T14:24:46Z")

</div>

Hello Everyone, I have a beginner question regarding a context in which we have to index a PostgreSQL database with Elastic. Is it required to use an intermediary solution between PostgreSQL and Elastic ? If so what ar…

---

## [Why is 7.15 not available in docker hub yet?](https://discuss.elastic.co/t/why-is-7-15-not-available-in-docker-hub-yet/286930)

<div class="topic-metadata">

**Author:** [@blueren](https://discuss.elastic.co/u/blueren)\
**Replies:** 6\
**Last updated:** [October 18, 2021, 12:53pm UTC](https://discuss.elastic.co/t/why-is-7-15-not-available-in-docker-hub-yet/286930 "2021-10-18T12:53:08Z")

</div>

Why is 7.15 of Elasticsearch / kibana not available in dockerhub yet? When is it likely to be made available? At the moment, I only see 7.14.2 as the latest available tag. https://hub.docker.com/\_/elasticsearch

---

## [How to get score aggregations on the scores after rescore phase?](https://discuss.elastic.co/t/how-to-get-score-aggregations-on-the-scores-after-rescore-phase/286984)

<div class="topic-metadata">

**Author:** [@Igor\_L](https://discuss.elastic.co/u/Igor_L)\
**Replies:** 0\
**Last updated:** [October 18, 2021, 11:32am UTC](https://discuss.elastic.co/t/how-to-get-score-aggregations-on-the-scores-after-rescore-phase/286984 "2021-10-18T11:32:53Z")

</div>

org/Elasticsearch/search/query/QueryPhase.java: // Pre-process aggregations as late as possible. In the case of a DFS\_Q\_T\_F // request, preProcess is called on the DFS phase phase, this is why we pre-process them // her…

---

## [Elastic watcher webhook - lack of retry mechanism](https://discuss.elastic.co/t/elastic-watcher-webhook-lack-of-retry-mechanism/286973)

<div class="topic-metadata">

**Author:** [@hcdmonitor](https://discuss.elastic.co/u/hcdmonitor)\
**Replies:** 0\
**Last updated:** [October 18, 2021, 10:27am UTC](https://discuss.elastic.co/t/elastic-watcher-webhook-lack-of-retry-mechanism/286973 "2021-10-18T10:27:36Z")

</div>

We use Elastic watcher webhook actions to post event information to an external system using an API. This works fine most of the time but there are occasions when the action fails, seemingly due to the endpoint not respo…

---

## [ILM shards to be allocated to nodes matching the given filters](https://discuss.elastic.co/t/ilm-shards-to-be-allocated-to-nodes-matching-the-given-filters/286699)

<div class="topic-metadata">

**Author:** [@lisiyu](https://discuss.elastic.co/u/lisiyu)\
**Replies:** 3\
**Last updated:** [October 18, 2021, 9:55am UTC](https://discuss.elastic.co/t/ilm-shards-to-be-allocated-to-nodes-matching-the-given-filters/286699 "2021-10-18T09:55:18Z")

</div>

I setting 3 data nodes: one hot;one warm;one cold. The elasticsearch.yaml ： node.master: false node.data: true node.ingest: true node.attr.box\_type: hot The ILM is : PUT \_ilm/policy/k8s-logs { "policy":{ "…

---

## [Job for elasticsearch.service failed](https://discuss.elastic.co/t/job-for-elasticsearch-service-failed/286934)

<div class="topic-metadata">

**Author:** [@dun7ill](https://discuss.elastic.co/u/dun7ill)\
**Replies:** 2\
**Last updated:** [October 18, 2021, 9:48am UTC](https://discuss.elastic.co/t/job-for-elasticsearch-service-failed/286934 "2021-10-18T09:48:41Z")

</div>

Hi All, I've installed Elasticsearch 7 on CentOS 7, I faced a problem when I try to start it. Sometimes it's work fine, then it's failed ! Please find the following code ; ● elasticsearch.service - Elasticsearch L…

---

## [How can I force search to look into fields that marked as \_Ignored](https://discuss.elastic.co/t/how-can-i-force-search-to-look-into-fields-that-marked-as-ignored/286915)

<div class="topic-metadata">

**Author:** [@ShayWeizman](https://discuss.elastic.co/u/ShayWeizman)\
**Replies:** 2\
**Last updated:** [October 18, 2021, 9:24am UTC](https://discuss.elastic.co/t/how-can-i-force-search-to-look-into-fields-that-marked-as-ignored/286915 "2021-10-18T09:24:07Z")

</div>

Hi All, I'm using 7.15, I'm saving some logs of failed tests, the log contain the test failed reason which I save in fields called: "testcaseFailedReason" I've noticed that I don't get values from this field in visua…

---

## [Depending on the restart of the index server, there are cases in which the search is different. Why?](https://discuss.elastic.co/t/depending-on-the-restart-of-the-index-server-there-are-cases-in-which-the-search-is-different-why/286792)

<div class="topic-metadata">

**Author:** [@jeongin](https://discuss.elastic.co/u/jeongin)\
**Replies:** 7\
**Last updated:** [October 18, 2021, 8:37am UTC](https://discuss.elastic.co/t/depending-on-the-restart-of-the-index-server-there-are-cases-in-which-the-search-is-different-why/286792 "2021-10-18T08:37:22Z")

</div>

We have a separate boxtype index server. Two cases will be described. First Restart. Perform an index. Check the term with '\_termvectors' api. Term 'xxxx' exists. Check the term with '\_explain' api. Receive 'no match…

---

## [Does this feature really work as the description? https://github.com/elastic/elasticsearch/pull/59394](https://discuss.elastic.co/t/does-this-feature-really-work-as-the-description-https-github-com-elastic-elasticsearch-pull-59394/286957)

<div class="topic-metadata">

**Author:** [@GrandFisher](https://discuss.elastic.co/u/GrandFisher)\
**Replies:** 3\
**Last updated:** [October 18, 2021, 7:00am UTC](https://discuss.elastic.co/t/does-this-feature-really-work-as-the-description-https-github-com-elastic-elasticsearch-pull-59394/286957 "2021-10-18T07:00:16Z")

</div>

Does anyone really observe this feature in the log? We never found this log in our log file.（total circuit breaker has thrown at least an CircuitBreakingException） logger.info("attempting to trigger G1GC due to high he…

---

## [Setup repository on cluster across two servers](https://discuss.elastic.co/t/setup-repository-on-cluster-across-two-servers/286945)

<div class="topic-metadata">

**Author:** [@alfianaf](https://discuss.elastic.co/u/alfianaf)\
**Replies:** 4\
**Last updated:** [October 18, 2021, 5:15am UTC](https://discuss.elastic.co/t/setup-repository-on-cluster-across-two-servers/286945 "2021-10-18T05:15:52Z")

</div>

Hello, I have a cluster set up on two servers, Node master and coordination on IP 10.10.10.1. Node data on IP 10.10.10.2. I want to set up repository on my cluster, here is my question How I can declare my path.repo…

---

## [Delete all data streams when delete index through data stream API](https://discuss.elastic.co/t/delete-all-data-streams-when-delete-index-through-data-stream-api/286804)

<div class="topic-metadata">

**Author:** [@d4nnyx](https://discuss.elastic.co/u/d4nnyx)\
**Replies:** 4\
**Last updated:** [October 18, 2021, 5:06am UTC](https://discuss.elastic.co/t/delete-all-data-streams-when-delete-index-through-data-stream-api/286804 "2021-10-18T05:06:06Z")

</div>

I have index "test-index", and other data streams but "test index" data stream. When I try to delete this "test-index" index through data stream API (and "test-index" data stream does not exist), I get "acknowledge: tru…

---

## [How can I build a claster from two independent Elastic Servers?](https://discuss.elastic.co/t/how-can-i-build-a-claster-from-two-independent-elastic-servers/286798)

<div class="topic-metadata">

**Author:** [@marti1](https://discuss.elastic.co/u/marti1)\
**Replies:** 2\
**Last updated:** [October 18, 2021, 4:33am UTC](https://discuss.elastic.co/t/how-can-i-build-a-claster-from-two-independent-elastic-servers/286798 "2021-10-18T04:33:37Z")

</div>

Hi, I have two independent Elastic Servers in my business. I know the steeps I have to do to set up the cluster, the question is what will happens with the data of both servers when I create the cluster? Will I lose i…

---

## [Update elasticsearch index mapping through script or curl command](https://discuss.elastic.co/t/update-elasticsearch-index-mapping-through-script-or-curl-command/286905)

<div class="topic-metadata">

**Author:** [@prataprajasekhar](https://discuss.elastic.co/u/prataprajasekhar)\
**Replies:** 8\
**Last updated:** [October 18, 2021, 4:30am UTC](https://discuss.elastic.co/t/update-elasticsearch-index-mapping-through-script-or-curl-command/286905 "2021-10-18T04:30:40Z")

</div>

Dear Team, We are trying to update an index using below method in kibana dev console. Can you please let me know the method to be followed either using curl method or wget method or via a python or shell script to upda…

---

## [Checking query efficiency tool](https://discuss.elastic.co/t/checking-query-efficiency-tool/286944)

<div class="topic-metadata">

**Author:** [@eylon\_koren](https://discuss.elastic.co/u/eylon_koren)\
**Replies:** 1\
**Last updated:** [October 18, 2021, 4:12am UTC](https://discuss.elastic.co/t/checking-query-efficiency-tool/286944 "2021-10-18T04:12:58Z")

</div>

Hi! I am providing accessibility to search on ES for our customers. Some of them are creating inefficient queries, which uses wildcard at the start of a sentence or without any field specified. I would like to find th…

---

## [Else conditional in ingest pipeline](https://discuss.elastic.co/t/else-conditional-in-ingest-pipeline/286697)

<div class="topic-metadata">

**Author:** [@alfianaf](https://discuss.elastic.co/u/alfianaf)\
**Replies:** 9\
**Last updated:** [October 18, 2021, 3:55am UTC](https://discuss.elastic.co/t/else-conditional-in-ingest-pipeline/286697 "2021-10-18T03:55:58Z")

</div>

Hello, I want to make else conditional on my ingest pipeline, here's pipeline I've made: PUT \_ingest/pipeline/pipeline-test { "processors": \[ { "pipeline":{ "description": "check field1 to output to …

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=555)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=557)
