# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=548

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 549

---

## [How does Elasticsearch search on multiple fields in the same query?](https://discuss.elastic.co/t/how-does-elasticsearch-search-on-multiple-fields-in-the-same-query/288272)

<div class="topic-metadata">

**Author:** [@Alexical](https://discuss.elastic.co/u/Alexical)\
**Replies:** 2\
**Last updated:** [November 3, 2021, 8:06am UTC](https://discuss.elastic.co/t/how-does-elasticsearch-search-on-multiple-fields-in-the-same-query/288272 "2021-11-03T08:06:03Z")

</div>

Hey, I have a decent enough idea of how various indexes work in SQL, how multicolumn index data structures are laid out, and how Postgres can use multiple different indexes by using each individually then doing bitmap op…

---

## [Thread Pool Management](https://discuss.elastic.co/t/thread-pool-management/288275)

<div class="topic-metadata">

**Author:** [@tsousahs](https://discuss.elastic.co/u/tsousahs)\
**Replies:** 0\
**Last updated:** [November 3, 2021, 12:33am UTC](https://discuss.elastic.co/t/thread-pool-management/288275 "2021-11-03T00:33:34Z")

</div>

Hello, We are seeing a lot of CPU processing without much indexing activity. I have run the following command to see the hot thread: GET \_nodes/hot\_threads which i got the following output. 100.5% (502.6ms out of 500…

---

## [Couldn't login to Kibana URL](https://discuss.elastic.co/t/couldnt-login-to-kibana-url/288217)

<div class="topic-metadata">

**Author:** [@orelevi](https://discuss.elastic.co/u/orelevi)\
**Replies:** 4\
**Last updated:** [November 2, 2021, 9:17pm UTC](https://discuss.elastic.co/t/couldnt-login-to-kibana-url/288217 "2021-11-02T21:17:38Z")

</div>

I know it's not the best practice but i want to check something, so i manually created opensearch service at AWS and i can't connect through the kibana url (timeout error) i really don't understand why, my security group…

---

## [ILM policies - fails to move to cold node](https://discuss.elastic.co/t/ilm-policies-fails-to-move-to-cold-node/288252)

<div class="topic-metadata">

**Author:** [@Callahan](https://discuss.elastic.co/u/Callahan)\
**Replies:** 0\
**Last updated:** [November 2, 2021, 5:34pm UTC](https://discuss.elastic.co/t/ilm-policies-fails-to-move-to-cold-node/288252 "2021-11-02T17:34:10Z")

</div>

We have a slightly old Elastic stack that I built over 2+ years ago. It ran into some issues a week or so ago and one of the team took a bit of a sledge hammer to the indices to fix it. It's now back up and running but I…

---

## [ELK certificates update](https://discuss.elastic.co/t/elk-certificates-update/288211)

<div class="topic-metadata">

**Author:** [@rodri.gz](https://discuss.elastic.co/u/rodri.gz)\
**Replies:** 1\
**Last updated:** [November 2, 2021, 9:13pm UTC](https://discuss.elastic.co/t/elk-certificates-update/288211 "2021-11-02T21:13:10Z")

</div>

Hello ! I have my cluster secured and several agents connecting to elastic via https with .pem certificates. When these certificates expire should I update all the certificates of all my agents in all my nodes? thanks…

---

## [Elasticsearch inaccurate shard state when timed\_out is true](https://discuss.elastic.co/t/elasticsearch-inaccurate-shard-state-when-timed-out-is-true/285513)

<div class="topic-metadata">

**Author:** [@niketpatel2525](https://discuss.elastic.co/u/niketpatel2525)\
**Replies:** 14\
**Last updated:** [November 2, 2021, 5:28pm UTC](https://discuss.elastic.co/t/elasticsearch-inaccurate-shard-state-when-timed-out-is-true/285513 "2021-11-02T17:28:09Z")

</div>

Hey there, I have an index with 40 shards and I use the timeout feature with my search query. As per the documentation, if request timeout before it completes search on all shards, it will return whatever the results ot…

---

## [Expand Elasticsearch cluster v6 help](https://discuss.elastic.co/t/expand-elasticsearch-cluster-v6-help/288220)

<div class="topic-metadata">

**Author:** [@Ain\_Ryushika](https://discuss.elastic.co/u/Ain_Ryushika)\
**Replies:** 3\
**Last updated:** [November 2, 2021, 4:11pm UTC](https://discuss.elastic.co/t/expand-elasticsearch-cluster-v6-help/288220 "2021-11-02T16:11:37Z")

</div>

Elasticsearch version 6.8.17, all nodes are data and master nodes. Hello, I have a need to expand current Elasticsearch cluster from 3 to 6 nodes. I have a question regarding parameter "discovery.zen.minimum\_master\_no…

---

## [Import bash output in Kibana, it's possible?](https://discuss.elastic.co/t/import-bash-output-in-kibana-its-possible/288225)

<div class="topic-metadata">

**Author:** [@pi314](https://discuss.elastic.co/u/pi314)\
**Replies:** 2\
**Last updated:** [November 2, 2021, 12:58pm UTC](https://discuss.elastic.co/t/import-bash-output-in-kibana-its-possible/288225 "2021-11-02T12:58:23Z")

</div>

Hello everyone, can I import the output of a bash script into a kibana dashboard? I have created the following script to search email sending in postfix but I want to put together something visually more attractive. He…

---

## [Include empty nested fields in aggregation](https://discuss.elastic.co/t/include-empty-nested-fields-in-aggregation/288003)

<div class="topic-metadata">

**Author:** [@Calin\_Blaga](https://discuss.elastic.co/u/Calin_Blaga)\
**Replies:** 2\
**Last updated:** [November 2, 2021, 11:37am UTC](https://discuss.elastic.co/t/include-empty-nested-fields-in-aggregation/288003 "2021-11-02T11:37:40Z")

</div>

I would like to do an aggregation on a nested field, and I would like to include empty occurrences too. What I tried: GET index/\_search { "size": 0, "aggs": { "language\_skills": { "nested": { "pat…

---

## [Fleet Pipeline does not exist - Data Streams not getting data](https://discuss.elastic.co/t/fleet-pipeline-does-not-exist-data-streams-not-getting-data/285877)

<div class="topic-metadata">

**Author:** [@Heroj04](https://discuss.elastic.co/u/Heroj04)\
**Replies:** 21\
**Last updated:** [November 2, 2021, 11:29am UTC](https://discuss.elastic.co/t/fleet-pipeline-does-not-exist-data-streams-not-getting-data/285877 "2021-11-02T11:29:46Z")

</div>

I have elastic setup and working using regular beats fine. I have since setup fleet and trying to add servers using that. however I am seeing a bunch of errors about pipelines not existing, only for certain items. See an…

---

## [Add nodes to the cluster on the fly](https://discuss.elastic.co/t/add-nodes-to-the-cluster-on-the-fly/287666)

<div class="topic-metadata">

**Author:** [@Ain\_Ryushika](https://discuss.elastic.co/u/Ain_Ryushika)\
**Replies:** 5\
**Last updated:** [November 2, 2021, 11:13am UTC](https://discuss.elastic.co/t/add-nodes-to-the-cluster-on-the-fly/287666 "2021-11-02T11:13:50Z")

</div>

Hello, I have a task to add 2 more nodes in a cluster. Currently we have 5 nodes in a cluster which are all data nodes. Elastic version 7.11.2. Current discovery parameters set for cluster: "discovery.zen.ping.unicast.…

---

## [Can CCR also replicate dashboards (and other stuff...)?](https://discuss.elastic.co/t/can-ccr-also-replicate-dashboards-and-other-stuff/287415)

<div class="topic-metadata">

**Author:** [@bertr](https://discuss.elastic.co/u/bertr)\
**Replies:** 1\
**Last updated:** [November 2, 2021, 11:00am UTC](https://discuss.elastic.co/t/can-ccr-also-replicate-dashboards-and-other-stuff/287415 "2021-11-02T11:00:18Z")

</div>

CCR is great to replicate data in user indices (such as all beats indices), but I don't know if it can also be used to replicate kibana dashboards. Rationale : it's a bummer if you need to fail over and you have your da…

---

## [Purpose of @timestamp field in data stream](https://discuss.elastic.co/t/purpose-of-timestamp-field-in-data-stream/288183)

<div class="topic-metadata">

**Author:** [@rhsp](https://discuss.elastic.co/u/rhsp)\
**Replies:** 4\
**Last updated:** [November 2, 2021, 5:56am UTC](https://discuss.elastic.co/t/purpose-of-timestamp-field-in-data-stream/288183 "2021-11-02T05:56:52Z")

</div>

I am confused by the need for the mandatory @timestamp as it does not seem to be used in any part of the data stream. The date on the index is based on creation date instead of the @timestamp field. Rollover also seem to…

---

## [Help with note.roles](https://discuss.elastic.co/t/help-with-note-roles/288149)

<div class="topic-metadata">

**Author:** [@b0r1s](https://discuss.elastic.co/u/b0r1s)\
**Replies:** 2\
**Last updated:** [November 1, 2021, 10:57pm UTC](https://discuss.elastic.co/t/help-with-note-roles/288149 "2021-11-01T22:57:09Z")

</div>

Hey everyone o/ I was working with 3 nodes in my cluster. Now I added a 4th node, to be the cold node. Some indices that should be on it (according to ILM) are still not going. I'm trying to configure node.roles on the…

---

## [Support needed (Install Issues)](https://discuss.elastic.co/t/support-needed-install-issues/288151)

<div class="topic-metadata">

**Author:** [@Hondo](https://discuss.elastic.co/u/Hondo)\
**Replies:** 3\
**Last updated:** [November 1, 2021, 10:55pm UTC](https://discuss.elastic.co/t/support-needed-install-issues/288151 "2021-11-01T22:55:00Z")

</div>

Hello, our webhoster have issius to install "Elasticsearch" on our ded. Rootserver with Almalinnux 8.4.0 He\`s write Blockquote Regarding the Elasticsearch application issue, it seems that you may need to further che…

---

## [Help with slow query/indexing time on big index](https://discuss.elastic.co/t/help-with-slow-query-indexing-time-on-big-index/286583)

<div class="topic-metadata">

**Author:** [@Ain\_Ryushika](https://discuss.elastic.co/u/Ain_Ryushika)\
**Replies:** 7\
**Last updated:** [November 1, 2021, 9:47pm UTC](https://discuss.elastic.co/t/help-with-slow-query-indexing-time-on-big-index/286583 "2021-11-01T21:47:31Z")

</div>

System Specifications Elasticsearch: 3 data nodes, 200 primary shards, 406 total shards CPU model: Intel(R) Xeon(R) Gold 6248 CPU @ 2.50GHz CPU total logical cores: 8 Memory : 32GB (16gb heap) Client have an index 9…

---

## [How to create outlier jobs with data fields coming from multiple sources (log1,log2, metricbeat1, etc....)](https://discuss.elastic.co/t/how-to-create-outlier-jobs-with-data-fields-coming-from-multiple-sources-log1-log2-metricbeat1-etc/288016)

<div class="topic-metadata">

**Author:** [@Indigo\_Star](https://discuss.elastic.co/u/Indigo_Star)\
**Replies:** 1\
**Last updated:** [November 1, 2021, 9:07pm UTC](https://discuss.elastic.co/t/how-to-create-outlier-jobs-with-data-fields-coming-from-multiple-sources-log1-log2-metricbeat1-etc/288016 "2021-11-01T21:07:24Z")

</div>

Hi everyone, Let me elaborate what i want and why i want that then may be it would be easier to find a best solution. I am new to ML jobs, I've created Single metric jobs and also have explored Multi-metric ML jobs a l…

---

## [Sorting by named query result](https://discuss.elastic.co/t/sorting-by-named-query-result/288168)

<div class="topic-metadata">

**Author:** [@NLSVTN](https://discuss.elastic.co/u/NLSVTN)\
**Replies:** 0\
**Last updated:** [November 1, 2021, 6:36pm UTC](https://discuss.elastic.co/t/sorting-by-named-query-result/288168 "2021-11-01T18:36:33Z")

</div>

Is it possible to sort the results of the ES query by the value present in the named query? We have such code in Elasticsearch-dsl: def \_named\_family\_sample\_q(family\_samples\_q, family\_guid, quality\_filters\_by\_family): …

---

## [7.15.1 is extremely slow](https://discuss.elastic.co/t/7-15-1-is-extremely-slow/287617)

<div class="topic-metadata">

**Author:** [@elasticforme](https://discuss.elastic.co/u/elasticforme)\
**Replies:** 10\
**Last updated:** [November 1, 2021, 5:25pm UTC](https://discuss.elastic.co/t/7-15-1-is-extremely-slow/287617 "2021-11-01T17:25:50Z")

</div>

whom ever it may concern something is wrong with 7.15.1 loading kibana dashboard is extremely slow same hardware works loading same data same dashboard in 7.12 only 14 second. 7.15.1 it takes 2 min. everything is same …

---

## [Search #/@'s on ElasticSearch](https://discuss.elastic.co/t/search-s-on-elasticsearch/288157)

<div class="topic-metadata">

**Author:** [@Joran](https://discuss.elastic.co/u/Joran)\
**Replies:** 0\
**Last updated:** [November 1, 2021, 3:51pm UTC](https://discuss.elastic.co/t/search-s-on-elasticsearch/288157 "2021-11-01T15:51:45Z")

</div>

Hi, We attempted to index @/#'s on our Elasticsearch, so we could search for example "#bitcoin". See here our settings for our Index "users" (some settings I replaced with "PRIVATE"): "users": { "settings": { "index"…

---

## [How to add the name of Ingest node that processed the pipeline to special field](https://discuss.elastic.co/t/how-to-add-the-name-of-ingest-node-that-processed-the-pipeline-to-special-field/288091)

<div class="topic-metadata">

**Author:** [@Ayd\_Asraf](https://discuss.elastic.co/u/Ayd_Asraf)\
**Replies:** 3\
**Last updated:** [November 1, 2021, 3:36pm UTC](https://discuss.elastic.co/t/how-to-add-the-name-of-ingest-node-that-processed-the-pipeline-to-special-field/288091 "2021-11-01T15:36:00Z")

</div>

Hello, I am trying to get the ingest node name that ran the pipeline which produced the output final document and append it to the document by setting the value of a special extra field "ingested\_on" that was created fo…

---

## [Shard creation when using index pattern](https://discuss.elastic.co/t/shard-creation-when-using-index-pattern/288099)

<div class="topic-metadata">

**Author:** [@shi](https://discuss.elastic.co/u/shi)\
**Replies:** 3\
**Last updated:** [November 1, 2021, 3:11pm UTC](https://discuss.elastic.co/t/shard-creation-when-using-index-pattern/288099 "2021-11-01T15:11:55Z")

</div>

How are shards created/allocated when we are using an index pattern such that each day's log is written to a separate index (eg my\_index\_emailf\_log-\* , my\_index\_emailf\_log-dd-mm-yyyy .) Suppose we have specified 1 pri…

---

## [Read XEL file and send to elasticsearch](https://discuss.elastic.co/t/read-xel-file-and-send-to-elasticsearch/288109)

<div class="topic-metadata">

**Author:** [@sahere37](https://discuss.elastic.co/u/sahere37)\
**Replies:** 4\
**Last updated:** [November 1, 2021, 9:12am UTC](https://discuss.elastic.co/t/read-xel-file-and-send-to-elasticsearch/288109 "2021-11-01T09:12:14Z")

</div>

Hi all, I have some xel files which are a SQL server output. Is there any way to read these files and index them in Elasticsearch. Can beats or logstash read these files? Any help will be so appreciated. Regards

---

## [Waht are the possible datatypes of fileds of an index like keyword, ip , date nanos etc](https://discuss.elastic.co/t/waht-are-the-possible-datatypes-of-fileds-of-an-index-like-keyword-ip-date-nanos-etc/287891)

<div class="topic-metadata">

**Author:** [@shi](https://discuss.elastic.co/u/shi)\
**Replies:** 8\
**Last updated:** [November 1, 2021, 9:11am UTC](https://discuss.elastic.co/t/waht-are-the-possible-datatypes-of-fileds-of-an-index-like-keyword-ip-date-nanos-etc/287891 "2021-11-01T09:11:01Z")

</div>

Waht are the possible datatypes of fileds of an index like keyword, ip , date nanos, etc? guess if field type is keyword then it is is stored in docvalues so we can sort on it? regards shini

---

## [Find word count in text field](https://discuss.elastic.co/t/find-word-count-in-text-field/288120)

<div class="topic-metadata">

**Author:** [@sanjaye218](https://discuss.elastic.co/u/sanjaye218)\
**Replies:** 0\
**Last updated:** [November 1, 2021, 8:44am UTC](https://discuss.elastic.co/t/find-word-count-in-text-field/288120 "2021-11-01T08:44:28Z")

</div>

Hi, I am trying to get top 10 words along with word count in text field in multiple documents based on certain filter criteria. I can see termvector but its giving results per document. e.g. document 1 contains comment…

---

## [Index 128 out of bounds for length 128](https://discuss.elastic.co/t/index-128-out-of-bounds-for-length-128/287971)

<div class="topic-metadata">

**Author:** [@shreyanshes103](https://discuss.elastic.co/u/shreyanshes103)\
**Replies:** 1\
**Last updated:** [November 1, 2021, 8:02am UTC](https://discuss.elastic.co/t/index-128-out-of-bounds-for-length-128/287971 "2021-11-01T08:02:11Z")

</div>

Hi All ,getting error like this..."caused\_by" : { "type" : "array\_index\_out\_of\_bounds\_exception", "reason" : "Index 128 out of bounds for length 128", "caused\_by" : { "type" : "array\_index\_out\_of\_bounds\_exception", …

---

## [ILM Questions - ILM lifecycle policy defaults on upgrade and applying a policy to existing/old indices](https://discuss.elastic.co/t/ilm-questions-ilm-lifecycle-policy-defaults-on-upgrade-and-applying-a-policy-to-existing-old-indices/288115)

<div class="topic-metadata">

**Author:** [@neil6323](https://discuss.elastic.co/u/neil6323)\
**Replies:** 0\
**Last updated:** [November 1, 2021, 7:04am UTC](https://discuss.elastic.co/t/ilm-questions-ilm-lifecycle-policy-defaults-on-upgrade-and-applying-a-policy-to-existing-old-indices/288115 "2021-11-01T07:04:49Z")

</div>

I have a couple of questions about the management of ILM based on legacy index templates. Previously I have created a number of new index lifecycle policies with custom config for each of the beats being used. These p…

---

## [How can I get the count of all indices?](https://discuss.elastic.co/t/how-can-i-get-the-count-of-all-indices/288047)

<div class="topic-metadata">

**Author:** [@buaaytt](https://discuss.elastic.co/u/buaaytt)\
**Replies:** 7\
**Last updated:** [November 1, 2021, 6:08am UTC](https://discuss.elastic.co/t/how-can-i-get-the-count-of-all-indices/288047 "2021-11-01T06:08:39Z")

</div>

And is there a way to configure whether to include the default system indices, whose names start with a dot?

---

## [Query Prefix Numbers and Dates](https://discuss.elastic.co/t/query-prefix-numbers-and-dates/288044)

<div class="topic-metadata">

**Author:** [@elipongr](https://discuss.elastic.co/u/elipongr)\
**Replies:** 1\
**Last updated:** [November 1, 2021, 4:27am UTC](https://discuss.elastic.co/t/query-prefix-numbers-and-dates/288044 "2021-11-01T04:27:09Z")

</div>

So hey i am working with customer where we use flowable which has query models where we can write ES Querys. In our case we need to search for all elemets in array which have the numberValue idk lets say 222. However i…

---

## [Minimize elastic search write operations in storage account](https://discuss.elastic.co/t/minimize-elastic-search-write-operations-in-storage-account/288024)

<div class="topic-metadata">

**Author:** [@pindropviolence](https://discuss.elastic.co/u/pindropviolence)\
**Replies:** 1\
**Last updated:** [November 1, 2021, 4:26am UTC](https://discuss.elastic.co/t/minimize-elastic-search-write-operations-in-storage-account/288024 "2021-11-01T04:26:23Z")

</div>

Hi , I have set up Elastic Stack with beats and i have been able to monitor the logs without any issues. AZ logs getting streamed via event hubs , beats from multiple subscriptions. Have set up curator jobs to delete …

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=547)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=549)
