# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=714

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 715

---

## [Node crash is happening ES 6.8](https://discuss.elastic.co/t/node-crash-is-happening-es-6-8/262791)

<div class="topic-metadata">

**Author:** [@nk1506](https://discuss.elastic.co/u/nk1506)\
**Replies:** 2\
**Last updated:** [February 1, 2021, 9:51am UTC](https://discuss.elastic.co/t/node-crash-is-happening-es-6-8/262791 "2021-02-01T09:51:41Z")

</div>

Because of some bad query GC clean up is happening more frequently and node is getting crashed after sometime. Is there any way to know which query is causing the issues? Or how to prevent node is going down? I read ab…

---

## [Recover shards from different version](https://discuss.elastic.co/t/recover-shards-from-different-version/262766)

<div class="topic-metadata">

**Author:** [@carmine.fabrizio](https://discuss.elastic.co/u/carmine.fabrizio)\
**Replies:** 2\
**Last updated:** [February 1, 2021, 9:16am UTC](https://discuss.elastic.co/t/recover-shards-from-different-version/262766 "2021-02-01T09:16:55Z")

</div>

Hi there, I have a cluster of 25 nodes with HOT/WARM/COLD phases in place, the cluster is running on version 7.5.1 and by mistake one of the hot nodes was running on a different version 7.8.1, and ingesting data, I not…

---

## [Best infrastructure for elasticsearch](https://discuss.elastic.co/t/best-infrastructure-for-elasticsearch/262737)

<div class="topic-metadata">

**Author:** [@iammanmale](https://discuss.elastic.co/u/iammanmale)\
**Replies:** 3\
**Last updated:** [February 1, 2021, 9:01am UTC](https://discuss.elastic.co/t/best-infrastructure-for-elasticsearch/262737 "2021-02-01T09:01:11Z")

</div>

We have 7 ES node + 2 logstash server to collect log from AWS machines around the world by filebeat. Those ES and logstash nodes are just desktop PC at the moment. We want to put them into a more reliable infrastructure. …

---

## [Java Scroll Api with aggregation](https://discuss.elastic.co/t/java-scroll-api-with-aggregation/262798)

<div class="topic-metadata">

**Author:** [@vands](https://discuss.elastic.co/u/vands)\
**Replies:** 0\
**Last updated:** [February 1, 2021, 8:27am UTC](https://discuss.elastic.co/t/java-scroll-api-with-aggregation/262798 "2021-02-01T08:27:46Z")

</div>

Hi All , I am using Java scroll API to fetch data from an index . Is it possible to use CompositeAggregationBuilder along with scroll api and get aggregation resultset in batches of 10000 from elastic . If so , please h…

---

## [Elasticsearch master and client service/pod not coming up](https://discuss.elastic.co/t/elasticsearch-master-and-client-service-pod-not-coming-up/262788)

<div class="topic-metadata">

**Author:** [@Munieswaran](https://discuss.elastic.co/u/Munieswaran)\
**Replies:** 1\
**Last updated:** [February 1, 2021, 8:07am UTC](https://discuss.elastic.co/t/elasticsearch-master-and-client-service-pod-not-coming-up/262788 "2021-02-01T08:07:00Z")

</div>

I'm running Elasticsearch cluster in openshift environment, where i recently patched and rebooted the underlaying nodes, after reboot master and client pods are not coming up and error seems to be related to mount, but d…

---

## [Ingest node cloning](https://discuss.elastic.co/t/ingest-node-cloning/262485)

<div class="topic-metadata">

**Author:** [@NickGearls](https://discuss.elastic.co/u/NickGearls)\
**Replies:** 3\
**Last updated:** [February 1, 2021, 7:35am UTC](https://discuss.elastic.co/t/ingest-node-cloning/262485 "2021-02-01T07:35:33Z")

</div>

There is no "clone" feature in ingest nodes as in LogStash. Is it possible to implement this feature with a plugin? I want to use the cloud version, so I don't want to install my own LogStash server for this cloning (a…

---

## [Index Roller Policy not working](https://discuss.elastic.co/t/index-roller-policy-not-working/262553)

<div class="topic-metadata">

**Author:** [@sureshdpawar](https://discuss.elastic.co/u/sureshdpawar)\
**Replies:** 2\
**Last updated:** [February 1, 2021, 4:39am UTC](https://discuss.elastic.co/t/index-roller-policy-not-working/262553 "2021-02-01T04:39:57Z")

</div>

I am referring to above document to automate rollover with ILM. I am doing it without data streams and by using an ILM index alias, I created a lifecycle policy as named as timeseires\_policy with below setting { …

---

## [How i can get timestamp?](https://discuss.elastic.co/t/how-i-can-get-timestamp/262777)

<div class="topic-metadata">

**Author:** [@Ricky\_Alamsyah](https://discuss.elastic.co/u/Ricky_Alamsyah)\
**Replies:** 1\
**Last updated:** [February 1, 2021, 3:27am UTC](https://discuss.elastic.co/t/how-i-can-get-timestamp/262777 "2021-02-01T03:27:05Z")

</div>

how i can get range timestamp with format epoch\_millis ? "mappings": { "properties": { "@timestamp": { "type": "date" }, i try this but not working { "query":{ "bool": { "must": \[{ "match\_all": {} }\], "filter…

---

## [Dynamically assign filter, char\_filter, analyzer?](https://discuss.elastic.co/t/dynamically-assign-filter-char-filter-analyzer/262774)

<div class="topic-metadata">

**Author:** [@adude946](https://discuss.elastic.co/u/adude946)\
**Replies:** 4\
**Last updated:** [February 1, 2021, 2:30am UTC](https://discuss.elastic.co/t/dynamically-assign-filter-char-filter-analyzer/262774 "2021-02-01T02:30:48Z")

</div>

Wanted to know if it's possible to dynamically assign filter, char\_filter & analyzer? We have multilanguage data in ES. The search is language specific which the application detects at request time. So if request is in …

---

## [Include specific fields from document using Ingest pipeline](https://discuss.elastic.co/t/include-specific-fields-from-document-using-ingest-pipeline/262734)

<div class="topic-metadata">

**Author:** [@mussa572](https://discuss.elastic.co/u/mussa572)\
**Replies:** 1\
**Last updated:** [February 1, 2021, 1:02am UTC](https://discuss.elastic.co/t/include-specific-fields-from-document-using-ingest-pipeline/262734 "2021-02-01T01:02:00Z")

</div>

Hi I am ingesting following document to elasticsearch directly . First I am only interested in wprss\_ftp\_feed\_source and its values and exclude all other fields before they are ingested into index . second after select…

---

## [Unregistered Authentication Agent for unix-process](https://discuss.elastic.co/t/unregistered-authentication-agent-for-unix-process/262716)

<div class="topic-metadata">

**Author:** [@Taufik\_Maulana](https://discuss.elastic.co/u/Taufik_Maulana)\
**Replies:** 1\
**Last updated:** [February 1, 2021, 12:45am UTC](https://discuss.elastic.co/t/unregistered-authentication-agent-for-unix-process/262716 "2021-02-01T00:45:39Z")

</div>

Hello everyone, I'm having trouble starting my elasticsearch . This is what journal -xe command's output. -- Subject: Unit elasticsearch.service has begun start-up -- Defined-By: systemd -- Support: http://lists.freed…

---

## [Conflicting Use Cases? Perf concerns?](https://discuss.elastic.co/t/conflicting-use-cases-perf-concerns/262733)

<div class="topic-metadata">

**Author:** [@brpinard](https://discuss.elastic.co/u/brpinard)\
**Replies:** 2\
**Last updated:** [January 31, 2021, 4:33pm UTC](https://discuss.elastic.co/t/conflicting-use-cases-perf-concerns/262733 "2021-01-31T16:33:06Z")

</div>

I’m looking to deliver an Elasticsearch based search experience off our event driven architecture. We have a stream of events on Kalfka. Each event represents a state change for a thing that we can call a case. There a…

---

## [Clarification on setting up TLS in an elastic cluster](https://discuss.elastic.co/t/clarification-on-setting-up-tls-in-an-elastic-cluster/262613)

<div class="topic-metadata">

**Author:** [@first100](https://discuss.elastic.co/u/first100)\
**Replies:** 0\
**Last updated:** [January 29, 2021, 8:19am UTC](https://discuss.elastic.co/t/clarification-on-setting-up-tls-in-an-elastic-cluster/262613 "2021-01-29T08:19:36Z")

</div>

Hello, im trying to set up TLS in elastic cluster, the cluster works normally without tls, communicating in http, im received from company some certificates for all node of my cluster, ca\_cert.crt, subca\_cert.crt, machi…

---

## [Slack-Alerting | JSON Body](https://discuss.elastic.co/t/slack-alerting-json-body/262677)

<div class="topic-metadata">

**Author:** [@manjesh23](https://discuss.elastic.co/u/manjesh23)\
**Replies:** 0\
**Last updated:** [January 29, 2021, 6:15pm UTC](https://discuss.elastic.co/t/slack-alerting-json-body/262677 "2021-01-29T18:15:28Z")

</div>

Hello All, I am testing Kibana to Slack feature. Where, I am receiving a alert message on Slack but no data is present in there. "actions": { "incoming-webhook": { "throttle\_period\_in\_millis": 10000, …

---

## [Reindexing doesnt work](https://discuss.elastic.co/t/reindexing-doesnt-work/262693)

<div class="topic-metadata">

**Author:** [@Deny7](https://discuss.elastic.co/u/Deny7)\
**Replies:** 1\
**Last updated:** [February 1, 2021, 12:24am UTC](https://discuss.elastic.co/t/reindexing-doesnt-work/262693 "2021-02-01T00:24:36Z")

</div>

Hi, I changed mapping to index so I wanted reindex. I have about 200 daily indicies that I want reindex. I used bellow command. When I ran it gave me 504 timeout error. When I checked GET /\_cat/indices?v there is creat…

---

## [Absolute beginner in elasticsearch](https://discuss.elastic.co/t/absolute-beginner-in-elasticsearch/262763)

<div class="topic-metadata">

**Author:** [@Werner](https://discuss.elastic.co/u/Werner)\
**Replies:** 6\
**Last updated:** [January 31, 2021, 11:36pm UTC](https://discuss.elastic.co/t/absolute-beginner-in-elasticsearch/262763 "2021-01-31T23:36:43Z")

</div>

Hallo ! :slight\_smile: I am an absolute beginner in elasticsearch and after some hours of reading and watching tutorial-videos I got the impression, that it needs a lot of knowledge and preparation, before I can make a …

---

## [Remapping an index](https://discuss.elastic.co/t/remapping-an-index/262400)

<div class="topic-metadata">

**Author:** [@DavidoffX](https://discuss.elastic.co/u/DavidoffX)\
**Replies:** 2\
**Last updated:** [January 31, 2021, 7:38pm UTC](https://discuss.elastic.co/t/remapping-an-index/262400 "2021-01-31T19:38:43Z")

</div>

I've followed is guide in an attempt to apply a new (reduced) mapping to an existing index : I realise that this is a very old blog post. The "atomic" step which is said to re-index , doesn't seem to index any documen…

---

## [Dynamic mapping setting not honoured](https://discuss.elastic.co/t/dynamic-mapping-setting-not-honoured/262551)

<div class="topic-metadata">

**Author:** [@DavidoffX](https://discuss.elastic.co/u/DavidoffX)\
**Replies:** 1\
**Last updated:** [January 31, 2021, 7:32pm UTC](https://discuss.elastic.co/t/dynamic-mapping-setting-not-honoured/262551 "2021-01-31T19:32:24Z")

</div>

If I create new index with a mapping definition eg. { "mappings": { "dynamic": "false", "properties": { ...} } } and then send data to it with fields that aren't included in the mapping, they ar…

---

## [GPG Key](https://discuss.elastic.co/t/gpg-key/261891)

<div class="topic-metadata">

**Author:** [@alipujaistopo](https://discuss.elastic.co/u/alipujaistopo)\
**Replies:** 3\
**Last updated:** [January 31, 2021, 6:52pm UTC](https://discuss.elastic.co/t/gpg-key/261891 "2021-01-31T18:52:29Z")

</div>

hi guys, i wanna ask something about installation elastic and beats, because they need GPG-key and my server can't access public internet. how can i add a GPG Key manually? thanks

---

## [Elasticsearch configuration in a shared server/node](https://discuss.elastic.co/t/elasticsearch-configuration-in-a-shared-server-node/262729)

<div class="topic-metadata">

**Author:** [@ehsan\_kabiri\_33](https://discuss.elastic.co/u/ehsan_kabiri_33)\
**Replies:** 1\
**Last updated:** [January 31, 2021, 5:32pm UTC](https://discuss.elastic.co/t/elasticsearch-configuration-in-a-shared-server-node/262729 "2021-01-31T17:32:45Z")

</div>

I do know it's better to have separate server for each job, but I have a shared server between Elasticsearch and MySQL, with a total 8 Gig RAM. we should avoid swapping in Elasticsearch, so I set bootstrap.memory\_lock: …

---

## [Multiple values match query in Update by query](https://discuss.elastic.co/t/multiple-values-match-query-in-update-by-query/262757)

<div class="topic-metadata">

**Author:** [@sarvendras](https://discuss.elastic.co/u/sarvendras)\
**Replies:** 1\
**Last updated:** [January 31, 2021, 5:16pm UTC](https://discuss.elastic.co/t/multiple-values-match-query-in-update-by-query/262757 "2021-01-31T17:16:30Z")

</div>

Hi All, I have to update one field based on match of multiple values of a field.I want to update field amt as 9000 based on query of multiple values of RRN but multiple values are not supported and giving error. Is the…

---

## [Monitoring/tasks consistently running task](https://discuss.elastic.co/t/monitoring-tasks-consistently-running-task/262754)

<div class="topic-metadata">

**Author:** [@liorg2](https://discuss.elastic.co/u/liorg2)\
**Replies:** 1\
**Last updated:** [January 31, 2021, 4:25pm UTC](https://discuss.elastic.co/t/monitoring-tasks-consistently-running-task/262754 "2021-01-31T16:25:19Z")

</div>

Can anyone explain these lines in the cat/tasks? should we be worried about them?

---

## [I want to except results on a specific date from elastic aggregation](https://discuss.elastic.co/t/i-want-to-except-results-on-a-specific-date-from-elastic-aggregation/262741)

<div class="topic-metadata">

**Author:** [@e997cd7e8d9915436150](https://discuss.elastic.co/u/e997cd7e8d9915436150)\
**Replies:** 0\
**Last updated:** [January 31, 2021, 7:58am UTC](https://discuss.elastic.co/t/i-want-to-except-results-on-a-specific-date-from-elastic-aggregation/262741 "2021-01-31T07:58:42Z")

</div>

This is my query that returns results on 19th Oct. GET apachelog/\_search { "size": 0, "aggs": { "NAME": { "terms": { "field": "ext.keyword", "size": 10 } } }, "query": { …

---

## [Advice for a beginner](https://discuss.elastic.co/t/advice-for-a-beginner/262749)

<div class="topic-metadata">

**Author:** [@Shivansh\_Mishra](https://discuss.elastic.co/u/Shivansh_Mishra)\
**Replies:** 1\
**Last updated:** [January 31, 2021, 11:59am UTC](https://discuss.elastic.co/t/advice-for-a-beginner/262749 "2021-01-31T11:59:41Z")

</div>

Hi all, I am trying to learn java and want to know about how the enterprise code works so I was thinking of contributing to elastic search so that I can get some mentorship. I am well versed in c# and I wanted to know …

---

## [Cloud deployment constantly going unhealthy](https://discuss.elastic.co/t/cloud-deployment-constantly-going-unhealthy/262423)

<div class="topic-metadata">

**Author:** [@Supernovasports](https://discuss.elastic.co/u/Supernovasports)\
**Replies:** 17\
**Last updated:** [January 30, 2021, 8:59pm UTC](https://discuss.elastic.co/t/cloud-deployment-constantly-going-unhealthy/262423 "2021-01-30T20:59:35Z")

</div>

Hi everyone, I have a deployment which today went unhealthy and after a full restart it works for a few minutes and then goes unhealthy again. From what I can see I haven't filled my storage capacity and I haven't increa…

---

## [Elasticsearch Node Roles Abbreviation](https://discuss.elastic.co/t/elasticsearch-node-roles-abbreviation/262724)

<div class="topic-metadata">

**Author:** [@vishakh](https://discuss.elastic.co/u/vishakh)\
**Replies:** 1\
**Last updated:** [January 30, 2021, 7:46pm UTC](https://discuss.elastic.co/t/elasticsearch-node-roles-abbreviation/262724 "2021-01-30T19:46:03Z")

</div>

Currently, I'm running ELK-Stack: 7.10 cluster On my cluster-nodes, I see "cdhilmrstw" as node roles Can anyone please explain/denote what these individual node abbreviations stands for?

---

## [Heap 50% of 30GB no docs yet](https://discuss.elastic.co/t/heap-50-of-30gb-no-docs-yet/261938)

<div class="topic-metadata">

**Author:** [@chrislinx](https://discuss.elastic.co/u/chrislinx)\
**Replies:** 4\
**Last updated:** [January 30, 2021, 6:51pm UTC](https://discuss.elastic.co/t/heap-50-of-30gb-no-docs-yet/261938 "2021-01-30T18:51:00Z")

</div>

3 physical Elasticsearch nodes in a cluster. Each node 8 core 64gb ram ubuntu svr 20.04 lts with 2TB M2 storage. 30gb Heap. 600 shards, 1 replica. I will eventually index 10TB on this cluster so 20GB per shard ~12TB. M…

---

## [Elasticsearch fails to start on ubuntu 20.04](https://discuss.elastic.co/t/elasticsearch-fails-to-start-on-ubuntu-20-04/262684)

<div class="topic-metadata">

**Author:** [@josephthejoe](https://discuss.elastic.co/u/josephthejoe)\
**Replies:** 6\
**Last updated:** [January 30, 2021, 6:28pm UTC](https://discuss.elastic.co/t/elasticsearch-fails-to-start-on-ubuntu-20-04/262684 "2021-01-30T18:28:58Z")

</div>

There seems to be a lot of these types of posts ive gone through a ton of them and havent been able to find one spitting out similar errors to what I have. No logs just the output from systemctl status. lab@siem:~$ syst…

---

## [Suricata - ELK stack](https://discuss.elastic.co/t/suricata-elk-stack/262715)

<div class="topic-metadata">

**Author:** [@nunex\_17](https://discuss.elastic.co/u/nunex_17)\
**Replies:** 3\
**Last updated:** [January 30, 2021, 6:26pm UTC](https://discuss.elastic.co/t/suricata-elk-stack/262715 "2021-01-30T18:26:17Z")

</div>

Hi! I need to implement a IDS solution. I already have suriata running on a powerful physical serve, but i need to have the ELK stack on a different machine. Do you guys recommend any minimum system requirements for th…

---

## [Unable to search nested object with correct format](https://discuss.elastic.co/t/unable-to-search-nested-object-with-correct-format/262615)

<div class="topic-metadata">

**Author:** [@ycbencheng](https://discuss.elastic.co/u/ycbencheng)\
**Replies:** 1\
**Last updated:** [January 30, 2021, 5:39pm UTC](https://discuss.elastic.co/t/unable-to-search-nested-object-with-correct-format/262615 "2021-01-30T17:39:46Z")

</div>

Hi ELK community, I'm unable to get the nested prospects obj within the vehicle index. Here is the suppose index obj - { "\_index" : "vehicles", "\_type" : "\_doc", "\_id" : "3MZBxxxxxxx", …

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=713)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=715)
