# Elasticsearch **URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=711 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 712 --- ## [Kubernetes Tags](https://discuss.elastic.co/t/kubernetes-tags/263237)
**Author:** [@mariannoem-eltras](https://discuss.elastic.co/u/mariannoem-eltras)\ **Replies:** 0\ **Last updated:** [February 4, 2021, 12:04pm UTC](https://discuss.elastic.co/t/kubernetes-tags/263237 "2021-02-04T12:04:44Z")
Hi folks, is there any way to add dynamic tag to filebeat running in kubernetes? I know how to add static tag, but howabout adding Namespace? ${kubernetes.namespace} doesnt work. --- ## [Cumulative MAX/MIN](https://discuss.elastic.co/t/cumulative-max-min/263236)
**Author:** [@Damiano](https://discuss.elastic.co/u/Damiano)\ **Replies:** 0\ **Last updated:** [February 4, 2021, 11:54am UTC](https://discuss.elastic.co/t/cumulative-max-min/263236 "2021-02-04T11:54:35Z")
Hello, i am looking for a way to calculate the cumulative max metric using histograms. For those who know pandas (python) i am talking about cummax() or cummin() So basically in a simple histograms series like: 1, 2,… --- ## [Master node is not electing in case of hot-warm architecture](https://discuss.elastic.co/t/master-node-is-not-electing-in-case-of-hot-warm-architecture/263232)
**Author:** [@Aniket\_Pant](https://discuss.elastic.co/u/Aniket_Pant)\ **Replies:** 0\ **Last updated:** [February 4, 2021, 11:23am UTC](https://discuss.elastic.co/t/master-node-is-not-electing-in-case-of-hot-warm-architecture/263232 "2021-02-04T11:23:42Z")
I want to implement hot-warm architecture i have two nodes one for hot and other is for warm data and these node will act as a master node also yeah i know for master node we need 3 node but this is just for testing purp… --- ## [Unassigned shards on the node](https://discuss.elastic.co/t/unassigned-shards-on-the-node/263231)
**Author:** [@priyashree](https://discuss.elastic.co/u/priyashree)\ **Replies:** 0\ **Last updated:** [February 4, 2021, 11:18am UTC](https://discuss.elastic.co/t/unassigned-shards-on-the-node/263231 "2021-02-04T11:18:05Z")
Cluster state is changed to red since there are 2 unassigned shards. curl -s 'localhost:9200/\_cat/shards' | fgrep UNASSIGNED .kibana\_task\_manager\_1 0 p UNASSIGNED … --- ## [Interval queries filter, not\_containing behaving like not overlapping. Intended?](https://discuss.elastic.co/t/interval-queries-filter-not-containing-behaving-like-not-overlapping-intended/263212)
**Author:** [@aaronkiwi](https://discuss.elastic.co/u/aaronkiwi)\ **Replies:** 0\ **Last updated:** [February 4, 2021, 9:01am UTC](https://discuss.elastic.co/t/interval-queries-filter-not-containing-behaving-like-not-overlapping-intended/263212 "2021-02-04T09:01:59Z")
Hello I was wondering what the actual difference between the not\_overlapping and not\_containing filters for interval queries are. From the documentation I would assume that overlapping is when any part of the filter is… --- ## [How can i get total hits for chart in js?](https://discuss.elastic.co/t/how-can-i-get-total-hits-for-chart-in-js/263219)
**Author:** [@Ricky\_Alamsyah](https://discuss.elastic.co/u/Ricky_Alamsyah)\ **Replies:** 0\ **Last updated:** [February 4, 2021, 9:49am UTC](https://discuss.elastic.co/t/how-can-i-get-total-hits-for-chart-in-js/263219 "2021-02-04T09:49:01Z")
how i can get total hits for chart in js ? "hits" : { "total" : { "value" : 10000, "relation" : "gte" }, "max\_score" : 1.0, "hits" : \[ { "\_index" : "scotch.io-tutorial", "\_type" : "cities\_list", "id" : "onVJbH… --- ## [Error Activating Self-Monitoring in ElasticSearch 7.10](https://discuss.elastic.co/t/error-activating-self-monitoring-in-elasticsearch-7-10/262616)
**Author:** [@IGNACIO\_RODERA\_TOBAL](https://discuss.elastic.co/u/IGNACIO_RODERA_TOBAL)\ **Replies:** 3\ **Last updated:** [February 4, 2021, 9:31am UTC](https://discuss.elastic.co/t/error-activating-self-monitoring-in-elasticsearch-7-10/262616 "2021-02-04T09:31:04Z")
Hello all, I am setting up a new production environment with ElasticSearch version 7.10. At this moment we only have 2 servers running When I try to activate Self Monitoring I always get the same error: "We couldn't … --- ## [Fleet Custom Logs Ingest Pipeline](https://discuss.elastic.co/t/fleet-custom-logs-ingest-pipeline/262999)
**Author:** [@beerygaz](https://discuss.elastic.co/u/beerygaz)\ **Replies:** 1\ **Last updated:** [February 4, 2021, 8:34am UTC](https://discuss.elastic.co/t/fleet-custom-logs-ingest-pipeline/262999 "2021-02-04T08:34:21Z")
We're trying to ingest a custom log using the custom log integration in Fleet. Is there a way to push thins custom log through an ingest pipeline so that we can parse out the custom fields in the message field using gro… --- ## [How to convert miliseconds into hh:mm:ss using plainless](https://discuss.elastic.co/t/how-to-convert-miliseconds-into-hhss-using-plainless/263006)
**Author:** [@mohanss08](https://discuss.elastic.co/u/mohanss08)\ **Replies:** 3\ **Last updated:** [February 4, 2021, 7:50am UTC](https://discuss.elastic.co/t/how-to-convert-miliseconds-into-hhss-using-plainless/263006 "2021-02-04T07:50:44Z")
With ELK - 7.10.1 i am trying to visualize kibana using painless script, Currently i have logstash output data in the below format. "build\_end\_time" =\> "2021-01-13 01:29:49", "build\_duration" =\> "6409651", "build\_start… --- ## [Rally gets stuck on check-cluster-health](https://discuss.elastic.co/t/rally-gets-stuck-on-check-cluster-health/262480)
**Author:** [@rsarpal](https://discuss.elastic.co/u/rsarpal)\ **Replies:** 6\ **Last updated:** [February 4, 2021, 8:04am UTC](https://discuss.elastic.co/t/rally-gets-stuck-on-check-cluster-health/262480 "2021-02-04T08:04:10Z")
Hi, We have older version of elastic 2.4 , I am trying to test it with rally. I have tried to test with latest and the older versions of rally (1.3.0, 1.4.1, latest) Rally gets stuck on check-cluster-health Running pu… --- ## [Elastic search not starting](https://discuss.elastic.co/t/elastic-search-not-starting/262886)
**Author:** [@SumeshGopu](https://discuss.elastic.co/u/SumeshGopu)\ **Replies:** 6\ **Last updated:** [February 4, 2021, 7:57am UTC](https://discuss.elastic.co/t/elastic-search-not-starting/262886 "2021-02-04T07:57:13Z")
Hello, We have a simple elasticsearch setup. Yesterday the diskspace went full and I was not able to get into index management to delete old index. So I deleted the files from disk. Now elasticsearch wont start I am… --- ## [Delete too many indexes at once leads the cluster to red](https://discuss.elastic.co/t/delete-too-many-indexes-at-once-leads-the-cluster-to-red/262849)
**Author:** [@sebastienf](https://discuss.elastic.co/u/sebastienf)\ **Replies:** 8\ **Last updated:** [February 4, 2021, 7:55am UTC](https://discuss.elastic.co/t/delete-too-many-indexes-at-once-leads-the-cluster-to-red/262849 "2021-02-04T07:55:33Z")
I work on a ES 5.6 "on premises", and we work to switch to ES 7.x. Before that, we aim to reduce our over-sharding issue : we generate too much index (every day when every month is ok) and espacially, with 5 shards (def… --- ## [Elasticsearch reindex API is not able to copy the documents](https://discuss.elastic.co/t/elasticsearch-reindex-api-is-not-able-to-copy-the-documents/263121)
**Author:** [@chaitra\_hegde](https://discuss.elastic.co/u/chaitra_hegde)\ **Replies:** 7\ **Last updated:** [February 4, 2021, 7:21am UTC](https://discuss.elastic.co/t/elasticsearch-reindex-api-is-not-able-to-copy-the-documents/263121 "2021-02-04T07:21:50Z")
Hi, I am using Elasticsearch 7.8.0. I am trying to copy documents from one index to another using reindex API. I tried 2 cases. Case 1. Only source index is present in the Elasticsearch cluster. Destination index is n… --- ## [How to enable elasticsearch on ipv4](https://discuss.elastic.co/t/how-to-enable-elasticsearch-on-ipv4/263204)
**Author:** [@Somesh\_ng](https://discuss.elastic.co/u/Somesh_ng)\ **Replies:** 0\ **Last updated:** [February 4, 2021, 7:21am UTC](https://discuss.elastic.co/t/how-to-enable-elasticsearch-on-ipv4/263204 "2021-02-04T07:21:08Z")
Can someone let me know how to run elasticsearch only on ipv4. --- ## [Understanding Elasticsearch ILM Lifecycle Actions](https://discuss.elastic.co/t/understanding-elasticsearch-ilm-lifecycle-actions/263202)
**Author:** [@BBQigniter](https://discuss.elastic.co/u/BBQigniter)\ **Replies:** 0\ **Last updated:** [February 4, 2021, 7:13am UTC](https://discuss.elastic.co/t/understanding-elasticsearch-ilm-lifecycle-actions/263202 "2021-02-04T07:13:20Z")
Hi, I want to better understand ILM and the actions it is doing in sequence. For example: What do I have to do if I want to move a hot-index (phase complete) to the next warm-phase and then to cold? I found the ilm-move… --- ## [Cannot detect ES version - using spark](https://discuss.elastic.co/t/cannot-detect-es-version-using-spark/263201)
**Author:** [@Nenad13](https://discuss.elastic.co/u/Nenad13)\ **Replies:** 0\ **Last updated:** [February 4, 2021, 6:21am UTC](https://discuss.elastic.co/t/cannot-detect-es-version-using-spark/263201 "2021-02-04T06:21:44Z")
I am using and AWS Glue Job to use a Spark cluster and trying to connect to an elasticsearch node. val esHost = "10.196.67.240" val esPort = "9200" val indexName = "xxx" val sparkConfig = new SparkConf().set("es.nodes"… --- ## [Elasticsearch get rid of yellow status](https://discuss.elastic.co/t/elasticsearch-get-rid-of-yellow-status/261141)
**Author:** [@first100](https://discuss.elastic.co/u/first100)\ **Replies:** 6\ **Last updated:** [February 4, 2021, 2:20am UTC](https://discuss.elastic.co/t/elasticsearch-get-rid-of-yellow-status/261141 "2021-02-04T02:20:00Z")
Hi I have Elasticsearch that I installed as a single node at the beginning and then the indices were created this configuration, after I added two other nodes and restarted elastic, and I always have the health status y… --- ## [Updating index analyzer with html char strip filter - blocking?](https://discuss.elastic.co/t/updating-index-analyzer-with-html-char-strip-filter-blocking/263182)
**Author:** [@barry2](https://discuss.elastic.co/u/barry2)\ **Replies:** 0\ **Last updated:** [February 4, 2021, 12:03am UTC](https://discuss.elastic.co/t/updating-index-analyzer-with-html-char-strip-filter-blocking/263182 "2021-02-04T00:03:08Z")
Hello, I have an index with around 11,000,000 documents in it. I need to update the index analyzer to include a html strip character filter. I know I have to close the index first, apply the new analyzer, then open the … --- ## [Get Month From Date/Time Field \[Painless\]](https://discuss.elastic.co/t/get-month-from-date-time-field-painless/262916)
**Author:** [@AClerk](https://discuss.elastic.co/u/AClerk)\ **Replies:** 17\ **Last updated:** [February 3, 2021, 10:54pm UTC](https://discuss.elastic.co/t/get-month-from-date-time-field-painless/262916 "2021-02-03T22:54:57Z")
Hello Following this example When using doc\['timestamp'\].value.getMonth(); Getting an error \[Possible causing node crash, still monitoring\] doc\['timestamp'\].value.getMonthValue(); works as expected and returning mont… --- ## [Elastic Search Query for cross document reference counts](https://discuss.elastic.co/t/elastic-search-query-for-cross-document-reference-counts/263061)
**Author:** [@mobius](https://discuss.elastic.co/u/mobius)\ **Replies:** 1\ **Last updated:** [February 3, 2021, 10:40pm UTC](https://discuss.elastic.co/t/elastic-search-query-for-cross-document-reference-counts/263061 "2021-02-03T22:40:12Z")
I have emails in the index which look like these: { "emailId" : 1, "to" : "a@example.com", "from" : "b@example.com", "subject" : "xyz subject" }, { "emailId" : 2, … --- ## [Elasticsearch query - Most recent log for each user, for field logtype='x'](https://discuss.elastic.co/t/elasticsearch-query-most-recent-log-for-each-user-for-field-logtype-x/263170)
**Author:** [@brennan](https://discuss.elastic.co/u/brennan)\ **Replies:** 0\ **Last updated:** [February 3, 2021, 9:24pm UTC](https://discuss.elastic.co/t/elasticsearch-query-most-recent-log-for-each-user-for-field-logtype-x/263170 "2021-02-03T21:24:31Z")
I am trying to query elasticsearch to get the most recent log for all userIDs where we only include one log per user with field logtype='x' if logtype='x' then get 1 log per userID where the date of this log is the most… --- ## [Saved field "engines.time" is invalid for use with the "Date Histogram" aggregation. Please select a new field](https://discuss.elastic.co/t/saved-field-engines-time-is-invalid-for-use-with-the-date-histogram-aggregation-please-select-a-new-field/263160)
**Author:** [@Ankit4](https://discuss.elastic.co/u/Ankit4)\ **Replies:** 0\ **Last updated:** [February 3, 2021, 6:26pm UTC](https://discuss.elastic.co/t/saved-field-engines-time-is-invalid-for-use-with-the-date-histogram-aggregation-please-select-a-new-field/263160 "2021-02-03T18:26:42Z")
I am getting this error, while creating index pattern in kibana; Error: Saved field "engines.time" is invalid for use with the "Date Histogram" aggregation. Please select a new field. at FieldParamType.\_this.deseria… --- ## [Elasticsearch: ('search\_phase\_execution\_exception', 'compile error')](https://discuss.elastic.co/t/elasticsearch-search-phase-execution-exception-compile-error/263146)
**Author:** [@Nikkie](https://discuss.elastic.co/u/Nikkie)\ **Replies:** 0\ **Last updated:** [February 3, 2021, 4:09pm UTC](https://discuss.elastic.co/t/elasticsearch-search-phase-execution-exception-compile-error/263146 "2021-02-03T16:09:40Z")
I am executing script\_query with cosineSimilarity using tensorflow embedding. The embeddings are obtained from tensorflow-hub. model which is loaded using the url: "https://tfhub.dev/google/universal-sentence-encoder/4" … --- ## [Xpack enabled elastic stack Cluster](https://discuss.elastic.co/t/xpack-enabled-elastic-stack-cluster/262808)
**Author:** [@Sagar\_Mandal](https://discuss.elastic.co/u/Sagar_Mandal)\ **Replies:** 7\ **Last updated:** [February 3, 2021, 3:04pm UTC](https://discuss.elastic.co/t/xpack-enabled-elastic-stack-cluster/262808 "2021-02-03T15:04:31Z")
Hi Team, I have a fedora distribution environment setup where I have 1 master node and 2 data node for Elasticsearch and single kibana and logstash in total I've 4 servers where logstash and kibana are in a single serve… --- ## [S3 backup configuration error](https://discuss.elastic.co/t/s3-backup-configuration-error/262795)
**Author:** [@Lior\_Yakobov](https://discuss.elastic.co/u/Lior_Yakobov)\ **Replies:** 12\ **Last updated:** [February 3, 2021, 2:42pm UTC](https://discuss.elastic.co/t/s3-backup-configuration-error/262795 "2021-02-03T14:42:39Z")
Hello, I'm trying to configure AWS S3 repository for backups but facing access issues to the S3 bucket. I did the following steps: Installed repository-s3 plugin on all cluster nodes restarted all nodes after the plu… --- ## [Recently rolled index does process data (0 docs)](https://discuss.elastic.co/t/recently-rolled-index-does-process-data-0-docs/261242)
**Author:** [@Zeroc0pter](https://discuss.elastic.co/u/Zeroc0pter)\ **Replies:** 8\ **Last updated:** [February 3, 2021, 2:33pm UTC](https://discuss.elastic.co/t/recently-rolled-index-does-process-data-0-docs/261242 "2021-02-03T14:33:03Z")
Hi People, I'm having an issue with our ILM set up. Well, I think it's related to our ILM policy. We use ElasticSearch 7. The policy rolled from 00001 to 00002 and suddenly it stopped processing data from our applicati… --- ## [How to create ingest pipeline for elasticsearch in kubernetes context?](https://discuss.elastic.co/t/how-to-create-ingest-pipeline-for-elasticsearch-in-kubernetes-context/263130)
**Author:** [@eeijlar](https://discuss.elastic.co/u/eeijlar)\ **Replies:** 0\ **Last updated:** [February 3, 2021, 2:15pm UTC](https://discuss.elastic.co/t/how-to-create-ingest-pipeline-for-elasticsearch-in-kubernetes-context/263130 "2021-02-03T14:15:55Z")
I am shipping a csv file from filebeat to elasticsearch. I understand that I need to use an ingest pipeline to parse the csv data prior to it being stored in elastic, similar to what is described in this answer From wha… --- ## [Index Status goes Unknown after Dramatic Increase in Size](https://discuss.elastic.co/t/index-status-goes-unknown-after-dramatic-increase-in-size/263038)
**Author:** [@Senthamarai\_Kannan](https://discuss.elastic.co/u/Senthamarai_Kannan)\ **Replies:** 2\ **Last updated:** [February 3, 2021, 1:22pm UTC](https://discuss.elastic.co/t/index-status-goes-unknown-after-dramatic-increase-in-size/263038 "2021-02-03T13:22:35Z")
One of our ES indices go to Unknown status after the size increases dramatically. Usually the index size is about 300MB but it goes above 8GB and goes to Unknown state. This is a single node instance hosted in a Windo… --- ## [Better way to convert the object field to nested type field](https://discuss.elastic.co/t/better-way-to-convert-the-object-field-to-nested-type-field/263026)
**Author:** [@Prabaharan\_Kathiresa](https://discuss.elastic.co/u/Prabaharan_Kathiresa)\ **Replies:** 0\ **Last updated:** [February 2, 2021, 6:14pm UTC](https://discuss.elastic.co/t/better-way-to-convert-the-object-field-to-nested-type-field/263026 "2021-02-02T18:14:08Z")
Hi Team We have an index with object field, we are planning to improve the object field into nested type (array of objects). ie. { "name": "Adam", "car" : { "name": "Maruthi", "modelyear": "2005" } } we are … --- ## [Parallel queries to partitions in Elasticsearch aggregations](https://discuss.elastic.co/t/parallel-queries-to-partitions-in-elasticsearch-aggregations/263122)
**Author:** [@NerdSec](https://discuss.elastic.co/u/NerdSec)\ **Replies:** 0\ **Last updated:** [February 3, 2021, 12:58pm UTC](https://discuss.elastic.co/t/parallel-queries-to-partitions-in-elasticsearch-aggregations/263122 "2021-02-03T12:58:40Z")
If I have a partitioned terms aggregation, say with 20 partitions. If I request for all the 20 partitions by sending 20 requests at the same time using the REST API, will the result be fetched faster or would it still ta… [Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=710) [Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=712)