# Elastic Stack

**URL:** https://discuss.elastic.co/c/elastic-stack/81.md?page=1571

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1572

---

## [Is it possible to get the length of the dataset of its own?](https://discuss.elastic.co/t/is-it-possible-to-get-the-length-of-the-dataset-of-its-own/263079)

<div class="topic-metadata">

**Author:** [@m-amano](https://discuss.elastic.co/u/m-amano)\
**Replies:** 1\
**Last updated:** [February 4, 2021, 4:44pm UTC](https://discuss.elastic.co/t/is-it-possible-to-get-the-length-of-the-dataset-of-its-own/263079 "2021-02-04T16:44:20Z")

</div>

I am using Elasticsearch v.7.10.2 and Vega version is v.4.3.0. I tried the code below to get the size of the dataset itself and got an error. "data": \[ { "name": "dataset1", "values": \[{...},{...}\], "transfo…

---

## [How to create table with a term and percentage value from boolean property](https://discuss.elastic.co/t/how-to-create-table-with-a-term-and-percentage-value-from-boolean-property/262893)

<div class="topic-metadata">

**Author:** [@shellshock79](https://discuss.elastic.co/u/shellshock79)\
**Replies:** 1\
**Last updated:** [February 4, 2021, 4:34pm UTC](https://discuss.elastic.co/t/how-to-create-table-with-a-term-and-percentage-value-from-boolean-property/262893 "2021-02-04T16:34:39Z")

</div>

Hi Guys, I have been going round and round for days with this one and seem to hit a dead end no matter what I try. I keep pushing because I have a feeling it should be fairly easy, but alas I cannot find how to do it. P…

---

## [Hiding Visualization on Dashboard](https://discuss.elastic.co/t/hiding-visualization-on-dashboard/263080)

<div class="topic-metadata">

**Author:** [@maniGupt](https://discuss.elastic.co/u/maniGupt)\
**Replies:** 1\
**Last updated:** [February 4, 2021, 4:30pm UTC](https://discuss.elastic.co/t/hiding-visualization-on-dashboard/263080 "2021-02-04T16:30:07Z")

</div>

HI , Is there a way to hide a visualization if there is "no result found" for it , on dashboard. There are many control filters, based on which, some visualization might not have data. Can we hide such visualization a…

---

## [How to use OCR in Elasticsearch ingest attachment plugin?](https://discuss.elastic.co/t/how-to-use-ocr-in-elasticsearch-ingest-attachment-plugin/263007)

<div class="topic-metadata">

**Author:** [@OB1290](https://discuss.elastic.co/u/OB1290)\
**Replies:** 11\
**Last updated:** [February 4, 2021, 4:27pm UTC](https://discuss.elastic.co/t/how-to-use-ocr-in-elasticsearch-ingest-attachment-plugin/263007 "2021-02-04T16:27:31Z")

</div>

I was able to make the plugin work with PDFs that contain searchable text. When I give it a PDF or PNG with non searchable text, it fails to extract the text from the binary data. Unfortunately, I couldn't find anything…

---

## [How i can add option field in Kibana metrics](https://discuss.elastic.co/t/how-i-can-add-option-field-in-kibana-metrics/263141)

<div class="topic-metadata">

**Author:** [@ITchandj](https://discuss.elastic.co/u/ITchandj)\
**Replies:** 1\
**Last updated:** [February 4, 2021, 4:25pm UTC](https://discuss.elastic.co/t/how-i-can-add-option-field-in-kibana-metrics/263141 "2021-02-04T16:25:02Z")

</div>

Hello everybody. I need help. how can add field option in kibana. the result should be like the follow pictures. thank in advance

---

## [Kibana Shard Issue](https://discuss.elastic.co/t/kibana-shard-issue/263203)

<div class="topic-metadata">

**Author:** [@Daniel\_J1996](https://discuss.elastic.co/u/Daniel_J1996)\
**Replies:** 1\
**Last updated:** [February 4, 2021, 4:23pm UTC](https://discuss.elastic.co/t/kibana-shard-issue/263203 "2021-02-04T16:23:56Z")

</div>

Hey all, I'm trying to build a test cluster pertaining to 1 master node and 2 data nodes. The master node runs elasticsearch and Kibana while the other two nodes only run elasticsearch. I am running into an issue with K…

---

## [Does Kibana support localization for 10 languages?](https://discuss.elastic.co/t/does-kibana-support-localization-for-10-languages/263257)

<div class="topic-metadata">

**Author:** [@sarath\_td](https://discuss.elastic.co/u/sarath_td)\
**Replies:** 1\
**Last updated:** [February 4, 2021, 4:09pm UTC](https://discuss.elastic.co/t/does-kibana-support-localization-for-10-languages/263257 "2021-02-04T16:09:42Z")

</div>

We have an immediate requirement for enabling multi lingual support in Kibana (localization/globalization) for our clients. All our dashboards visualizations should support local language. Is there a way to achieve this? …

---

## [ES 7.8 Percolate Performance Issues](https://discuss.elastic.co/t/es-7-8-percolate-performance-issues/263262)

<div class="topic-metadata">

**Author:** [@plush](https://discuss.elastic.co/u/plush)\
**Replies:** 0\
**Last updated:** [February 4, 2021, 3:23pm UTC](https://discuss.elastic.co/t/es-7-8-percolate-performance-issues/263262 "2021-02-04T15:23:46Z")

</div>

We've recently updated our Elasticsearch cluster version from 6.7 to 7.8. Since we upgraded, we've noticed that the performance of our percolate queries has significantly degraded. For reference, when running a single-t…

---

## [Logstash elasticsearch output plugin - Populating api\_key from metadata field does not work](https://discuss.elastic.co/t/logstash-elasticsearch-output-plugin-populating-api-key-from-metadata-field-does-not-work/263259)

<div class="topic-metadata">

**Author:** [@vigneshr35](https://discuss.elastic.co/u/vigneshr35)\
**Replies:** 0\
**Last updated:** [February 4, 2021, 3:13pm UTC](https://discuss.elastic.co/t/logstash-elasticsearch-output-plugin-populating-api-key-from-metadata-field-does-not-work/263259 "2021-02-04T15:13:50Z")

</div>

Hi All, I am using the elasticsearch output plugin of logstash to post my events to elasticsearch. I am using the api\_key authentication method. It is all working fine until I have the api\_key parameter value hardcoded.…

---

## [\[ES 7.6\] regular expression has redundant nested repeat operator](https://discuss.elastic.co/t/es-7-6-regular-expression-has-redundant-nested-repeat-operator/220835)

<div class="topic-metadata">

**Author:** [@yurgers](https://discuss.elastic.co/u/yurgers)\
**Replies:** 8\
**Last updated:** [February 4, 2021, 2:54pm UTC](https://discuss.elastic.co/t/es-7-6-regular-expression-has-redundant-nested-repeat-operator/220835 "2021-02-04T14:54:03Z")

</div>

good day! I'm new to ELK Noticed that after updating ES to 7.6 a large number of messages started appearing in /var/log/messages Feb 25 13:55:01 elasticsearch elasticsearch\[23298\]: regular expression has redundant ne…

---

## [Can I use my time range in a details visualization?](https://discuss.elastic.co/t/can-i-use-my-time-range-in-a-details-visualization/263255)

<div class="topic-metadata">

**Author:** [@ematal96](https://discuss.elastic.co/u/ematal96)\
**Replies:** 0\
**Last updated:** [February 4, 2021, 2:44pm UTC](https://discuss.elastic.co/t/can-i-use-my-time-range-in-a-details-visualization/263255 "2021-02-04T14:44:17Z")

</div>

Hi all, I need to parse my time range into my scripted field to set a details table to start from: "time-range-start" , to:"time-range-end". Actually i've a scripted filed that create the visualization with a fixed t…

---

## [Same output when searching exact phrase in Discovery search](https://discuss.elastic.co/t/same-output-when-searching-exact-phrase-in-discovery-search/263248)

<div class="topic-metadata">

**Author:** [@nastymajestic](https://discuss.elastic.co/u/nastymajestic)\
**Replies:** 0\
**Last updated:** [February 4, 2021, 2:09pm UTC](https://discuss.elastic.co/t/same-output-when-searching-exact-phrase-in-discovery-search/263248 "2021-02-04T14:09:00Z")

</div>

I'm trying to search for exact phrase in Discovery tab. In "message" field I'm trying to search for "transactionId:" phrase (with quotation marks) and when I search for it like this: "message": "\\"transactionId\\"\\:" It…

---

## [How to convert to requried JSON](https://discuss.elastic.co/t/how-to-convert-to-requried-json/263254)

<div class="topic-metadata">

**Author:** [@onkarborade](https://discuss.elastic.co/u/onkarborade)\
**Replies:** 0\
**Last updated:** [February 4, 2021, 2:40pm UTC](https://discuss.elastic.co/t/how-to-convert-to-requried-json/263254 "2021-02-04T14:40:17Z")

</div>

Hi, Getting following logstash output "rosterentry" : { "rosterdaterange" : \[ "100,01-JUL-20,01-AUG-22", "100,02-JUL-20,02-AUG-22", "101,03-JUL-19,0…

---

## [Could not locate that index-pattern (id: .\*), \[click here to re-create it\](#/management/kibana/index)](https://discuss.elastic.co/t/could-not-locate-that-index-pattern-id-click-here-to-re-create-it-management-kibana-index/263045)

<div class="topic-metadata">

**Author:** [@bruno\_aleixo](https://discuss.elastic.co/u/bruno_aleixo)\
**Replies:** 3\
**Last updated:** [February 4, 2021, 2:38pm UTC](https://discuss.elastic.co/t/could-not-locate-that-index-pattern-id-click-here-to-re-create-it-management-kibana-index/263045 "2021-02-04T14:38:26Z")

</div>

Hi, I need to delete my index, as it was causing a field conflict, but there was a chart created and I'm taking the error below, would there be any way to update this ID?

---

## [Beats require setup with elasticsearch as the output before using logstash as the output](https://discuss.elastic.co/t/beats-require-setup-with-elasticsearch-as-the-output-before-using-logstash-as-the-output/263249)

<div class="topic-metadata">

**Author:** [@bzak](https://discuss.elastic.co/u/bzak)\
**Replies:** 0\
**Last updated:** [February 4, 2021, 2:10pm UTC](https://discuss.elastic.co/t/beats-require-setup-with-elasticsearch-as-the-output-before-using-logstash-as-the-output/263249 "2021-02-04T14:10:10Z")

</div>

I have elk running in k8s. When I configure the beats to ship logs straight to elasticsearch, logs flow smoothly. However, I can't get the beats to ship logs to Logstash. There is a work around that I use to get this wor…

---

## [JDBC connection string](https://discuss.elastic.co/t/jdbc-connection-string/263165)

<div class="topic-metadata">

**Author:** [@525125](https://discuss.elastic.co/u/525125)\
**Replies:** 3\
**Last updated:** [February 4, 2021, 1:41pm UTC](https://discuss.elastic.co/t/jdbc-connection-string/263165 "2021-02-04T13:41:20Z")

</div>

Hi Team , We want to ingest oracle db (jdbc connection string ) filebeat -\>logstash --\>elk--\>kibana. Could help us what are prerequisites for achieve this.

---

## [Search between two indexes](https://discuss.elastic.co/t/search-between-two-indexes/262216)

<div class="topic-metadata">

**Author:** [@rohit\_pandey](https://discuss.elastic.co/u/rohit_pandey)\
**Replies:** 5\
**Last updated:** [February 4, 2021, 12:42pm UTC](https://discuss.elastic.co/t/search-between-two-indexes/262216 "2021-02-04T12:42:07Z")

</div>

I have two indexes: Index1 | id | name | | 1 | A | | 2 | B | | 3 | Z | Index2 | id | stmt\_id | description | | 1 | 11 | AAA | 2 | 11 | BBB | 3 | 11 | BBC | 4 | 22 | …

---

## [How to use logstash to index file with suggester mapping](https://discuss.elastic.co/t/how-to-use-logstash-to-index-file-with-suggester-mapping/263238)

<div class="topic-metadata">

**Author:** [@ahmed\_hussiney](https://discuss.elastic.co/u/ahmed_hussiney)\
**Replies:** 0\
**Last updated:** [February 4, 2021, 12:32pm UTC](https://discuss.elastic.co/t/how-to-use-logstash-to-index-file-with-suggester-mapping/263238 "2021-02-04T12:32:10Z")

</div>

Hello, I am new to Elastic search , and I want to implement auto complete search functionality by indexing data from JSON file , however all the samples I can find for "completion" suggester is using curl or developer t…

---

## [Kubernetes Tags](https://discuss.elastic.co/t/kubernetes-tags/263237)

<div class="topic-metadata">

**Author:** [@mariannoem-eltras](https://discuss.elastic.co/u/mariannoem-eltras)\
**Replies:** 0\
**Last updated:** [February 4, 2021, 12:04pm UTC](https://discuss.elastic.co/t/kubernetes-tags/263237 "2021-02-04T12:04:44Z")

</div>

Hi folks, is there any way to add dynamic tag to filebeat running in kubernetes? I know how to add static tag, but howabout adding Namespace? ${kubernetes.namespace} doesnt work.

---

## [Cumulative MAX/MIN](https://discuss.elastic.co/t/cumulative-max-min/263236)

<div class="topic-metadata">

**Author:** [@Damiano](https://discuss.elastic.co/u/Damiano)\
**Replies:** 0\
**Last updated:** [February 4, 2021, 11:54am UTC](https://discuss.elastic.co/t/cumulative-max-min/263236 "2021-02-04T11:54:35Z")

</div>

Hello, i am looking for a way to calculate the cumulative max metric using histograms. For those who know pandas (python) i am talking about cummax() or cummin() So basically in a simple histograms series like: 1, 2,…

---

## [Input with file and pipeline plugin at the sametime](https://discuss.elastic.co/t/input-with-file-and-pipeline-plugin-at-the-sametime/263233)

<div class="topic-metadata">

**Author:** [@hzarrabi](https://discuss.elastic.co/u/hzarrabi)\
**Replies:** 0\
**Last updated:** [February 4, 2021, 11:28am UTC](https://discuss.elastic.co/t/input-with-file-and-pipeline-plugin-at-the-sametime/263233 "2021-02-04T11:28:57Z")

</div>

Hi Guys, I'm trying to use in my input.conf file and pipeline plugin at the sametime but logstash crash with the following error message \[FATAL\]\[logstash.runner\] An unexpected error occurred! {:error=\>#\<LogStash::Error…

---

## [Master node is not electing in case of hot-warm architecture](https://discuss.elastic.co/t/master-node-is-not-electing-in-case-of-hot-warm-architecture/263232)

<div class="topic-metadata">

**Author:** [@Aniket\_Pant](https://discuss.elastic.co/u/Aniket_Pant)\
**Replies:** 0\
**Last updated:** [February 4, 2021, 11:23am UTC](https://discuss.elastic.co/t/master-node-is-not-electing-in-case-of-hot-warm-architecture/263232 "2021-02-04T11:23:42Z")

</div>

I want to implement hot-warm architecture i have two nodes one for hot and other is for warm data and these node will act as a master node also yeah i know for master node we need 3 node but this is just for testing purp…

---

## [How to Filebeat and logstash working with a JSON file](https://discuss.elastic.co/t/how-to-filebeat-and-logstash-working-with-a-json-file/263227)

<div class="topic-metadata">

**Author:** [@thewasta](https://discuss.elastic.co/u/thewasta)\
**Replies:** 0\
**Last updated:** [February 4, 2021, 10:02am UTC](https://discuss.elastic.co/t/how-to-filebeat-and-logstash-working-with-a-json-file/263227 "2021-02-04T10:02:25Z")

</div>

Filebeat, Logstash version: 7.10 Given this json { "killStreakData": { "12344412441": { "Name": "nickName", "highestKS": 2 }, "53134441634": { "Name": "nickName2", "highestKS": 3…

---

## [Unassigned shards on the node](https://discuss.elastic.co/t/unassigned-shards-on-the-node/263231)

<div class="topic-metadata">

**Author:** [@priyashree](https://discuss.elastic.co/u/priyashree)\
**Replies:** 0\
**Last updated:** [February 4, 2021, 11:18am UTC](https://discuss.elastic.co/t/unassigned-shards-on-the-node/263231 "2021-02-04T11:18:05Z")

</div>

Cluster state is changed to red since there are 2 unassigned shards. curl -s 'localhost:9200/\_cat/shards' | fgrep UNASSIGNED .kibana\_task\_manager\_1 0 p UNASSIGNED …

---

## [Interval queries filter, not\_containing behaving like not overlapping. Intended?](https://discuss.elastic.co/t/interval-queries-filter-not-containing-behaving-like-not-overlapping-intended/263212)

<div class="topic-metadata">

**Author:** [@aaronkiwi](https://discuss.elastic.co/u/aaronkiwi)\
**Replies:** 0\
**Last updated:** [February 4, 2021, 9:01am UTC](https://discuss.elastic.co/t/interval-queries-filter-not-containing-behaving-like-not-overlapping-intended/263212 "2021-02-04T09:01:59Z")

</div>

Hello I was wondering what the actual difference between the not\_overlapping and not\_containing filters for interval queries are. From the documentation I would assume that overlapping is when any part of the filter is…

---

## [How can i get total hits for chart in js?](https://discuss.elastic.co/t/how-can-i-get-total-hits-for-chart-in-js/263219)

<div class="topic-metadata">

**Author:** [@Ricky\_Alamsyah](https://discuss.elastic.co/u/Ricky_Alamsyah)\
**Replies:** 0\
**Last updated:** [February 4, 2021, 9:49am UTC](https://discuss.elastic.co/t/how-can-i-get-total-hits-for-chart-in-js/263219 "2021-02-04T09:49:01Z")

</div>

how i can get total hits for chart in js ? "hits" : { "total" : { "value" : 10000, "relation" : "gte" }, "max\_score" : 1.0, "hits" : \[ { "\_index" : "scotch.io-tutorial", "\_type" : "cities\_list", "id" : "onVJbH…

---

## [Error Activating Self-Monitoring in ElasticSearch 7.10](https://discuss.elastic.co/t/error-activating-self-monitoring-in-elasticsearch-7-10/262616)

<div class="topic-metadata">

**Author:** [@IGNACIO\_RODERA\_TOBAL](https://discuss.elastic.co/u/IGNACIO_RODERA_TOBAL)\
**Replies:** 3\
**Last updated:** [February 4, 2021, 9:31am UTC](https://discuss.elastic.co/t/error-activating-self-monitoring-in-elasticsearch-7-10/262616 "2021-02-04T09:31:04Z")

</div>

Hello all, I am setting up a new production environment with ElasticSearch version 7.10. At this moment we only have 2 servers running When I try to activate Self Monitoring I always get the same error: "We couldn't …

---

## [Kibana index patterns couldn't find any Elasticsearch data when server.basePath is set](https://discuss.elastic.co/t/kibana-index-patterns-couldnt-find-any-elasticsearch-data-when-server-basepath-is-set/262214)

<div class="topic-metadata">

**Author:** [@jordanpantin](https://discuss.elastic.co/u/jordanpantin)\
**Replies:** 4\
**Last updated:** [February 4, 2021, 9:30am UTC](https://discuss.elastic.co/t/kibana-index-patterns-couldnt-find-any-elasticsearch-data-when-server-basepath-is-set/262214 "2021-02-04T09:30:10Z")

</div>

I have installed ElasticSearch and Kibana (v 7.9.3) on a windows server. ElasticSearch is available on port 9200. I use reverse proxy on IIS for access to Kibana from outside. So I specified the server.basePath in con…

---

## [Fleet Custom Logs Ingest Pipeline](https://discuss.elastic.co/t/fleet-custom-logs-ingest-pipeline/262999)

<div class="topic-metadata">

**Author:** [@beerygaz](https://discuss.elastic.co/u/beerygaz)\
**Replies:** 1\
**Last updated:** [February 4, 2021, 8:34am UTC](https://discuss.elastic.co/t/fleet-custom-logs-ingest-pipeline/262999 "2021-02-04T08:34:21Z")

</div>

We're trying to ingest a custom log using the custom log integration in Fleet. Is there a way to push thins custom log through an ingest pipeline so that we can parse out the custom fields in the message field using gro…

---

## [How to convert miliseconds into hh:mm:ss using plainless](https://discuss.elastic.co/t/how-to-convert-miliseconds-into-hhss-using-plainless/263006)

<div class="topic-metadata">

**Author:** [@mohanss08](https://discuss.elastic.co/u/mohanss08)\
**Replies:** 3\
**Last updated:** [February 4, 2021, 7:50am UTC](https://discuss.elastic.co/t/how-to-convert-miliseconds-into-hhss-using-plainless/263006 "2021-02-04T07:50:44Z")

</div>

With ELK - 7.10.1 i am trying to visualize kibana using painless script, Currently i have logstash output data in the below format. "build\_end\_time" =\> "2021-01-13 01:29:49", "build\_duration" =\> "6409651", "build\_start…

[Previous page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1570)

[Next page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1572)
