# Elastic Stack **URL:** https://discuss.elastic.co/c/elastic-stack/81.md?page=1609 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1610 --- ## [Millions of closed indices?](https://discuss.elastic.co/t/millions-of-closed-indices/260758)
**Author:** [@cjbottaro](https://discuss.elastic.co/u/cjbottaro)\ **Replies:** 1\ **Last updated:** [January 11, 2021, 8:02pm UTC](https://discuss.elastic.co/t/millions-of-closed-indices/260758 "2021-01-11T20:02:26Z")
Hello. We're toying with the idea of using Es for some type of "cold storage". Basically archival of our clients' data. The data grows indefinitely over time. The idea is to have an index for each piece of archived data… --- ## [Launch Logstash Pipeline through API](https://discuss.elastic.co/t/launch-logstash-pipeline-through-api/260761)
**Author:** [@ctan](https://discuss.elastic.co/u/ctan)\ **Replies:** 0\ **Last updated:** [January 11, 2021, 8:00pm UTC](https://discuss.elastic.co/t/launch-logstash-pipeline-through-api/260761 "2021-01-11T20:00:36Z")
I would like to find a way to launch a Logstash pipeline through the API. The use case is that an application is going to write directly to Elasticsearch, and when it is done we want Logstash to kick-off and do it's thin… --- ## [Mixed storage within a cluster question](https://discuss.elastic.co/t/mixed-storage-within-a-cluster-question/260757)
**Author:** [@linkerc](https://discuss.elastic.co/u/linkerc)\ **Replies:** 0\ **Last updated:** [January 11, 2021, 7:05pm UTC](https://discuss.elastic.co/t/mixed-storage-within-a-cluster-question/260757 "2021-01-11T19:05:55Z")
I have a cluster of ES nodes on AWS. Let's say 20 nodes using EBS and 3 using i3en (local disks). I am testing with i3en nodes to improve IO. But I am still seeing slow indexing and search logs showing up (up to tens … --- ## [Beats Denial of Service issue (ESA-2020-16)](https://discuss.elastic.co/t/beats-denial-of-service-issue-esa-2020-16/260759)
**Author:** [@Anandh\_Kumar](https://discuss.elastic.co/u/Anandh_Kumar)\ **Replies:** 0\ **Last updated:** [January 11, 2021, 7:35pm UTC](https://discuss.elastic.co/t/beats-denial-of-service-issue-esa-2020-16/260759 "2021-01-11T19:35:53Z")
Does the denial of service issue apply to filebeat connections made to logstash over ssl? We have filebeat running in one linux machine streaming via SSL TCP to a logstash output setup in another linux machine. --- ## [Logstash connection to Azure mssql](https://discuss.elastic.co/t/logstash-connection-to-azure-mssql/260722)
**Author:** [@vikram\_singh](https://discuss.elastic.co/u/vikram_singh)\ **Replies:** 0\ **Last updated:** [January 11, 2021, 12:56pm UTC](https://discuss.elastic.co/t/logstash-connection-to-azure-mssql/260722 "2021-01-11T12:56:58Z")
Hi, I am trying to connect logstash to azure mssql db. But is is showing Error: unable to load /tmp/mssql-jdbc-8.4.1.jre8.jar from :jdbc\_driver\_library, file not readable (please check user and group permissions for t… --- ## [Logstash, jdbc and .logstash\_jdbc\_last\_run](https://discuss.elastic.co/t/logstash-jdbc-and-logstash-jdbc-last-run/260654)
**Author:** [@elasticforme](https://discuss.elastic.co/u/elasticforme)\ **Replies:** 3\ **Last updated:** [January 11, 2021, 6:56pm UTC](https://discuss.elastic.co/t/logstash-jdbc-and-logstash-jdbc-last-run/260654 "2021-01-11T18:56:04Z")
In all my cases I do not want to use .logstash\_jdbc\_last\_run how do I avoid using it. I uses following option but it still try to use .logstash\_jdbc\_last\_run and fails sometime when two or more jdbc trying to use that. … --- ## [Index patterns health status yellow](https://discuss.elastic.co/t/index-patterns-health-status-yellow/260749)
**Author:** [@Grant1999](https://discuss.elastic.co/u/Grant1999)\ **Replies:** 1\ **Last updated:** [January 11, 2021, 6:16pm UTC](https://discuss.elastic.co/t/index-patterns-health-status-yellow/260749 "2021-01-11T18:16:06Z")
Any idea what it means about health status being yellow? --- ## [Vega: Cannot get dynamic data into strokeDash field](https://discuss.elastic.co/t/vega-cannot-get-dynamic-data-into-strokedash-field/260551)
**Author:** [@ege](https://discuss.elastic.co/u/ege)\ **Replies:** 5\ **Last updated:** [January 11, 2021, 5:32pm UTC](https://discuss.elastic.co/t/vega-cannot-get-dynamic-data-into-strokedash-field/260551 "2021-01-11T17:32:43Z")
I am in the process of creating a sequence diagram using Vega viz. The following code is the approach I'm using. { "$schema": "https://vega.github.io/schema/vega/v5.json", "description": "Sequence Diagram", "paddi… --- ## [Master not discovered or elected yet, an election requires two nodes with ids](https://discuss.elastic.co/t/master-not-discovered-or-elected-yet-an-election-requires-two-nodes-with-ids/260755)
**Author:** [@Sean\_Tisdale](https://discuss.elastic.co/u/Sean_Tisdale)\ **Replies:** 0\ **Last updated:** [January 11, 2021, 5:43pm UTC](https://discuss.elastic.co/t/master-not-discovered-or-elected-yet-an-election-requires-two-nodes-with-ids/260755 "2021-01-11T17:43:02Z")
I'm am currently trying to set up a cluster with 3 nodes in total. 1 master node and 2 data nodes. I am currently just trying to get the the first two nodes to connect. My master node runs fine when I start it but my dat… --- ## [Kibana with basePath login redirect loop on GCP](https://discuss.elastic.co/t/kibana-with-basepath-login-redirect-loop-on-gcp/260115)
**Author:** [@uncl3mar1k](https://discuss.elastic.co/u/uncl3mar1k)\ **Replies:** 2\ **Last updated:** [January 11, 2021, 5:30pm UTC](https://discuss.elastic.co/t/kibana-with-basepath-login-redirect-loop-on-gcp/260115 "2021-01-11T17:30:41Z")
On a regular GKE private cluster I Installed ECK (kubectl apply -f https://download.elastic.co/downloads/eck/1.3.1/all-in-one.yaml) Installed Elasticsearch and Kibana: apiVersion: v1 kind: Namespace meta… --- ## [Installing plugin in Kibana 7.8](https://discuss.elastic.co/t/installing-plugin-in-kibana-7-8/260155)
**Author:** [@ssimmons](https://discuss.elastic.co/u/ssimmons)\ **Replies:** 6\ **Last updated:** [January 11, 2021, 5:08pm UTC](https://discuss.elastic.co/t/installing-plugin-in-kibana-7-8/260155 "2021-01-11T17:08:20Z")
I've been working on creating a custom plugin in Kibana 7.8. I've got it working but I'm having problems doing a yarn build so I can install the plugin on our dev server. Following the steps lined out here: https://githu… --- ## [Inconsistent results for the same query on an index with 0 replicas](https://discuss.elastic.co/t/inconsistent-results-for-the-same-query-on-an-index-with-0-replicas/258715)
**Author:** [@Marten](https://discuss.elastic.co/u/Marten)\ **Replies:** 6\ **Last updated:** [January 11, 2021, 4:28pm UTC](https://discuss.elastic.co/t/inconsistent-results-for-the-same-query-on-an-index-with-0-replicas/258715 "2021-01-11T16:28:00Z")
Hi there, I have a problem with inconsistent ranking of the results when submitting the same query multiple times. I'm using ES 5.6.8 on an index with 5 primary shards. I have set the number of replicas from 1 to 0 to… --- ## [Fresh Install if ELK 7.10 floods deprecation log](https://discuss.elastic.co/t/fresh-install-if-elk-7-10-floods-deprecation-log/259972)
**Author:** [@JSylvia007](https://discuss.elastic.co/u/JSylvia007)\ **Replies:** 2\ **Last updated:** [January 11, 2021, 4:20pm UTC](https://discuss.elastic.co/t/fresh-install-if-elk-7-10-floods-deprecation-log/259972 "2021-01-11T16:20:11Z")
Originally posted here: Fresh Install if ELK 7.10 floods deprecation log and at the recommendation of @DavidTurner creating a new post here... A fresh install of ELK 7.10 fills the deprecation log once Kibana is install… --- ## [Pie chart in vega](https://discuss.elastic.co/t/pie-chart-in-vega/260373)
**Author:** [@Pranusha119](https://discuss.elastic.co/u/Pranusha119)\ **Replies:** 8\ **Last updated:** [January 11, 2021, 4:10pm UTC](https://discuss.elastic.co/t/pie-chart-in-vega/260373 "2021-01-11T16:10:09Z")
{ "$schema": "https://vega.github.io/schema/vega-lite/v4.json", "description": "A simple pie chart with labels.", "data": { "values": \[ {"category": "a", "value": 4}, {"category": "a", "value": 4},… --- ## ["is one of" filter when filtering on tooltip Map](https://discuss.elastic.co/t/is-one-of-filter-when-filtering-on-tooltip-map/260617)
**Author:** [@ErikvdVen](https://discuss.elastic.co/u/ErikvdVen)\ **Replies:** 4\ **Last updated:** [January 11, 2021, 3:50pm UTC](https://discuss.elastic.co/t/is-one-of-filter-when-filtering-on-tooltip-map/260617 "2021-01-11T15:50:45Z")
I have a dashboard, containing a Map visualization. I can add different "tooltip fields", so I could set a filter for example, but this only contains a "is" filter. Can I set a "is one of" filter as well? Example of suc… --- ## [Convert key value pair into hash](https://discuss.elastic.co/t/convert-key-value-pair-into-hash/260691)
**Author:** [@subash](https://discuss.elastic.co/u/subash)\ **Replies:** 1\ **Last updated:** [January 11, 2021, 3:41pm UTC](https://discuss.elastic.co/t/convert-key-value-pair-into-hash/260691 "2021-01-11T15:41:22Z")
I have a field p1 with the value as partition=root,size=23.28GB,free=15.76GB p1 : partition=root,size=23.28GB,free=15.76GB I want to store this in an array field and the values in a hash, like below. \[partition\]\[root… --- ## [Vega: Collecting data from a visualization data table](https://discuss.elastic.co/t/vega-collecting-data-from-a-visualization-data-table/260724)
**Author:** [@nikita\_zaliven](https://discuss.elastic.co/u/nikita_zaliven)\ **Replies:** 18\ **Last updated:** [January 11, 2021, 3:37pm UTC](https://discuss.elastic.co/t/vega-collecting-data-from-a-visualization-data-table/260724 "2021-01-11T15:37:05Z")
Hello, Using a dashboard, I have one visualization which is a data table. I am trying to figure out if and how it is possible with Vega to load a specific column from the data table in order to use it with another data… --- ## [Issue in import csv functionality with timestamp field contains spaces and kommas](https://discuss.elastic.co/t/issue-in-import-csv-functionality-with-timestamp-field-contains-spaces-and-kommas/260584)
**Author:** [@willemdh](https://discuss.elastic.co/u/willemdh)\ **Replies:** 3\ **Last updated:** [January 11, 2021, 3:33pm UTC](https://discuss.elastic.co/t/issue-in-import-csv-functionality-with-timestamp-field-contains-spaces-and-kommas/260584 "2021-01-11T15:33:41Z")
Hello, Kibana 7.10.1. Tried to use the import csv functionality and for some reason is the first colomn header replaced by a value with a front and end space.. Seem like a bug? The csv was exported from Excel. Als… --- ## [Reverse proxy using nginx to a specific dashboard](https://discuss.elastic.co/t/reverse-proxy-using-nginx-to-a-specific-dashboard/260580)
**Author:** [@Amphagory](https://discuss.elastic.co/u/Amphagory)\ **Replies:** 2\ **Last updated:** [January 11, 2021, 3:14pm UTC](https://discuss.elastic.co/t/reverse-proxy-using-nginx-to-a-specific-dashboard/260580 "2021-01-11T15:14:18Z")
Hello, I am a bit green in setting up a reverse proxy using nginx and I was hoping someone would help me with the following: The following is my simple configuration (please suggest more directives if I should include … --- ## [Apply internal controls visualization](https://discuss.elastic.co/t/apply-internal-controls-visualization/260731)
**Author:** [@nikita\_zaliven](https://discuss.elastic.co/u/nikita_zaliven)\ **Replies:** 4\ **Last updated:** [January 11, 2021, 3:13pm UTC](https://discuss.elastic.co/t/apply-internal-controls-visualization/260731 "2021-01-11T15:13:52Z")
Hello, I was wondering if and how it is possible to select a certain field filter, and have it only filter the option fields inside the controls visualization? For example, by selecting field of option 1, fields of opt… --- ## [Logstash io.netty.util.internal.OutOfDirectMemoryError: failed to allocate 16777216 byte(s) of direct memory (used: 12766298444, max: 12771524608)](https://discuss.elastic.co/t/logstash-io-netty-util-internal-outofdirectmemoryerror-failed-to-allocate-16777216-byte-s-of-direct-memory-used-12766298444-max-12771524608/260067)
**Author:** [@pavank](https://discuss.elastic.co/u/pavank)\ **Replies:** 6\ **Last updated:** [January 11, 2021, 3:09pm UTC](https://discuss.elastic.co/t/logstash-io-netty-util-internal-outofdirectmemoryerror-failed-to-allocate-16777216-byte-s-of-direct-memory-used-12766298444-max-12771524608/260067 "2021-01-11T15:09:26Z")
Hi All, We are using Logstash 6.3.1 and recently we have been facing issues with getting the log flowing from Filebeat agents. Attaching the configuration and log samples. We have increased the heap memory from 4GB to … --- ## [Dissect filter mapping](https://discuss.elastic.co/t/dissect-filter-mapping/260705)
**Author:** [@ashok9177](https://discuss.elastic.co/u/ashok9177)\ **Replies:** 1\ **Last updated:** [January 11, 2021, 3:08pm UTC](https://discuss.elastic.co/t/dissect-filter-mapping/260705 "2021-01-11T15:08:25Z")
Hi, I want extract only one field after \[HOT\_KV\_LOG\] from the below log message with dissect filter, anyone help me \[HOT\_KV\_LOG\] \[msg\_process\] level\_\_keyword="INFO" type\_\_keyword="MESSAGE\_PROCESSED" e2e\_latency\_\_number… --- ## [How to find sum of unique counts when creating a table using discover?](https://discuss.elastic.co/t/how-to-find-sum-of-unique-counts-when-creating-a-table-using-discover/260545)
**Author:** [@learnkibana](https://discuss.elastic.co/u/learnkibana)\ **Replies:** 2\ **Last updated:** [January 11, 2021, 3:04pm UTC](https://discuss.elastic.co/t/how-to-find-sum-of-unique-counts-when-creating-a-table-using-discover/260545 "2021-01-11T15:04:25Z")
So I created a table using the visualisation console and I managed to get the unique values of the patent IDs. However, I am unable to find the total amount of unique patentIDs. Is there a way I can sum all the 'Unique… --- ## [OpenmapTiles in Vega During Offline Mode](https://discuss.elastic.co/t/openmaptiles-in-vega-during-offline-mode/260477)
**Author:** [@gerardo\_dutan](https://discuss.elastic.co/u/gerardo_dutan)\ **Replies:** 4\ **Last updated:** [January 11, 2021, 2:58pm UTC](https://discuss.elastic.co/t/openmaptiles-in-vega-during-offline-mode/260477 "2021-01-11T14:58:34Z")
Hello, I'm currently deploying the stack in an offline environment and am having issues with generating a map based visualization in vega. I'm using the standard config reference in the vega script to pull up a map, work… --- ## [Unable to revive connection: http://localhost:9200 with Docker](https://discuss.elastic.co/t/unable-to-revive-connection-http-localhost-9200-with-docker/260726)
**Author:** [@gcio](https://discuss.elastic.co/u/gcio)\ **Replies:** 9\ **Last updated:** [January 11, 2021, 2:54pm UTC](https://discuss.elastic.co/t/unable-to-revive-connection-http-localhost-9200-with-docker/260726 "2021-01-11T14:54:17Z")
Hi everyone, I'm starting a docker container as follows docker run -d --rm --name ejq-elk -v $PWD:/var/backups -p 5601:5601 sebp/elk:7.10.0 However, this returns a connection error ==\> /var/log/kibana/kibana5.log \<==… --- ## [Duplicate winlogbeat index patterns](https://discuss.elastic.co/t/duplicate-winlogbeat-index-patterns/260620)
**Author:** [@craign30](https://discuss.elastic.co/u/craign30)\ **Replies:** 2\ **Last updated:** [January 11, 2021, 2:14pm UTC](https://discuss.elastic.co/t/duplicate-winlogbeat-index-patterns/260620 "2021-01-11T14:14:48Z")
I'm running Elastic, Kibana, and Winlogbeat 7.8 on a single server with Winlogbeat on my clients, as well. Everything is currently working properly, but I noticed duplicate winlogbeat-\* index patterns in Kibana. The de… --- ## [Aggregation problem with timeseries - terms / sum](https://discuss.elastic.co/t/aggregation-problem-with-timeseries-terms-sum/260729)
**Author:** [@Thomas74](https://discuss.elastic.co/u/Thomas74)\ **Replies:** 0\ **Last updated:** [January 11, 2021, 2:08pm UTC](https://discuss.elastic.co/t/aggregation-problem-with-timeseries-terms-sum/260729 "2021-01-11T14:08:13Z")
Hi, I'm collecting metrics of my cluster via prometheus and metricbeat. Documents received are timeseries. That's mean I have multiple document for the same timestamp. Each 10s I have a list of all index with their con… --- ## [Does Line panel support the Filter Ratio metric aggregation?](https://discuss.elastic.co/t/does-line-panel-support-the-filter-ratio-metric-aggregation/260585)
**Author:** [@larrya](https://discuss.elastic.co/u/larrya)\ **Replies:** 2\ **Last updated:** [January 11, 2021, 2:06pm UTC](https://discuss.elastic.co/t/does-line-panel-support-the-filter-ratio-metric-aggregation/260585 "2021-01-11T14:06:30Z")
I like the format of the Line visualization better than the TSVB visualization because the overall style of the Line panel is more appealing. However, the Line panel does not support the Filter Ratio metric aggregation, … --- ## [High cpu usage 100% on elastic search servers](https://discuss.elastic.co/t/high-cpu-usage-100-on-elastic-search-servers/260442)
**Author:** [@ghl1l0](https://discuss.elastic.co/u/ghl1l0)\ **Replies:** 5\ **Last updated:** [January 11, 2021, 1:41pm UTC](https://discuss.elastic.co/t/high-cpu-usage-100-on-elastic-search-servers/260442 "2021-01-11T13:41:12Z")
Hello, I've a problem with elastic search that it use100% of CPU; with ES 7.9.3.: 3 nodes. 6 CPU(s) -Xms8g -Xmx8g Kibana run slowly and nodes states is yellow ! Thanks for helping Regards, Rali --- ## [My ELK Cluster is slow indexing Why? Please Help](https://discuss.elastic.co/t/my-elk-cluster-is-slow-indexing-why-please-help/260542)
**Author:** [@HKN\_MZ](https://discuss.elastic.co/u/HKN_MZ)\ **Replies:** 5\ **Last updated:** [January 11, 2021, 1:39pm UTC](https://discuss.elastic.co/t/my-elk-cluster-is-slow-indexing-why-please-help/260542 "2021-01-11T13:39:34Z")
I am trying to send data to Elasticsearch, but elasticsearch indexing is soo slow. Some usefull outputs on below. GET \_/nodes/hot\_threads?pretty is the output; GET \_cluster/stats is the output; [Previous page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1608) [Next page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1610)