# Elastic Stack **URL:** https://discuss.elastic.co/c/elastic-stack/81.md?page=1109 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1110 --- ## [Want to check connection duration](https://discuss.elastic.co/t/want-to-check-connection-duration/293235)
**Author:** [@root\_linux](https://discuss.elastic.co/u/root_linux)\ **Replies:** 6\ **Last updated:** [January 2, 2022, 5:17pm UTC](https://discuss.elastic.co/t/want-to-check-connection-duration/293235 "2022-01-02T17:17:11Z")
hi all, I have configured Elasticsearch, kibana and logstash on a server. Sending logs from different filebeat clients to logstash. I have logs in which connection esatablish and connection reset time present. My requir… --- ## [Could not find gem mimemagic 0.3.3](https://discuss.elastic.co/t/could-not-find-gem-mimemagic-0-3-3/293288)
**Author:** [@shrikantgulia](https://discuss.elastic.co/u/shrikantgulia)\ **Replies:** 1\ **Last updated:** [January 2, 2022, 3:37pm UTC](https://discuss.elastic.co/t/could-not-find-gem-mimemagic-0-3-3/293288 "2022-01-02T15:37:05Z")
Dears, happy new year i upgraded logstash from 7.3 to 7.14.2 and i took the backup of the plugins when i am installing the backuo of the plugin i faced the error "Using bundled JDK: /usr/share/logstash/jdk OpenJDK 64… --- ## [How to specify routing for index transform job](https://discuss.elastic.co/t/how-to-specify-routing-for-index-transform-job/292393)
**Author:** [@Assaf\_Cohen](https://discuss.elastic.co/u/Assaf_Cohen)\ **Replies:** 4\ **Last updated:** [January 2, 2022, 2:45pm UTC](https://discuss.elastic.co/t/how-to-specify-routing-for-index-transform-job/292393 "2022-01-02T14:45:22Z")
Hello, we have an index transform job, created as below (shortened for the sake of brevity) PUT /\_plugins/\_transform/my\_test\_transform { "transform": { "enabled": true, "schedule": { "interval": { … --- ## [Stuck at “Successfully started Logstash API endpoint {:port=\>9600}”](https://discuss.elastic.co/t/stuck-at-successfully-started-logstash-api-endpoint-port-9600/293279)
**Author:** [@adkyushu](https://discuss.elastic.co/u/adkyushu)\ **Replies:** 3\ **Last updated:** [January 1, 2022, 7:16pm UTC](https://discuss.elastic.co/t/stuck-at-successfully-started-logstash-api-endpoint-port-9600/293279 "2022-01-01T19:16:37Z")
Stuck at “Successfully started Logstash API endpoint {:port=\>9600}” When I turn on --debug, it keeps looping the following information: --- ## [Safely repair (remove/add-back) a data node in cluster](https://discuss.elastic.co/t/safely-repair-remove-add-back-a-data-node-in-cluster/293272)
**Author:** [@David\_Copperfield](https://discuss.elastic.co/u/David_Copperfield)\ **Replies:** 1\ **Last updated:** [January 1, 2022, 5:29pm UTC](https://discuss.elastic.co/t/safely-repair-remove-add-back-a-data-node-in-cluster/293272 "2022-01-01T17:29:47Z")
we have an Elasticsearch cluster running with a few data nodes. Recently one of the data nodes have some disk issues and we'll fix it. To preserve indexes, I've excluded the faulty data node out from cluster, with curl… --- ## [Elastic Agent + Fleet in AWS ECS Fargate](https://discuss.elastic.co/t/elastic-agent-fleet-in-aws-ecs-fargate/293226)
**Author:** [@ajhstn](https://discuss.elastic.co/u/ajhstn)\ **Replies:** 2\ **Last updated:** [January 1, 2022, 2:29am UTC](https://discuss.elastic.co/t/elastic-agent-fleet-in-aws-ecs-fargate/293226 "2022-01-01T02:29:28Z")
I want to run Elastic Agent in ECS task container and manage it with a Fleet policy. I can't seem to find anyone whose written about this before and I'm a little stuck. Running Elastic Cloud 7.15 In general, should I … --- ## [Kibana state become yellow after upgrade to version 7.16.2](https://discuss.elastic.co/t/kibana-state-become-yellow-after-upgrade-to-version-7-16-2/293242)
**Author:** [@ZiaulAfiq](https://discuss.elastic.co/u/ZiaulAfiq)\ **Replies:** 2\ **Last updated:** [December 31, 2021, 5:26pm UTC](https://discuss.elastic.co/t/kibana-state-become-yellow-after-upgrade-to-version-7-16-2/293242 "2021-12-31T17:26:08Z")
Greetings all! I have encountered with this problem when I upgrading my Kibana from version 7.15.2 to 7.16.2 When looking at the status, some of the plugins shows yellow state. These are the plugins that are affected d… --- ## [Migration timeout when upgrading Kibana from 7.15.1 to 7.15.2 or 7.16.0](https://discuss.elastic.co/t/migration-timeout-when-upgrading-kibana-from-7-15-1-to-7-15-2-or-7-16-0/291338)
**Author:** [@calve](https://discuss.elastic.co/u/calve)\ **Replies:** 3\ **Last updated:** [December 31, 2021, 5:10pm UTC](https://discuss.elastic.co/t/migration-timeout-when-upgrading-kibana-from-7-15-1-to-7-15-2-or-7-16-0/291338 "2021-12-31T17:10:39Z")
Hi, my kibana installation fails to upgrade from 7.15.1 to 7.15.2 and 7.16.0 during the CLONE\_TEMP\_TO\_TARGET -\> CLONE\_TEMP\_TO\_TARGET step. Also had the exact same problem from 7.13.1 to 7.13.2 but cant remember how I f… --- ## [Upgrade assistant stops at 80%](https://discuss.elastic.co/t/upgrade-assistant-stops-at-80/292621)
**Author:** [@beeblebrox3](https://discuss.elastic.co/u/beeblebrox3)\ **Replies:** 1\ **Last updated:** [December 31, 2021, 5:09pm UTC](https://discuss.elastic.co/t/upgrade-assistant-stops-at-80/292621 "2021-12-31T17:09:43Z")
I'm trying to use the upgrade assistant to upgrade indexes created with older versions of elastic stack (version 6). I started the upgrade process with version 7.10. And then I upgraded to 7.16.2. In both versions I'm g… --- ## [Beginners crash course - upload file fails](https://discuss.elastic.co/t/beginners-crash-course-upload-file-fails/292518)
**Author:** [@raja\_peter](https://discuss.elastic.co/u/raja_peter)\ **Replies:** 1\ **Last updated:** [December 31, 2021, 4:59pm UTC](https://discuss.elastic.co/t/beginners-crash-course-upload-file-fails/292518 "2021-12-31T16:59:20Z")
I'm following Beginner's crash course, Part 2 Relevance of a search. The said json file from News Category Dataset | Kaggle is not uploading and getting Invalid file format error. I tried Dev tools - Network for any erro… --- ## [Elasticsearch-Hadoop Integration Issue: cannot find class definition](https://discuss.elastic.co/t/elasticsearch-hadoop-integration-issue-cannot-find-class-definition/293070)
**Author:** [@scheung3](https://discuss.elastic.co/u/scheung3)\ **Replies:** 7\ **Last updated:** [December 31, 2021, 4:38pm UTC](https://discuss.elastic.co/t/elasticsearch-hadoop-integration-issue-cannot-find-class-definition/293070 "2021-12-31T16:38:27Z")
Hi helpful community! I am trying to load data from hive to Elasticsearch through a JDBC driver connection. I was able to execute my create index query and load index query without errors. However, I got java errors abo… --- ## [How to filter two fields based on a list of values](https://discuss.elastic.co/t/how-to-filter-two-fields-based-on-a-list-of-values/292846)
**Author:** [@Muharez](https://discuss.elastic.co/u/Muharez)\ **Replies:** 2\ **Last updated:** [December 31, 2021, 3:03pm UTC](https://discuss.elastic.co/t/how-to-filter-two-fields-based-on-a-list-of-values/292846 "2021-12-31T15:03:34Z")
Hi there! I have just started learning Elasticsearch. I created an index with four fields that contain information on distances between pairs of postcodes. { "distances" : { "mappings" : { "properties" : {… --- ## [ElasticSearch Input Plugin has no log output](https://discuss.elastic.co/t/elasticsearch-input-plugin-has-no-log-output/292906)
**Author:** [@l0ady](https://discuss.elastic.co/u/l0ady)\ **Replies:** 2\ **Last updated:** [December 31, 2021, 2:26pm UTC](https://discuss.elastic.co/t/elasticsearch-input-plugin-has-no-log-output/292906 "2021-12-31T14:26:40Z")
I want to extract one ES from another es periodically through logstash, but only the startup log, no other log information。。。THX config: input { #beats { # port =\> 5044 #} elasticsearch { hosts =\> \["10.1.2… --- ## [Stacked bars with percentages not clickable again](https://discuss.elastic.co/t/stacked-bars-with-percentages-not-clickable-again/292914)
**Author:** [@alrubaa](https://discuss.elastic.co/u/alrubaa)\ **Replies:** 1\ **Last updated:** [December 31, 2021, 2:17pm UTC](https://discuss.elastic.co/t/stacked-bars-with-percentages-not-clickable-again/292914 "2021-12-31T14:17:33Z")
Hi All, I recently upgraded Elasticsearch and Kibana to version 7.16.1 due to log4j issue and I noticed that my stacked bars charts with percentages are no longer clickable to filter. I had this issue with version 7.12.… --- ## [Registry not working in filebeat 7.16.1](https://discuss.elastic.co/t/registry-not-working-in-filebeat-7-16-1/292464)
**Author:** [@bbailey](https://discuss.elastic.co/u/bbailey)\ **Replies:** 4\ **Last updated:** [December 31, 2021, 12:16pm UTC](https://discuss.elastic.co/t/registry-not-working-in-filebeat-7-16-1/292464 "2021-12-31T12:16:35Z")
I have recently updated from filebeat 7.7.1 to 7.16.1 running in docker and finding that even though the registry is persisted, each time I restart the filebeat container all logs are being re-read When I reverted from … --- ## [Kibana dev tools appears to ignore the env variable NOPROXY](https://discuss.elastic.co/t/kibana-dev-tools-appears-to-ignore-the-env-variable-noproxy/293165)
**Author:** [@Russell\_Fulton](https://discuss.elastic.co/u/Russell_Fulton)\ **Replies:** 1\ **Last updated:** [December 31, 2021, 10:38am UTC](https://discuss.elastic.co/t/kibana-dev-tools-appears-to-ignore-the-env-variable-noproxy/293165 "2021-12-31T10:38:59Z")
The Linux server on which kibana is running does not have direct internet access. Instead there are a bunch of ENV variable set that most network aware programs use. In particular we set NOPROXY= local.domain. Most o… --- ## [Sample size](https://discuss.elastic.co/t/sample-size/293230)
**Author:** [@Moni](https://discuss.elastic.co/u/Moni)\ **Replies:** 1\ **Last updated:** [December 31, 2021, 10:38am UTC](https://discuss.elastic.co/t/sample-size/293230 "2021-12-31T10:38:08Z")
What is the max value we can enter for disciver:sampleSize? Is 10k the max limit? --- ## [Kibana Markdown Panel Result](https://discuss.elastic.co/t/kibana-markdown-panel-result/293240)
**Author:** [@jennamul90](https://discuss.elastic.co/u/jennamul90)\ **Replies:** 1\ **Last updated:** [December 31, 2021, 10:32am UTC](https://discuss.elastic.co/t/kibana-markdown-panel-result/293240 "2021-12-31T10:32:52Z")
Is there a way to get the result of a panel included in the mark-down? My skills are pretty basic when it comes to using Elastic/Kibana --- ## [Collecting Elasticsearch monitoring data with Metricbeat in docker deployment](https://discuss.elastic.co/t/collecting-elasticsearch-monitoring-data-with-metricbeat-in-docker-deployment/293246)
**Author:** [@Petr.Simik](https://discuss.elastic.co/u/Petr.Simik)\ **Replies:** 0\ **Last updated:** [December 31, 2021, 9:26am UTC](https://discuss.elastic.co/t/collecting-elasticsearch-monitoring-data-with-metricbeat-in-docker-deployment/293246 "2021-12-31T09:26:43Z")
What is the best practice to switch from legacy to metricbeat monitoring for clusters deployed in docker.? How should I modify our docker compose file to incorporate metricbeat for internal Elasticsearch monitoring. Is… --- ## [Kibana failed to start (after upgrade 7.4 \> 7.16)](https://discuss.elastic.co/t/kibana-failed-to-start-after-upgrade-7-4-7-16/293210)
**Author:** [@zebu14](https://discuss.elastic.co/u/zebu14)\ **Replies:** 3\ **Last updated:** [December 31, 2021, 9:01am UTC](https://discuss.elastic.co/t/kibana-failed-to-start-after-upgrade-7-4-7-16/293210 "2021-12-31T09:01:38Z")
Hello, After updating my Elasticsearch nodes from 7.4 to 7.16, I followed the upgrade documentation and upgraded my Kibana node from 7.4 to 7.16 through rpm (rpm -Uvh kibana\[...\].rpm The install process finished and ev… --- ## [Subsecond precision in Elasticsearch/Opensearch](https://discuss.elastic.co/t/subsecond-precision-in-elasticsearch-opensearch/293215)
**Author:** [@rizvaughan](https://discuss.elastic.co/u/rizvaughan)\ **Replies:** 3\ **Last updated:** [December 31, 2021, 8:08am UTC](https://discuss.elastic.co/t/subsecond-precision-in-elasticsearch-opensearch/293215 "2021-12-31T08:08:38Z")
Hello all, I had opened a similar issue before to get sub second precision in Elasticsearch. I wasn't able to send logs in epoch millseconds to Elasticsearch which now I have figured out how to do. Now I have two issue… --- ## [Kibana Dashboard testing](https://discuss.elastic.co/t/kibana-dashboard-testing/293175)
**Author:** [@dhamoust](https://discuss.elastic.co/u/dhamoust)\ **Replies:** 2\ **Last updated:** [December 31, 2021, 3:53am UTC](https://discuss.elastic.co/t/kibana-dashboard-testing/293175 "2021-12-31T03:53:05Z")
How to test charts in dashboard through automation? --- ## [Error on installing Elastic Search](https://discuss.elastic.co/t/error-on-installing-elastic-search/293239)
**Author:** [@syahmi](https://discuss.elastic.co/u/syahmi)\ **Replies:** 0\ **Last updated:** [December 31, 2021, 2:56am UTC](https://discuss.elastic.co/t/error-on-installing-elastic-search/293239 "2021-12-31T02:56:15Z")
Hello, I'm trying to install Elasticsearch on my windows 10 virtual machine. I installed JDK, and already set the environment path. I downloaded the Elasticsearch and run the cli commands for installation as given in th… --- ## [How can we apply ILM to Stack Monitoring indices?](https://discuss.elastic.co/t/how-can-we-apply-ilm-to-stack-monitoring-indices/293231)
**Author:** [@Laurent\_Gauthier](https://discuss.elastic.co/u/Laurent_Gauthier)\ **Replies:** 0\ **Last updated:** [December 30, 2021, 10:20pm UTC](https://discuss.elastic.co/t/how-can-we-apply-ilm-to-stack-monitoring-indices/293231 "2021-12-30T22:20:22Z")
We are using Stack Monitoring on our Elastic Cloud clusters and this is proving very helpful. However, by default, the Stack Monitoring creates new indexes everyday (.monitoring-\*) and we have not found and easy way to c… --- ## [Indexing Performance drop after a few hours](https://discuss.elastic.co/t/indexing-performance-drop-after-a-few-hours/293223)
**Author:** [@stretchy](https://discuss.elastic.co/u/stretchy)\ **Replies:** 8\ **Last updated:** [December 30, 2021, 9:16pm UTC](https://discuss.elastic.co/t/indexing-performance-drop-after-a-few-hours/293223 "2021-12-30T21:16:19Z")
Hi, I'm having an issue with the Elasticsearch after a few hours (2-3 hours). There is a massive performance drop (50%-60%) but no symptoms as to why. Setup: Three nodes: 1 master two data nodes Elasticsearch version… --- ## [New header field in my ElasticSearch log dashboard](https://discuss.elastic.co/t/new-header-field-in-my-elasticsearch-log-dashboard/293191)
**Author:** [@EExisT](https://discuss.elastic.co/u/EExisT)\ **Replies:** 0\ **Last updated:** [December 30, 2021, 9:38am UTC](https://discuss.elastic.co/t/new-header-field-in-my-elasticsearch-log-dashboard/293191 "2021-12-30T09:38:54Z")
Hello, i describe you the scenario. The system involved are: reverse proxy; elastic; kibana suricata logstash Actually i only see, on the kibana dashboard monitoring, traffic incoming with the reverse proxy ip to th… --- ## [Runtime field just stopped returning a value sometime around 4 AM this morning](https://discuss.elastic.co/t/runtime-field-just-stopped-returning-a-value-sometime-around-4-am-this-morning/293224)
**Author:** [@kossde](https://discuss.elastic.co/u/kossde)\ **Replies:** 3\ **Last updated:** [December 30, 2021, 7:03pm UTC](https://discuss.elastic.co/t/runtime-field-just-stopped-returning-a-value-sometime-around-4-am-this-morning/293224 "2021-12-30T19:03:34Z")
I created the following runtime field a couple of days ago and it was working fine. This morning, however it just stopped. The field is blank for all log entries that came in after around 4 AM this morning. Any idea… --- ## [Uninstall elasticsearch and kibana](https://discuss.elastic.co/t/uninstall-elasticsearch-and-kibana/293106)
**Author:** [@alipujaistopo](https://discuss.elastic.co/u/alipujaistopo)\ **Replies:** 6\ **Last updated:** [December 30, 2021, 3:39pm UTC](https://discuss.elastic.co/t/uninstall-elasticsearch-and-kibana/293106 "2021-12-30T15:39:36Z")
so I once had Elasticsearch and activated the trial license. After I uninstalled and reinstalled, this license still seems annoying. So how do I uninstall Elasticsearch completely clean, no more binding trial licenses? --- ## [How data will be distributed among the data nodes](https://discuss.elastic.co/t/how-data-will-be-distributed-among-the-data-nodes/293099)
**Author:** [@NK2812](https://discuss.elastic.co/u/NK2812)\ **Replies:** 8\ **Last updated:** [December 30, 2021, 5:09pm UTC](https://discuss.elastic.co/t/how-data-will-be-distributed-among-the-data-nodes/293099 "2021-12-30T17:09:23Z")
Hi, I have cluster with 3 master nodes and 3 data nodes and when I am trying to add the documents/data to cluster it seems only 2 data nodes are used. I have only one index and it is same for all the data nodes. if yo… --- ## [\[elastic output\] Differences in SSL between 7.9.1 and 7.16.2](https://discuss.elastic.co/t/elastic-output-differences-in-ssl-between-7-9-1-and-7-16-2/293035)
**Author:** [@rockandska](https://discuss.elastic.co/u/rockandska)\ **Replies:** 4\ **Last updated:** [December 30, 2021, 5:07pm UTC](https://discuss.elastic.co/t/elastic-output-differences-in-ssl-between-7-9-1-and-7-16-2/293035 "2021-12-30T17:07:30Z")
Hi, Previously, on 7.9.1, I had a configuration like the one bellow for my output : output { elasticsearch { hosts =\> "https://myhost:9200" index =\> "myindex" user =\> "myuser" password =\> "mypassword"… [Previous page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1108) [Next page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1110)