# Elastic Stack **URL:** https://discuss.elastic.co/c/elastic-stack/81.md?page=843 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 844 --- ## [Overwrite @timestamp filed by date and time filed in the CSV file](https://discuss.elastic.co/t/overwrite-timestamp-filed-by-date-and-time-filed-in-the-csv-file/311142)
**Author:** [@Faiz\_Shamri](https://discuss.elastic.co/u/Faiz_Shamri)\ **Replies:** 7\ **Last updated:** [August 2, 2022, 2:42pm UTC](https://discuss.elastic.co/t/overwrite-timestamp-filed-by-date-and-time-filed-in-the-csv-file/311142 "2022-08-02T14:42:43Z")
My logstash conf. file is like the below: input { file { path =\> "/somepath/balance\_20220731.csv" start\_position =\> "beginning" sincedb\_path =\> "/dev/null" } } filter { csv { separator =\> ";" … --- ## [Security rules over remote clusters](https://discuss.elastic.co/t/security-rules-over-remote-clusters/311217)
**Author:** [@Enrico\_Pasqualotto](https://discuss.elastic.co/u/Enrico_Pasqualotto)\ **Replies:** 1\ **Last updated:** [August 2, 2022, 2:37pm UTC](https://discuss.elastic.co/t/security-rules-over-remote-clusters/311217 "2022-08-02T14:37:17Z")
Hello, I've setup an infrastructure with a central Elastic cluster and other remote connected using "Remote clusters" feature. When I create detection rules I set the index pattern like :filebeat to match events also fr… --- ## [Configuration Prometheus data in ElasticSearch via Metricbeats](https://discuss.elastic.co/t/configuration-prometheus-data-in-elasticsearch-via-metricbeats/310222)
**Author:** [@tgkumarmca](https://discuss.elastic.co/u/tgkumarmca)\ **Replies:** 7\ **Last updated:** [August 2, 2022, 2:33pm UTC](https://discuss.elastic.co/t/configuration-prometheus-data-in-elasticsearch-via-metricbeats/310222 "2022-08-02T14:33:02Z")
Sub: We are looking for a solution to push the Prometheus data to Elasticsearch for long term storage. We have deployed Elasticsearch, Metric Beat, prometheus and Grafana on a kubernetes cluster. We need to push prometh… --- ## [Track Visualization and Dashboard Usage and Performance](https://discuss.elastic.co/t/track-visualization-and-dashboard-usage-and-performance/311152)
**Author:** [@Kohlman](https://discuss.elastic.co/u/Kohlman)\ **Replies:** 4\ **Last updated:** [August 2, 2022, 1:46pm UTC](https://discuss.elastic.co/t/track-visualization-and-dashboard-usage-and-performance/311152 "2022-08-02T13:46:31Z")
I've searched and this question has been asked a number of times over the years. The 2 most recent being in September and October 2020. I'd like to be able to see how often users are accessing our various dashboards? A… --- ## [Why a redirection to a hard Kibana URL works but not when the URL is dynamically created](https://discuss.elastic.co/t/why-a-redirection-to-a-hard-kibana-url-works-but-not-when-the-url-is-dynamically-created/311215)
**Author:** [@Vincent92](https://discuss.elastic.co/u/Vincent92)\ **Replies:** 1\ **Last updated:** [August 2, 2022, 1:53pm UTC](https://discuss.elastic.co/t/why-a-redirection-to-a-hard-kibana-url-works-but-not-when-the-url-is-dynamically-created/311215 "2022-08-02T13:53:07Z")
Hello, I'm trying to generate connection urls to go from a home application to specific queries in our Kibana. To do this I already asked the following question on the forum yesterday: previous question I've moved on … --- ## [Transform - List the unique values](https://discuss.elastic.co/t/transform-list-the-unique-values/311132)
**Author:** [@bianca6](https://discuss.elastic.co/u/bianca6)\ **Replies:** 4\ **Last updated:** [August 2, 2022, 1:30pm UTC](https://discuss.elastic.co/t/transform-list-the-unique-values/311132 "2022-08-02T13:30:50Z")
Hi, I'm using a Transform to group logs related to the same event. An event can have multiple IP. A simple aggregation like this: "test\_agg": { "terms": { "field": "vm\_ip" } }, Will list all the possible IP … --- ## [FATAL Error: Cannot find module './mysql\_logs'](https://discuss.elastic.co/t/fatal-error-cannot-find-module-mysql-logs/311131)
**Author:** [@RobertC1](https://discuss.elastic.co/u/RobertC1)\ **Replies:** 2\ **Last updated:** [August 2, 2022, 1:12pm UTC](https://discuss.elastic.co/t/fatal-error-cannot-find-module-mysql-logs/311131 "2022-08-02T13:12:40Z")
Please, can anyone give me a hand. ELK 7.15 version on Ubuntu 20.04 LTS. I had to reinstall the MySQL server 8.0, but when I try to start kibana (systemctl start kibana) in the log apears these lines. Started Kibana. … --- ## [Kibana 8.2.0-Discover page response taking more time compared to query time](https://discuss.elastic.co/t/kibana-8-2-0-discover-page-response-taking-more-time-compared-to-query-time/310843)
**Author:** [@prathibha](https://discuss.elastic.co/u/prathibha)\ **Replies:** 1\ **Last updated:** [August 2, 2022, 12:12pm UTC](https://discuss.elastic.co/t/kibana-8-2-0-discover-page-response-taking-more-time-compared-to-query-time/310843 "2022-08-02T12:12:22Z")
Hello Team, We are upgraded ELK components from 7.16.1 to 8.2.0 and noticed an increase in response time while checking from Discover page. This response is already compressed and still getting delay to get response and… --- ## [Some logs not work with elasticsearch](https://discuss.elastic.co/t/some-logs-not-work-with-elasticsearch/311182)
**Author:** [@White\_Hat](https://discuss.elastic.co/u/White_Hat)\ **Replies:** 5\ **Last updated:** [August 2, 2022, 12:09pm UTC](https://discuss.elastic.co/t/some-logs-not-work-with-elasticsearch/311182 "2022-08-02T12:09:45Z")
I have two logs: {"message":"hello","context":{"user\_id":"xxxxxx","error":{"ERROR":"Invalid x or y"}},"level":400,"level\_name":"ERROR","channel":"production","datetime":"2022-08-02T11:59:02.238022+04:30","extra":{}} an… --- ## [Fleet & Docker - How to maintain state?](https://discuss.elastic.co/t/fleet-docker-how-to-maintain-state/311156)
**Author:** [@DefensiveDepth](https://discuss.elastic.co/u/DefensiveDepth)\ **Replies:** 2\ **Last updated:** [August 2, 2022, 11:55am UTC](https://discuss.elastic.co/t/fleet-docker-how-to-maintain-state/311156 "2022-08-02T11:55:05Z")
I am running Fleet 8.3.3 in a Docker Container, using the docs found here: It appears that every time the container is destroyed and a new one created, a new Fleet server is registered, even if I set the container hostn… --- ## [Logs with the same timestamp wrong located](https://discuss.elastic.co/t/logs-with-the-same-timestamp-wrong-located/311207)
**Author:** [@TaiNguyen](https://discuss.elastic.co/u/TaiNguyen)\ **Replies:** 0\ **Last updated:** [August 2, 2022, 11:25am UTC](https://discuss.elastic.co/t/logs-with-the-same-timestamp-wrong-located/311207 "2022-08-02T11:25:28Z")
Hello! Im using logstash version 7.10.3. Below is my logstash filter config for timstamp match filter { if (\[biz\] and \[log\]\[type\] != "nginx") { grok { match =\> { "messag… --- ## [Lens graph formula missing fit(carry) ability in a formula summing up multiple indexes with sparse data](https://discuss.elastic.co/t/lens-graph-formula-missing-fit-carry-ability-in-a-formula-summing-up-multiple-indexes-with-sparse-data/311192)
**Author:** [@Mark\_Duncan](https://discuss.elastic.co/u/Mark_Duncan)\ **Replies:** 0\ **Last updated:** [August 2, 2022, 9:22am UTC](https://discuss.elastic.co/t/lens-graph-formula-missing-fit-carry-ability-in-a-formula-summing-up-multiple-indexes-with-sparse-data/311192 "2022-08-02T09:22:43Z")
In timelion, if I had 2 indexes of data: a with 1 data point every day at midnight b with 1 data point every hour I could create a graph with hourly intervals, and then sum the 2 indexes together in a single line that… --- ## [Exclude results in search in kibana](https://discuss.elastic.co/t/exclude-results-in-search-in-kibana/310744)
**Author:** [@Romzez](https://discuss.elastic.co/u/Romzez)\ **Replies:** 8\ **Last updated:** [August 2, 2022, 9:20am UTC](https://discuss.elastic.co/t/exclude-results-in-search-in-kibana/310744 "2022-08-02T09:20:41Z")
Hi all. Can someone tell me how to exclude search results? There is a field in which there are 2 values ​​(conditionally) - connected and an error. I need to exclude the results when first there is an error and then conn… --- ## [Logstash s3 output](https://discuss.elastic.co/t/logstash-s3-output/311118)
**Author:** [@Giridharan\_C](https://discuss.elastic.co/u/Giridharan_C)\ **Replies:** 4\ **Last updated:** [August 2, 2022, 8:59am UTC](https://discuss.elastic.co/t/logstash-s3-output/311118 "2022-08-02T08:59:12Z")
My logstash s3 output is not working as defined in the pipeline config. The exact output config is working for other pipelines. The dynamic directory structure(/syslog/%{+YYYY}/%{+MM}/%{+dd}/%{+HH}) defined in the config… --- ## [Convert dates in EJSON format / Access current processed field alias](https://discuss.elastic.co/t/convert-dates-in-ejson-format-access-current-processed-field-alias/311114)
**Author:** [@thomas\_seres\_panda](https://discuss.elastic.co/u/thomas_seres_panda)\ **Replies:** 0\ **Last updated:** [August 1, 2022, 12:26pm UTC](https://discuss.elastic.co/t/convert-dates-in-ejson-format-access-current-processed-field-alias/311114 "2022-08-01T12:26:39Z")
Hi ! I would like to dynamically : match any fields corresponding to a format like "yyyy-MM-dd" add new field by using current processed field : example : add\_field =\> { "\[%{current\_processed\_field\_name}'\_ejson'\]\[$… --- ## [Drill down using vega lite](https://discuss.elastic.co/t/drill-down-using-vega-lite/311187)
**Author:** [@Irwan\_Kurniawan](https://discuss.elastic.co/u/Irwan_Kurniawan)\ **Replies:** 0\ **Last updated:** [August 2, 2022, 8:44am UTC](https://discuss.elastic.co/t/drill-down-using-vega-lite/311187 "2022-08-02T08:44:10Z")
Hi, I want to drill down my chart using Vega Lite. I made a heat map and when I clicked on one point, it will become a filter or it can to move to another dashboard. This is my code, I try to make the simple one when I c… --- ## [Error Generating Encryption Key - Error: ENOENT: no such file or directory](https://discuss.elastic.co/t/error-generating-encryption-key-error-enoent-no-such-file-or-directory/310814)
**Author:** [@aniketdatir](https://discuss.elastic.co/u/aniketdatir)\ **Replies:** 3\ **Last updated:** [August 2, 2022, 8:05am UTC](https://discuss.elastic.co/t/error-generating-encryption-key-error-enoent-no-such-file-or-directory/310814 "2022-08-02T08:05:15Z")
Hi Kibana team, I m trying to generate encryption keyusing below command but getting error ubuntu@host:/usr/share/kibana$ bin/kibana-encryption-keys generate Error: ENOENT: no such file or directory, open '/usr/shar… --- ## [Kibana index corrupted? Should I delete it and restart service?](https://discuss.elastic.co/t/kibana-index-corrupted-should-i-delete-it-and-restart-service/310896)
**Author:** [@Mark\_S](https://discuss.elastic.co/u/Mark_S)\ **Replies:** 6\ **Last updated:** [August 2, 2022, 8:06am UTC](https://discuss.elastic.co/t/kibana-index-corrupted-should-i-delete-it-and-restart-service/310896 "2022-08-02T08:06:23Z")
A newly installed kibana could not create index pattern, so I restarted the service, and then I was not able to connect to 5601. From the logs (see bellow) I suspect that there is a problem with the kibana indices. What… --- ## [ERROR: Unable to create an enrollment token. Elasticsearch node HTTP layer SSL configuration Keystore doesn't contain any PrivateKey entries where the associated certificate is a CA certificateociated certificate is a CA certificate](https://discuss.elastic.co/t/error-unable-to-create-an-enrollment-token-elasticsearch-node-http-layer-ssl-configuration-keystore-doesnt-contain-any-privatekey-entries-where-the-associated-certificate-is-a-ca-certificateociated-certificate-is-a-ca-certificate/311045)
**Author:** [@huzaifa224](https://discuss.elastic.co/u/huzaifa224)\ **Replies:** 2\ **Last updated:** [August 2, 2022, 7:10am UTC](https://discuss.elastic.co/t/error-unable-to-create-an-enrollment-token-elasticsearch-node-http-layer-ssl-configuration-keystore-doesnt-contain-any-privatekey-entries-where-the-associated-certificate-is-a-ca-certificateociated-certificate-is-a-ca-certificate/311045 "2022-08-02T07:10:24Z")
I have installed the elasticsearch and configure the all certificated as mentioned in document but when i tried to generate a token it give the error. However i have already added the Keystore by using the command './b… --- ## [Kibana data values after rollup](https://discuss.elastic.co/t/kibana-data-values-after-rollup/309716)
**Author:** [@thirty2](https://discuss.elastic.co/u/thirty2)\ **Replies:** 8\ **Last updated:** [August 2, 2022, 7:05am UTC](https://discuss.elastic.co/t/kibana-data-values-after-rollup/309716 "2022-08-02T07:05:15Z")
Hi, in an index (raw\_data) where i have raw data i have records every minute. Each record has always the same value for a field called loss \>\>\> LOSS: 100 Then i created a rollup job for raw\_data index, to rollup data… --- ## [Setup.template.name not work](https://discuss.elastic.co/t/setup-template-name-not-work/311160)
**Author:** [@pi314](https://discuss.elastic.co/u/pi314)\ **Replies:** 1\ **Last updated:** [August 2, 2022, 5:22am UTC](https://discuss.elastic.co/t/setup-template-name-not-work/311160 "2022-08-02T05:22:34Z")
I am sending logs to elastic using filebeat but it is not creating the index with the desired name. filebeat version 7.11.0 (amd64), libbeat 7.11.0 \[84c4d4c4034fcb49c1a318ccdc7311d70adee15b built 2021-02-08 22:42:11 +00… --- ## [Cluster monitoring using Elastic Agent](https://discuss.elastic.co/t/cluster-monitoring-using-elastic-agent/311173)
**Author:** [@tahseen\_fatima](https://discuss.elastic.co/u/tahseen_fatima)\ **Replies:** 1\ **Last updated:** [August 2, 2022, 3:51am UTC](https://discuss.elastic.co/t/cluster-monitoring-using-elastic-agent/311173 "2022-08-02T03:51:15Z")
Hi Team, I have a 2 production cluster at 7.16.2v, now I want to do a cluster monitoring using elastic agent. I want to know which will be the good approach for doing cluster monitoring. Cluster monitoring using metr… --- ## [Caused by: java.io.StreamCorruptedException: invalid internal transport message format, got (0,0,0,28);](https://discuss.elastic.co/t/caused-by-java-io-streamcorruptedexception-invalid-internal-transport-message-format-got-0-0-0-28/311071)
**Author:** [@kingjianle](https://discuss.elastic.co/u/kingjianle)\ **Replies:** 11\ **Last updated:** [August 2, 2022, 3:22am UTC](https://discuss.elastic.co/t/caused-by-java-io-streamcorruptedexception-invalid-internal-transport-message-format-got-0-0-0-28/311071 "2022-08-02T03:22:59Z")
Elasticsearch version (6.8.0): Plugins installed: \[elasticsearch-analysis-ik\]6.8.0 JVM version (java version "1.8.0\_333"): OS version (uname -a if on a Unix-like system):Linux localhost.localdomain 3.10.0-1160.el7.x86… --- ## [Number of latitude and longitude in geo\_polygon search](https://discuss.elastic.co/t/number-of-latitude-and-longitude-in-geo-polygon-search/311096)
**Author:** [@yeziblo](https://discuss.elastic.co/u/yeziblo)\ **Replies:** 4\ **Last updated:** [August 2, 2022, 2:54am UTC](https://discuss.elastic.co/t/number-of-latitude-and-longitude-in-geo-polygon-search/311096 "2022-08-02T02:54:52Z")
When I perform a geo\_polygon query, we usually need to give a set of latitude and longitude, and query documents whose geo points are within the geographic polygon. We are considering limiting the number of latitudes an… --- ## [Proper way to dump indices from Elasticsearch and import to another Elasticsearch instance](https://discuss.elastic.co/t/proper-way-to-dump-indices-from-elasticsearch-and-import-to-another-elasticsearch-instance/310938)
**Author:** [@kent010341](https://discuss.elastic.co/u/kent010341)\ **Replies:** 7\ **Last updated:** [August 2, 2022, 2:50am UTC](https://discuss.elastic.co/t/proper-way-to-dump-indices-from-elasticsearch-and-import-to-another-elasticsearch-instance/310938 "2022-08-02T02:50:17Z")
I have a ELK stack deployed with docker container in a private network, and I have to export some of the indices to a device (such as a laptop) and import them to another Elasticsearch instance in another private network… --- ## [Multi-node cluster doesn't see old data](https://discuss.elastic.co/t/multi-node-cluster-doesnt-see-old-data/311092)
**Author:** [@freeman999](https://discuss.elastic.co/u/freeman999)\ **Replies:** 1\ **Last updated:** [August 2, 2022, 2:03am UTC](https://discuss.elastic.co/t/multi-node-cluster-doesnt-see-old-data/311092 "2022-08-02T02:03:58Z")
Hello everyone! I'm just new here. I already have a single-node cluster with Docker. I have two containers: docker ps CONTAINER ID IMAGE COMMAND C… --- ## [Elastic Agent Fortinet Module 7 Hours Delay Log](https://discuss.elastic.co/t/elastic-agent-fortinet-module-7-hours-delay-log/311034)
**Author:** [@godhand](https://discuss.elastic.co/u/godhand)\ **Replies:** 14\ **Last updated:** [August 2, 2022, 1:47am UTC](https://discuss.elastic.co/t/elastic-agent-fortinet-module-7-hours-delay-log/311034 "2022-08-02T01:47:33Z")
Hello, I've installed the Fleet Server, Elastic Agent, and Fortinet module integration. But the log from FortiGate to elastic has a delay of 7 hours. I looked at the logs via Observability -\> Logs -\> Stream, and Analytic… --- ## [Runtime field pitfall](https://discuss.elastic.co/t/runtime-field-pitfall/311155)
**Author:** [@rugenl](https://discuss.elastic.co/u/rugenl)\ **Replies:** 1\ **Last updated:** [August 2, 2022, 1:47am UTC](https://discuss.elastic.co/t/runtime-field-pitfall/311155 "2022-08-02T01:47:09Z")
If you have a runtime field that references a field, be sure to define the mapping for the referenced field. I was using an ECS field that was "always" present in my indices... until there was an ingest problem. When I… --- ## [\[Filebeat\] duplicate output when using queue.disk and restarting](https://discuss.elastic.co/t/filebeat-duplicate-output-when-using-queue-disk-and-restarting/310959)
**Author:** [@Yos](https://discuss.elastic.co/u/Yos)\ **Replies:** 4\ **Last updated:** [August 2, 2022, 12:12am UTC](https://discuss.elastic.co/t/filebeat-duplicate-output-when-using-queue-disk-and-restarting/310959 "2022-08-02T00:12:07Z")
I am facing a problem with duplicate output when using queue.disk with Filebeat and restarting. The contents of filebeat.yml and the operating procedure are as follows filebeat.yml filebeat.inputs: - type: filestream … --- ## [How to list more than 10 option items for filtering in a dashboard](https://discuss.elastic.co/t/how-to-list-more-than-10-option-items-for-filtering-in-a-dashboard/311048)
**Author:** [@rogerlee](https://discuss.elastic.co/u/rogerlee)\ **Replies:** 1\ **Last updated:** [August 1, 2022, 10:45pm UTC](https://discuss.elastic.co/t/how-to-list-more-than-10-option-items-for-filtering-in-a-dashboard/311048 "2022-08-01T22:45:17Z")
HI Experts, I created a series of dashboards. Now I want to use a "options control" to filter the result in dashboards, while the options control can only display 10 options. Is there any measure that I can break throug… [Previous page](https://discuss.elastic.co/c/elastic-stack/81.md?page=842) [Next page](https://discuss.elastic.co/c/elastic-stack/81.md?page=844)