# Elastic Stack **URL:** https://discuss.elastic.co/c/elastic-stack/81.md?page=1492 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1493 --- ## [Elastic snapshot repository - hidden .snapshot/ directory](https://discuss.elastic.co/t/elastic-snapshot-repository-hidden-snapshot-directory/268306)
**Author:** [@JimJ](https://discuss.elastic.co/u/JimJ)\ **Replies:** 2\ **Last updated:** [March 25, 2021, 9:09am UTC](https://discuss.elastic.co/t/elastic-snapshot-repository-hidden-snapshot-directory/268306 "2021-03-25T09:09:46Z")
Hi, I recently set up a snapshot repository. After a couple of hesitations and tests, I adopted a final setting. And ran the first snaphots after defining my policy. Now, I am facing a disk space issue. I noticed a … --- ## [Fleet setup - cannot enable kibana security](https://discuss.elastic.co/t/fleet-setup-cannot-enable-kibana-security/267117)
**Author:** [@bleed2002](https://discuss.elastic.co/u/bleed2002)\ **Replies:** 4\ **Last updated:** [March 25, 2021, 9:08am UTC](https://discuss.elastic.co/t/fleet-setup-cannot-enable-kibana-security/267117 "2021-03-25T09:08:42Z")
Hi there, I want to try out central management for Elastic Agents, but i cannot get "Kibana security" enabled, although I'm sure it is configured correctly. I'm running the stack on docker (19.03.12), ELK\_VERSION is 7.… --- ## [Server](https://discuss.elastic.co/t/server/268274)
**Author:** [@amazonas\_ecommerce](https://discuss.elastic.co/u/amazonas_ecommerce)\ **Replies:** 2\ **Last updated:** [March 25, 2021, 8:39am UTC](https://discuss.elastic.co/t/server/268274 "2021-03-25T08:39:48Z")
I installed Elasticsearch 7 on the ubunto AWS Lightsail. It's working perfectly on localhost. However, I have Magento2.4 on another EC2 AWS server, but I don't know how to use Elasticsearch on another server, I have alr… --- ## [Kibana Export and Import not working](https://discuss.elastic.co/t/kibana-export-and-import-not-working/268204)
**Author:** [@Automation\_Scripts](https://discuss.elastic.co/u/Automation_Scripts)\ **Replies:** 4\ **Last updated:** [March 25, 2021, 8:10am UTC](https://discuss.elastic.co/t/kibana-export-and-import-not-working/268204 "2021-03-25T08:10:16Z")
Hi guys, Exported some Kibana dashboards and vizualizations from one computer to another and I got the same error while importing the ndjson ==\> Sorry, there was an error The file could not be processed due to error:… --- ## [What is the correct way to specify mappings for "geo point" data type to index geo information documents in an elasticsearch index?](https://discuss.elastic.co/t/what-is-the-correct-way-to-specify-mappings-for-geo-point-data-type-to-index-geo-information-documents-in-an-elasticsearch-index/268200)
**Author:** [@Husnain](https://discuss.elastic.co/u/Husnain)\ **Replies:** 6\ **Last updated:** [March 25, 2021, 8:08am UTC](https://discuss.elastic.co/t/what-is-the-correct-way-to-specify-mappings-for-geo-point-data-type-to-index-geo-information-documents-in-an-elasticsearch-index/268200 "2021-03-25T08:08:52Z")
I have configured a logstash pipeline in which I have used filter "logstash-filter-geoip" for getting geo information about the IP Address.I have specified mapping before indexing documents into elasticsearch but it is s… --- ## [Combine windows registry and log file](https://discuss.elastic.co/t/combine-windows-registry-and-log-file/268236)
**Author:** [@ahmetnash](https://discuss.elastic.co/u/ahmetnash)\ **Replies:** 1\ **Last updated:** [March 25, 2021, 2:46am UTC](https://discuss.elastic.co/t/combine-windows-registry-and-log-file/268236 "2021-03-25T02:46:39Z")
In my windows computer, i am using filebeat to read the content of the application server logs. On the same machine, In the registry field i have also store the version of the application. I want to combine these two da… --- ## [Using \_reindex to convert a string field to a float](https://discuss.elastic.co/t/using-reindex-to-convert-a-string-field-to-a-float/268284)
**Author:** [@drdwilcox](https://discuss.elastic.co/u/drdwilcox)\ **Replies:** 0\ **Last updated:** [March 25, 2021, 1:55am UTC](https://discuss.elastic.co/t/using-reindex-to-convert-a-string-field-to-a-float/268284 "2021-03-25T01:55:46Z")
The subject says it all. I have a field that is intermittently being saved in an index as: { "index\_with\_string" : { "mappings" : { "timeElapsed" : { "full\_name" : "timeElapsed", "mapping" : … --- ## [How to retrieve only latest index](https://discuss.elastic.co/t/how-to-retrieve-only-latest-index/268264)
**Author:** [@harper\_S](https://discuss.elastic.co/u/harper_S)\ **Replies:** 7\ **Last updated:** [March 24, 2021, 10:51pm UTC](https://discuss.elastic.co/t/how-to-retrieve-only-latest-index/268264 "2021-03-24T22:51:30Z")
I have created a python api which will accept the \*.json file. for ex: abc.json { "service\_name": "httpd", "service\_status": "DOWN", "host\_name": "host1", "time": "1616600149.014236" } and, push the da… --- ## [Fix kibana dashboards for filebeat aws module](https://discuss.elastic.co/t/fix-kibana-dashboards-for-filebeat-aws-module/268270)
**Author:** [@EvanGertis](https://discuss.elastic.co/u/EvanGertis)\ **Replies:** 0\ **Last updated:** [March 24, 2021, 10:12pm UTC](https://discuss.elastic.co/t/fix-kibana-dashboards-for-filebeat-aws-module/268270 "2021-03-24T22:12:53Z")
I am very excited about the new dashboards feature for filebeat. I am trying to use custom indicies to differentiate between vpc flow logs, elb access logs, and cloudtrail logs. The issue is that the dashboards do not lo… --- ## [Logstash MongoDB Output Plugin - command insert requires authentication](https://discuss.elastic.co/t/logstash-mongodb-output-plugin-command-insert-requires-authentication/268265)
**Author:** [@christiancj](https://discuss.elastic.co/u/christiancj)\ **Replies:** 1\ **Last updated:** [March 24, 2021, 9:29pm UTC](https://discuss.elastic.co/t/logstash-mongodb-output-plugin-command-insert-requires-authentication/268265 "2021-03-24T21:29:32Z")
I'm using logstash 7.10.2 with MongoDB logstash-output plugin (tested 2 diff versions), I'm trying to write documents from elastic to mongodb, however I'm getting the following errors for each version, plugin version l… --- ## [Ingesting large number of files in a directory using logstash](https://discuss.elastic.co/t/ingesting-large-number-of-files-in-a-directory-using-logstash/268168)
**Author:** [@Razeen](https://discuss.elastic.co/u/Razeen)\ **Replies:** 3\ **Last updated:** [March 24, 2021, 8:24pm UTC](https://discuss.elastic.co/t/ingesting-large-number-of-files-in-a-directory-using-logstash/268168 "2021-03-24T20:24:31Z")
Hi, I have a logstash configuration to ingest large number of json files from a directory. The ingestion works perfectly fine, But for a particular number of json files. For example i pointed the input for a folder wi… --- ## [Elasticsearch 7.2.0 Cluster - Performance Recovery Help](https://discuss.elastic.co/t/elasticsearch-7-2-0-cluster-performance-recovery-help/267472)
**Author:** [@Owen\_Watson](https://discuss.elastic.co/u/Owen_Watson)\ **Replies:** 3\ **Last updated:** [March 24, 2021, 8:13pm UTC](https://discuss.elastic.co/t/elasticsearch-7-2-0-cluster-performance-recovery-help/267472 "2021-03-24T20:13:39Z")
I am new to elasticsearch management and have some issues with a cluster I am working with. Currently, the cluster is recovering from a node failure, but I would like to stop the recovery and delete a handful of indices… --- ## [Using Filebeat with Large JSON logs](https://discuss.elastic.co/t/using-filebeat-with-large-json-logs/268261)
**Author:** [@jamesjuxly](https://discuss.elastic.co/u/jamesjuxly)\ **Replies:** 0\ **Last updated:** [March 24, 2021, 7:58pm UTC](https://discuss.elastic.co/t/using-filebeat-with-large-json-logs/268261 "2021-03-24T19:58:48Z")
Hello, I'm using an ELK stack with filebeat to ship JSON logs from docker containers (kubernetes) to elastic. The problem I'm having is that large log entries seem to be skipped. Is there a setting to change to allow th… --- ## [Import mapping via index template](https://discuss.elastic.co/t/import-mapping-via-index-template/267393)
**Author:** [@Voula\_Mikr](https://discuss.elastic.co/u/Voula_Mikr)\ **Replies:** 4\ **Last updated:** [March 24, 2021, 6:52pm UTC](https://discuss.elastic.co/t/import-mapping-via-index-template/267393 "2021-03-24T18:52:06Z")
I want to import an index template with a mapping for the fields of the index pmdata\* in order to set as type of the field counter\_value float. After the import of the template with counter\_value type float, I imported … --- ## [Reindexing with new nested property changes dot to json representation](https://discuss.elastic.co/t/reindexing-with-new-nested-property-changes-dot-to-json-representation/268256)
**Author:** [@makmnr](https://discuss.elastic.co/u/makmnr)\ **Replies:** 0\ **Last updated:** [March 24, 2021, 6:49pm UTC](https://discuss.elastic.co/t/reindexing-with-new-nested-property-changes-dot-to-json-representation/268256 "2021-03-24T18:49:19Z")
I am trying to reindex in order to make field renames. But there are a lot of challenges as the fields to be renamed and old fields are objects. Following is a sample code to represent the issue: Processor Simulate@POST… --- ## [Splunk data ingestion into Elasticsearch via Logstash behind NLB](https://discuss.elastic.co/t/splunk-data-ingestion-into-elasticsearch-via-logstash-behind-nlb/267654)
**Author:** [@vijay.gvg](https://discuss.elastic.co/u/vijay.gvg)\ **Replies:** 3\ **Last updated:** [March 24, 2021, 6:41pm UTC](https://discuss.elastic.co/t/splunk-data-ingestion-into-elasticsearch-via-logstash-behind-nlb/267654 "2021-03-24T18:41:24Z")
Hi, We wanted to integrate logs from Splunk system into Elasticsearch via Logstash. Following are the steps we used to do the same: Create a Network Load Balancer (NLB) URL with Logstash as backend Configure Splunk for… --- ## [Multiple plot lines Vega Lite Kibana](https://discuss.elastic.co/t/multiple-plot-lines-vega-lite-kibana/268242)
**Author:** [@usman1](https://discuss.elastic.co/u/usman1)\ **Replies:** 1\ **Last updated:** [March 24, 2021, 5:01pm UTC](https://discuss.elastic.co/t/multiple-plot-lines-vega-lite-kibana/268242 "2021-03-24T17:01:34Z")
I am trying to create a two line graph with both of the lines using quantitative attributes. Following is an example of the data I have: \[ {"TIMESTAMP" : "15/07/2020 13:58", "A" : 61, "B" : 70}, {"TIMESTAMP" : … --- ## [Failed to update meta file permissions: chmod /usr/share/filebeat/data/registry/filebeat/meta.json: operation not permitted](https://discuss.elastic.co/t/failed-to-update-meta-file-permissions-chmod-usr-share-filebeat-data-registry-filebeat-meta-json-operation-not-permitted/268244)
**Author:** [@mdeheegher](https://discuss.elastic.co/u/mdeheegher)\ **Replies:** 0\ **Last updated:** [March 24, 2021, 4:41pm UTC](https://discuss.elastic.co/t/failed-to-update-meta-file-permissions-chmod-usr-share-filebeat-data-registry-filebeat-meta-json-operation-not-permitted/268244 "2021-03-24T16:41:31Z")
I am using FileBeat to transfer my kubernetes nginx-ingress controller logs to ElasticSearch. I deploy a pod with a filebeat container in it. I configure the filebeat "path.data" to a fileshare on Azure, to prevent that … --- ## [Logstash shipping issue](https://discuss.elastic.co/t/logstash-shipping-issue/268227)
**Author:** [@jcor](https://discuss.elastic.co/u/jcor)\ **Replies:** 1\ **Last updated:** [March 24, 2021, 4:18pm UTC](https://discuss.elastic.co/t/logstash-shipping-issue/268227 "2021-03-24T16:18:53Z")
Hey folks, I'm having a weird issue that I cant seem to solve. I have multiple winlogbeats shipping event logs to a logstash server which then forwards it to an elastic ingestion node which servers the cluster. Recentl… --- ## [Build filebeat x-pack cannot export dashboard](https://discuss.elastic.co/t/build-filebeat-x-pack-cannot-export-dashboard/227015)
**Author:** [@Mike\_Ware](https://discuss.elastic.co/u/Mike_Ware)\ **Replies:** 1\ **Last updated:** [March 24, 2021, 3:59pm UTC](https://discuss.elastic.co/t/build-filebeat-x-pack-cannot-export-dashboard/227015 "2021-03-24T15:59:36Z")
Once x-pack filebeat is build I cannot export dashboards. ''' MODULE=zeek ID=7cbb5410-3700-11e9-aa6d-ff445a78330c mage exportDashboard Error while connecting to Kibana: fail to get the Kibana version: HTTP GET reques… --- ## [Palo Alto integration with USERID \[SIEM Feature\]](https://discuss.elastic.co/t/palo-alto-integration-with-userid-siem-feature/268173)
**Author:** [@RdrgPorto](https://discuss.elastic.co/u/RdrgPorto)\ **Replies:** 5\ **Last updated:** [March 24, 2021, 3:13pm UTC](https://discuss.elastic.co/t/palo-alto-integration-with-userid-siem-feature/268173 "2021-03-24T15:13:57Z")
Hi, everyone I have been working with Palo Alto and Filebeat over several days. I have looked on Elastic documentation that it currently supports messages of Traffic and Threat types. Is it considered to parsing User-I… --- ## [Store and visualise key value pairs](https://discuss.elastic.co/t/store-and-visualise-key-value-pairs/268005)
**Author:** [@Crystal](https://discuss.elastic.co/u/Crystal)\ **Replies:** 2\ **Last updated:** [March 24, 2021, 3:04pm UTC](https://discuss.elastic.co/t/store-and-visualise-key-value-pairs/268005 "2021-03-24T15:04:11Z")
Hello, I have a set of key value pairs returned from an external API that I would like to store in Elastic and be able to visualize in Kibana. The data is returned from the external API as a JSON object containing mult… --- ## [Numeric value (1.8446744073709552e+19) out of range of long](https://discuss.elastic.co/t/numeric-value-1-8446744073709552e-19-out-of-range-of-long/268229)
**Author:** [@Alex\_Gilko](https://discuss.elastic.co/u/Alex_Gilko)\ **Replies:** 0\ **Last updated:** [March 24, 2021, 2:40pm UTC](https://discuss.elastic.co/t/numeric-value-1-8446744073709552e-19-out-of-range-of-long/268229 "2021-03-24T14:40:08Z")
"reason":"failed to parse field \[body.data.bar\_codes.frame\_id\] of type \[long\] in document with id 'LGaLZHgBVlMsC7cJsQlT'. Preview of field's value: '1.8446744073709552E19'","caused\_by":{"type":"input\_coercion\_exception",… --- ## [Vegalite unable to parse dates in format DD/MM/YYYY](https://discuss.elastic.co/t/vegalite-unable-to-parse-dates-in-format-dd-mm-yyyy/268206)
**Author:** [@usman1](https://discuss.elastic.co/u/usman1)\ **Replies:** 4\ **Last updated:** [March 24, 2021, 2:25pm UTC](https://discuss.elastic.co/t/vegalite-unable-to-parse-dates-in-format-dd-mm-yyyy/268206 "2021-03-24T14:25:40Z")
My log files have the timestamp as 13/10/2020 13:03 and Vegalite visualizations are being broken every time date is more than 12, which means it is taking month as days and vice versa. Following is the line of code I am… --- ## [Kubernetes Events MetricBeat filter duplicate entries](https://discuss.elastic.co/t/kubernetes-events-metricbeat-filter-duplicate-entries/267064)
**Author:** [@webmutation](https://discuss.elastic.co/u/webmutation)\ **Replies:** 5\ **Last updated:** [March 24, 2021, 2:25pm UTC](https://discuss.elastic.co/t/kubernetes-events-metricbeat-filter-duplicate-entries/267064 "2021-03-24T14:25:01Z")
Having setup a default ELK stack on Kubernetes cluster I deployed MetricBeat also as default... everything works well, excepts I get duplicated entries for the same data, due to the daemonSet (I have 3 worker nodes on th… --- ## [Creating Index Lifecycle Policies](https://discuss.elastic.co/t/creating-index-lifecycle-policies/265209)
**Author:** [@zaeemmasood](https://discuss.elastic.co/u/zaeemmasood)\ **Replies:** 13\ **Last updated:** [March 24, 2021, 2:19pm UTC](https://discuss.elastic.co/t/creating-index-lifecycle-policies/265209 "2021-03-24T14:19:46Z")
Hello. On ELK stack 7.6.2, I have a policy set for deleting all indices older than 30 days. The policy was set as follows: PUT \_ilm/policy/cleanup-history { "policy": { "phases": { "hot": { "min\_age… --- ## [Parse json from inside message](https://discuss.elastic.co/t/parse-json-from-inside-message/267269)
**Author:** [@Alex\_Gilko](https://discuss.elastic.co/u/Alex_Gilko)\ **Replies:** 5\ **Last updated:** [March 24, 2021, 2:16pm UTC](https://discuss.elastic.co/t/parse-json-from-inside-message/267269 "2021-03-24T14:16:17Z")
i trying to parse json from inside message . filebeat.autodiscover: providers: - type: docker hints.enabled: true used this in file beat used labels in docker-compose labels: co.elastic.logs/json.keys\_u… --- ## [Unable to start filebeat for apache logs](https://discuss.elastic.co/t/unable-to-start-filebeat-for-apache-logs/268094)
**Author:** [@Shriram\_Wasule](https://discuss.elastic.co/u/Shriram_Wasule)\ **Replies:** 7\ **Last updated:** [March 24, 2021, 2:08pm UTC](https://discuss.elastic.co/t/unable-to-start-filebeat-for-apache-logs/268094 "2021-03-24T14:08:08Z")
i am not able to get solution for error saying "Exiting: Failed to start crawler: creating module reloader failed: 1 error: invalid config: yaml: line 13: could not fin d expected ':'" following is my apache.yml file #… --- ## [Where is log.file.path in the doc?](https://discuss.elastic.co/t/where-is-log-file-path-in-the-doc/268217)
**Author:** [@fabulias](https://discuss.elastic.co/u/fabulias)\ **Replies:** 0\ **Last updated:** [March 24, 2021, 1:40pm UTC](https://discuss.elastic.co/t/where-is-log-file-path-in-the-doc/268217 "2021-03-24T13:40:06Z")
Hi, we're using filebeats for a lot of months, I know when we use log input automatically are created some object fields host agent log Currently, I'm using log.file.path but in specific doesn't appear in the doc. But… --- ## [\[Kibana/Vega\] Map signals latitude, longitude & zoom](https://discuss.elastic.co/t/kibana-vega-map-signals-latitude-longitude-zoom/267796)
**Author:** [@Kayak007](https://discuss.elastic.co/u/Kayak007)\ **Replies:** 3\ **Last updated:** [March 24, 2021, 1:37pm UTC](https://discuss.elastic.co/t/kibana-vega-map-signals-latitude-longitude-zoom/267796 "2021-03-24T13:37:41Z")
Hi, I'm trying to modify the values of the latitude, longitude and zoom signals in order to have a global view of France and then, after a certain time (5s), zoom on a city (Paris in the example below). And back to the … [Previous page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1491) [Next page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1493)