# Elastic Stack **URL:** https://discuss.elastic.co/c/elastic-stack/81.md?page=1699 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1700 --- ## [Orchestration of configuration](https://discuss.elastic.co/t/orchestration-of-configuration/255185)
**Author:** [@djmcgreal](https://discuss.elastic.co/u/djmcgreal)\ **Replies:** 3\ **Last updated:** [November 13, 2020, 6:01am UTC](https://discuss.elastic.co/t/orchestration-of-configuration/255185 "2020-11-13T06:01:58Z")
Hello, How are folks managing configuration of ES and Kibana from source code? For example, we have a number of Spaces, Users, Dashboards, Alerts, Pipeline configurations etc that we want to version and test through di… --- ## [Ingest xml file using Logstash](https://discuss.elastic.co/t/ingest-xml-file-using-logstash/255113)
**Author:** [@Priyanka3](https://discuss.elastic.co/u/Priyanka3)\ **Replies:** 9\ **Last updated:** [November 12, 2020, 8:29pm UTC](https://discuss.elastic.co/t/ingest-xml-file-using-logstash/255113 "2020-11-12T20:29:55Z")
Hi, I am very new to Elastic search and Logstash. But I am trying to ingest using Logstash. My xml file looks something like this \ **Author:** [@anon17386273](https://discuss.elastic.co/u/anon17386273)\ **Replies:** 1\ **Last updated:** [November 13, 2020, 4:12am UTC](https://discuss.elastic.co/t/adaptive-replica-selection-in-es-version-8/255277 "2020-11-13T04:12:33Z") Hi Does anyone know what adaptive replica selection mean? Below was extracted from https://www.elastic.co/guide/en/elasticsearch/reference/master/breaking-changes-8.0.html Search and get requests are now routed to s… --- ## [Kibana is running but can't access 5601 port](https://discuss.elastic.co/t/kibana-is-running-but-cant-access-5601-port/255272)
**Author:** [@spate141](https://discuss.elastic.co/u/spate141)\ **Replies:** 3\ **Last updated:** [November 13, 2020, 3:31am UTC](https://discuss.elastic.co/t/kibana-is-running-but-cant-access-5601-port/255272 "2020-11-13T03:31:30Z")
I'm trying to run the Kibana on 5601 port & seems like ES & Kibana service are running. But I can't access the Kibana portal or the 5601 port. Any suggestion? Elasticsearch: \> curl localhost:9200 { "name" : "node-1",… --- ## [Need suggestion for mapping](https://discuss.elastic.co/t/need-suggestion-for-mapping/255281)
**Author:** [@amanjain](https://discuss.elastic.co/u/amanjain)\ **Replies:** 0\ **Last updated:** [November 13, 2020, 3:03am UTC](https://discuss.elastic.co/t/need-suggestion-for-mapping/255281 "2020-11-13T03:03:12Z")
Hi I am using category, which is a hierarchical field represented as level1\>level2\>level3\>level4 I want to make a query that can apply filter on level2 or level3 individually. So, I am using simple\_pattern\_split tokeni… --- ## [Unable to start Elasticsearch 7.9.3](https://discuss.elastic.co/t/unable-to-start-elasticsearch-7-9-3/255280)
**Author:** [@mdAsh](https://discuss.elastic.co/u/mdAsh)\ **Replies:** 0\ **Last updated:** [November 13, 2020, 2:45am UTC](https://discuss.elastic.co/t/unable-to-start-elasticsearch-7-9-3/255280 "2020-11-13T02:45:37Z")
Hi, Faced similar issue by: https://discuss.elastic.co/t/unable-to-start-elasticsearch-7-6-2/254128 https://discuss.elastic.co/t/rpm-upgrade-from-7-1-1-to-7-5-0-fatal-error/210419 MainError: Caused by: java.security… --- ## [Metricbeat 7.8 | aws.rds | cpu intermittently missing from multiple events](https://discuss.elastic.co/t/metricbeat-7-8-aws-rds-cpu-intermittently-missing-from-multiple-events/255271)
**Author:** [@william.shipman](https://discuss.elastic.co/u/william.shipman)\ **Replies:** 0\ **Last updated:** [November 12, 2020, 11:56pm UTC](https://discuss.elastic.co/t/metricbeat-7-8-aws-rds-cpu-intermittently-missing-from-multiple-events/255271 "2020-11-12T23:56:35Z")
I'm using metricbeat's AWS module to scrape rds data from cloudwatch for multiple aurora databases. I'm currently seeing events missing cpu data at the same time, across multiple database instances, even while the events… --- ## [Fatal Error Block in setup after succesfull connection](https://discuss.elastic.co/t/fatal-error-block-in-setup-after-succesfull-connection/255255)
**Author:** [@Kiwito](https://discuss.elastic.co/u/Kiwito)\ **Replies:** 3\ **Last updated:** [November 12, 2020, 11:49pm UTC](https://discuss.elastic.co/t/fatal-error-block-in-setup-after-succesfull-connection/255255 "2020-11-12T23:49:24Z")
Hi there, I have been trying to solve this problem for a day. I couldn't find any solutions. \[2020-11-12T20:07:47,943\]\[INFO \]\[logstash.filters.geoip \]\[main\] Using geoip database {:path=\>"/opt/logstash/vendor/geoi… --- ## [How to convert strings to time format](https://discuss.elastic.co/t/how-to-convert-strings-to-time-format/255267)
**Author:** [@Stephenson](https://discuss.elastic.co/u/Stephenson)\ **Replies:** 0\ **Last updated:** [November 12, 2020, 11:01pm UTC](https://discuss.elastic.co/t/how-to-convert-strings-to-time-format/255267 "2020-11-12T23:01:31Z")
Hello everyone, Since a few months, I started working with logstash to small programs like reading a log. I have some trouble understanding the development. I have this line of log. 08:19:1915 , Error trae\_1dato I… --- ## [Cisco IOS Filebeat Indexing Error](https://discuss.elastic.co/t/cisco-ios-filebeat-indexing-error/255260)
**Author:** [@savethebyte](https://discuss.elastic.co/u/savethebyte)\ **Replies:** 2\ **Last updated:** [November 12, 2020, 10:28pm UTC](https://discuss.elastic.co/t/cisco-ios-filebeat-indexing-error/255260 "2020-11-12T22:28:15Z")
I am saving logs to a file via syslog-ng (for other reasons). Filebeat is using that file as a source for cisco-ios logs. I am using the official Cisco module but when I am loading cisco-ios logs, I am getting a parsing … --- ## [Kibana internal server error at login](https://discuss.elastic.co/t/kibana-internal-server-error-at-login/254695)
**Author:** [@ofer-dev](https://discuss.elastic.co/u/ofer-dev)\ **Replies:** 3\ **Last updated:** [November 12, 2020, 10:01pm UTC](https://discuss.elastic.co/t/kibana-internal-server-error-at-login/254695 "2020-11-12T22:01:38Z")
Hi, I'm getting this error on a fresh install of Kibana: OS is ubuntu 20.04 Version: 7.9.3 Build: 34038 Error at Fetch.\_callee3$ (https://lane-concept-vic-illustration.trycloudflare.com/34038/bundles/core/core.ent… --- ## [JWT Support in Beats](https://discuss.elastic.co/t/jwt-support-in-beats/254825)
**Author:** [@cchandak](https://discuss.elastic.co/u/cchandak)\ **Replies:** 2\ **Last updated:** [November 12, 2020, 9:38pm UTC](https://discuss.elastic.co/t/jwt-support-in-beats/254825 "2020-11-12T21:38:32Z")
I would like to scrape logs using Beats (either Filebeat, Metricbeat, etc.) and send them to Logstash or Kafka depending on my use case. Currently, I am leveraging the SSL support, but I would like to use JSON Web Token … --- ## [Filebeat running as root, but not ingesting all logs](https://discuss.elastic.co/t/filebeat-running-as-root-but-not-ingesting-all-logs/254583)
**Author:** [@droidus](https://discuss.elastic.co/u/droidus)\ **Replies:** 3\ **Last updated:** [November 12, 2020, 9:20pm UTC](https://discuss.elastic.co/t/filebeat-running-as-root-but-not-ingesting-all-logs/254583 "2020-11-12T21:20:15Z")
I am running Ubuntu, and I noticed in Kibana, it is only monitoring two files: kern.log and auth.log. Here are what the file permissions look like: -rw-r----- 1 syslog adm. Doing a ps aux, I get this: root 17888… --- ## [Mechanisms behind async\_search](https://discuss.elastic.co/t/mechanisms-behind-async-search/255254)
**Author:** [@alexpanas](https://discuss.elastic.co/u/alexpanas)\ **Replies:** 0\ **Last updated:** [November 12, 2020, 8:11pm UTC](https://discuss.elastic.co/t/mechanisms-behind-async-search/255254 "2020-11-12T20:11:13Z")
Hello, Could you please elaborate more about the mechanisms behind the current implementation of async search in Elasticsearch 7.8? As far as I can see - in our environment the .async\_search index has grew up to 40 Gb … --- ## [No cached mapping Error](https://discuss.elastic.co/t/no-cached-mapping-error/254694)
**Author:** [@droidus](https://discuss.elastic.co/u/droidus)\ **Replies:** 7\ **Last updated:** [November 12, 2020, 7:43pm UTC](https://discuss.elastic.co/t/no-cached-mapping-error/254694 "2020-11-12T19:43:02Z")
I am getting this message on my filebeats index. I went to Management \> Selected Index, then Refresh. But I still see this error. For example, I am looking for the log.file.path. Strange thing is, when I go to search… --- ## [Aggregate filter question](https://discuss.elastic.co/t/aggregate-filter-question/255250)
**Author:** [@mohsin106](https://discuss.elastic.co/u/mohsin106)\ **Replies:** 0\ **Last updated:** [November 12, 2020, 6:49pm UTC](https://discuss.elastic.co/t/aggregate-filter-question/255250 "2020-11-12T18:49:32Z")
Hi, on the aggregate filter page the following is stated under the How it works section: " an aggregate map is tied to one task\_id value which is tied to one task\_id pattern. So if you have 2 filters with different task… --- ## [Kibana canvas json inside table](https://discuss.elastic.co/t/kibana-canvas-json-inside-table/255117)
**Author:** [@Carlos\_Fernando\_Palm](https://discuss.elastic.co/u/Carlos_Fernando_Palm)\ **Replies:** 2\ **Last updated:** [November 12, 2020, 6:43pm UTC](https://discuss.elastic.co/t/kibana-canvas-json-inside-table/255117 "2020-11-12T18:43:16Z")
Hello, I am logging a variable as a json: But when I use a query to show in a canvas table I lose the new line characters: Is there a way to prevent that from happening? --- ## [How to set “\_id” value in elasticsearch document as my custom document id](https://discuss.elastic.co/t/how-to-set-id-value-in-elasticsearch-document-as-my-custom-document-id/254944)
**Author:** [@smruthip](https://discuss.elastic.co/u/smruthip)\ **Replies:** 8\ **Last updated:** [November 12, 2020, 6:35pm UTC](https://discuss.elastic.co/t/how-to-set-id-value-in-elasticsearch-document-as-my-custom-document-id/254944 "2020-11-12T18:35:15Z")
Can I do this outside in my python script before I send the data to elastic search? --- ## [Reports from a machine learning show it on a dashboard](https://discuss.elastic.co/t/reports-from-a-machine-learning-show-it-on-a-dashboard/255247)
**Author:** [@Juan\_David\_Jaramillo](https://discuss.elastic.co/u/Juan_David_Jaramillo)\ **Replies:** 1\ **Last updated:** [November 12, 2020, 6:07pm UTC](https://discuss.elastic.co/t/reports-from-a-machine-learning-show-it-on-a-dashboard/255247 "2020-11-12T18:07:40Z")
hello good day how can i make reports of a machine learning, i try to make a visualization with tsvb, but i don't know very well how it goes, what i need is to be able to make reports of a machine learning that is to sa… --- ## [Dynamic Watcher for Memory Metrics](https://discuss.elastic.co/t/dynamic-watcher-for-memory-metrics/255045)
**Author:** [@mdamera](https://discuss.elastic.co/u/mdamera)\ **Replies:** 3\ **Last updated:** [November 12, 2020, 5:52pm UTC](https://discuss.elastic.co/t/dynamic-watcher-for-memory-metrics/255045 "2020-11-12T17:52:12Z")
Team, I need to create a Dynamic watcher for below two metrics # jolokia.jvm.memory.heap.max 8,589,934,592 # jolokia.jvm.memory.heap.used 1,090,388,992 I need an watcher alert when jolokia.jvm.memory.heap.… --- ## [Bulk inserts bring down query performance](https://discuss.elastic.co/t/bulk-inserts-bring-down-query-performance/255248)
**Author:** [@Eric\_Bowden](https://discuss.elastic.co/u/Eric_Bowden)\ **Replies:** 2\ **Last updated:** [November 12, 2020, 5:39pm UTC](https://discuss.elastic.co/t/bulk-inserts-bring-down-query-performance/255248 "2020-11-12T17:39:00Z")
Our application occasionally performs large volumes of index insert/updates, it could be in the range of 10,000. To speed this up, we're allocating the upload/insert work across 10 threads, running continuously until al… --- ## [Elasticsearch Filter: Facing issue when using elasticsearch filter with logstash](https://discuss.elastic.co/t/elasticsearch-filter-facing-issue-when-using-elasticsearch-filter-with-logstash/255227)
**Author:** [@rainman](https://discuss.elastic.co/u/rainman)\ **Replies:** 9\ **Last updated:** [November 12, 2020, 5:15pm UTC](https://discuss.elastic.co/t/elasticsearch-filter-facing-issue-when-using-elasticsearch-filter-with-logstash/255227 "2020-11-12T17:15:43Z")
I am using Logstash to pull data from the Oracle database and process some validation and index into Elasticsearch. I have to update the existing document in the index if the "ID" exists. For that, I am using Elasticsea… --- ## [I no longer get alerts in my mail,](https://discuss.elastic.co/t/i-no-longer-get-alerts-in-my-mail/255246)
**Author:** [@Juan\_David\_Jaramillo](https://discuss.elastic.co/u/Juan_David_Jaramillo)\ **Replies:** 0\ **Last updated:** [November 12, 2020, 5:04pm UTC](https://discuss.elastic.co/t/i-no-longer-get-alerts-in-my-mail/255246 "2020-11-12T17:04:24Z")
I mistakenly unsubscribed from an alert email, but I added my email in elastic again but I still don't get the alerts. --- ## [Shorten URL permissions?](https://discuss.elastic.co/t/shorten-url-permissions/255241)
**Author:** [@lamp123432](https://discuss.elastic.co/u/lamp123432)\ **Replies:** 1\ **Last updated:** [November 12, 2020, 4:58pm UTC](https://discuss.elastic.co/t/shorten-url-permissions/255241 "2020-11-12T16:58:18Z")
How can I allow my read-only users to use the "shorten URL" feature when sharing? I don't want my users to be able to modify the dashboards, but they need to shorten the URLs because they are way too long. Thanks! --- ## [Kibana and offline OpenStreetMap serveur](https://discuss.elastic.co/t/kibana-and-offline-openstreetmap-serveur/255169)
**Author:** [@Simon\_Poirier](https://discuss.elastic.co/u/Simon_Poirier)\ **Replies:** 5\ **Last updated:** [November 12, 2020, 4:38pm UTC](https://discuss.elastic.co/t/kibana-and-offline-openstreetmap-serveur/255169 "2020-11-12T16:38:30Z")
Hi to all ! I build my own offline OpenStreetMap server in a virutal machine following switc2osm tutorial and it works fine. the tutorial here : switch2osm I build a second virtual machine whith Elastic search and kib… --- ## [Index templates lifecycle management](https://discuss.elastic.co/t/index-templates-lifecycle-management/254950)
**Author:** [@Craig2188](https://discuss.elastic.co/u/Craig2188)\ **Replies:** 5\ **Last updated:** [November 12, 2020, 4:38pm UTC](https://discuss.elastic.co/t/index-templates-lifecycle-management/254950 "2020-11-12T16:38:24Z")
I created an Index lifecycle policy to delete logs file entries older than 93 days to help with disk space and retention policies. I noticed that I need to create an index template to link to the policy, so I create… --- ## [502 Bad Gateway](https://discuss.elastic.co/t/502-bad-gateway/255236)
**Author:** [@erin\_verbeck](https://discuss.elastic.co/u/erin_verbeck)\ **Replies:** 1\ **Last updated:** [November 12, 2020, 4:38pm UTC](https://discuss.elastic.co/t/502-bad-gateway/255236 "2020-11-12T16:38:00Z")
Continuing the discussion from 502 Bad Gateway: Has anyone discovered a solution to persistent 502 Bad Gateways in Kibana? We are running ES and Kibana v 7.4, and have had this problem since starting our cluster in Apri… --- ## [Performance impact when encapsulating two bool query](https://discuss.elastic.co/t/performance-impact-when-encapsulating-two-bool-query/255239)
**Author:** [@Scylanth](https://discuss.elastic.co/u/Scylanth)\ **Replies:** 0\ **Last updated:** [November 12, 2020, 4:22pm UTC](https://discuss.elastic.co/t/performance-impact-when-encapsulating-two-bool-query/255239 "2020-11-12T16:22:26Z")
Hello, I am doing a search on an index with a filter on a field which is a text with a field analyzer. In my query I want to have all the records which contains exactly both of the fields I have specified in my query, o… --- ## [Kibana Alerting Missing Issue](https://discuss.elastic.co/t/kibana-alerting-missing-issue/254840)
**Author:** [@jaeyunkim](https://discuss.elastic.co/u/jaeyunkim)\ **Replies:** 3\ **Last updated:** [November 12, 2020, 4:34pm UTC](https://discuss.elastic.co/t/kibana-alerting-missing-issue/254840 "2020-11-12T16:34:13Z")
Hi, I'm monitoring the log alarm through Kibana. But there is a problem. There are times when the alarm doesn't come from Kibana. When I checked if there was no log, it was there. The alarm is set to activate once a… --- ## [Undefined method \`get' for](https://discuss.elastic.co/t/undefined-method-get-for/255214)
**Author:** [@ankitdevnalkar](https://discuss.elastic.co/u/ankitdevnalkar)\ **Replies:** 12\ **Last updated:** [November 12, 2020, 4:32pm UTC](https://discuss.elastic.co/t/undefined-method-get-for/255214 "2020-11-12T16:32:47Z")
I am facing bellow error while using http\_poller. I am trying to pull cloudflare API logs in json format. Here is my .conf file. I am using logstash 7.9.2 and logstash-input-http\_poller (5.0.2) Can anyone please help ? … [Previous page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1698) [Next page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1700)