# Latest

**URL:** https://discuss.elastic.co/latest.md?page=1697

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1698

---

## [Confused about ilm, index templates and new indices](https://discuss.elastic.co/t/confused-about-ilm-index-templates-and-new-indices/271996)

<div class="topic-metadata">

**Author:** [@tterranigma](https://discuss.elastic.co/u/tterranigma)\
**Replies:** 0\
**Last updated:** [May 3, 2021, 1:57pm UTC](https://discuss.elastic.co/t/confused-about-ilm-index-templates-and-new-indices/271996 "2021-05-03T13:57:56Z")

</div>

I have a serve where I install some beats (e.g. packetbeat) but I don't enable the systemd service. I only use packetbeat setup --index-management on this server so that the packetbeat index template and the ILM policy g…

---

## [Multi Engine Search Query](https://discuss.elastic.co/t/multi-engine-search-query/271155)

<div class="topic-metadata">

**Author:** [@elasticuser7](https://discuss.elastic.co/u/elasticuser7)\
**Replies:** 2\
**Last updated:** [May 3, 2021, 11:22pm UTC](https://discuss.elastic.co/t/multi-engine-search-query/271155 "2021-05-03T23:22:54Z")

</div>

Is it possible to query across multiple engines in site search? i.e. by either specifying multiple engines in the query URL or multiple engine keys? Or is it only possible to query each engine using a separate query req…

---

## [Failed to start Kibana with HTTPS](https://discuss.elastic.co/t/failed-to-start-kibana-with-https/271943)

<div class="topic-metadata">

**Author:** [@Farid\_N](https://discuss.elastic.co/u/Farid_N)\
**Replies:** 12\
**Last updated:** [May 3, 2021, 10:48pm UTC](https://discuss.elastic.co/t/failed-to-start-kibana-with-https/271943 "2021-05-03T22:48:30Z")

</div>

Hi I have a cluster with two nodes and two nginx I configured ssl tls and https between 2nodes and kibana, but unfortunately my kibana does not open :frowning\_face: I followed step by step with the bellow link: This…

---

## [Modify documents of a datastream index](https://discuss.elastic.co/t/modify-documents-of-a-datastream-index/271490)

<div class="topic-metadata">

**Author:** [@Reggaeny](https://discuss.elastic.co/u/Reggaeny)\
**Replies:** 4\
**Last updated:** [May 3, 2021, 10:47pm UTC](https://discuss.elastic.co/t/modify-documents-of-a-datastream-index/271490 "2021-05-03T22:47:45Z")

</div>

Coming from classic SQL and NoSql databases, I thought it must be possible to change documents in Elasticsearch datastream indexes. The first attempt via update\_by\_query (REST-Api) worked in the test but not in productiv…

---

## [Report from Kibana connected to Elastic Cloud - Failed to decrypt report job data](https://discuss.elastic.co/t/report-from-kibana-connected-to-elastic-cloud-failed-to-decrypt-report-job-data/272026)

<div class="topic-metadata">

**Author:** [@dimitris\_sb](https://discuss.elastic.co/u/dimitris_sb)\
**Replies:** 5\
**Last updated:** [May 3, 2021, 10:39pm UTC](https://discuss.elastic.co/t/report-from-kibana-connected-to-elastic-cloud-failed-to-decrypt-report-job-data/272026 "2021-05-03T22:39:02Z")

</div>

Hi All, I noticed the following error on a custom Kibana which is connected to Elastic Cloud elasticsearch instance. Reverse proxy exposes port 80 and then Cloudflare provides https connection. Therefore, I have set #…

---

## [Force logstash to restart after "Pipeline aborted due to error"](https://discuss.elastic.co/t/force-logstash-to-restart-after-pipeline-aborted-due-to-error/272007)

<div class="topic-metadata">

**Author:** [@wmd](https://discuss.elastic.co/u/wmd)\
**Replies:** 4\
**Last updated:** [May 3, 2021, 9:45pm UTC](https://discuss.elastic.co/t/force-logstash-to-restart-after-pipeline-aborted-due-to-error/272007 "2021-05-03T21:45:51Z")

</div>

Logstash v6.3.1 is logging this at startup and then getting stuck forever: Sending Logstash's logs to /usr/share/logstash/logs which is now configured via log4j2.properties \[2021-04-30T13:05:39,258\]\[ERROR\]\[logstash.pipe…

---

## [Managing Endpoints Monitored by Heartbeat](https://discuss.elastic.co/t/managing-endpoints-monitored-by-heartbeat/271019)

<div class="topic-metadata">

**Author:** [@Tim\_Mobley](https://discuss.elastic.co/u/Tim_Mobley)\
**Replies:** 1\
**Last updated:** [May 3, 2021, 8:47pm UTC](https://discuss.elastic.co/t/managing-endpoints-monitored-by-heartbeat/271019 "2021-05-03T20:47:46Z")

</div>

Is a more dynamic way to manage hostnames or IPs monitored by Heartbeat other than putting them in the hosts list in the files found in the monitors.d folder? There appears to be a character limit for that array, which i…

---

## [Metricbeat for MySQL fails - "missing required field accessing '0.queries'"](https://discuss.elastic.co/t/metricbeat-for-mysql-fails-missing-required-field-accessing-0-queries/271895)

<div class="topic-metadata">

**Author:** [@rudimk](https://discuss.elastic.co/u/rudimk)\
**Replies:** 2\
**Last updated:** [May 3, 2021, 8:33pm UTC](https://discuss.elastic.co/t/metricbeat-for-mysql-fails-missing-required-field-accessing-0-queries/271895 "2021-05-03T20:33:31Z")

</div>

Hello! I'm setting up Metricbeats on Ubuntu 18.04 to track metrics for a MySQL database. Unfortunately, starting the agent fails with the following error: May 02 11:08:07 ubuntu metricbeat\[69057\]: 2021-05-02T11:08:07.9…

---

## [Kibana not loading after providing credential, It is coming back to login page itself](https://discuss.elastic.co/t/kibana-not-loading-after-providing-credential-it-is-coming-back-to-login-page-itself/267086)

<div class="topic-metadata">

**Author:** [@r\_aravind](https://discuss.elastic.co/u/r_aravind)\
**Replies:** 10\
**Last updated:** [May 3, 2021, 7:53pm UTC](https://discuss.elastic.co/t/kibana-not-loading-after-providing-credential-it-is-coming-back-to-login-page-itself/267086 "2021-05-03T19:53:43Z")

</div>

I have setup my ELK stack kibana instance in Azure kubernetes. I have exposed my kibana service to external load balancer and accessing the load balancer service using DNS from NGINX ingress. I have tried accessing elas…

---

## [Control over writing data to a specific drive](https://discuss.elastic.co/t/control-over-writing-data-to-a-specific-drive/271695)

<div class="topic-metadata">

**Author:** [@Abhishek\_Shinde](https://discuss.elastic.co/u/Abhishek_Shinde)\
**Replies:** 6\
**Last updated:** [May 3, 2021, 7:52pm UTC](https://discuss.elastic.co/t/control-over-writing-data-to-a-specific-drive/271695 "2021-05-03T19:52:36Z")

</div>

We are planning to use single node Elasticsearch cluster. The node may contain multiple locations for writing indexing data. I would like to know, if it is possible to write the data to a specific indexing location only…

---

## [Auto\_flush\_interval with ordered pipeline](https://discuss.elastic.co/t/auto-flush-interval-with-ordered-pipeline/271924)

<div class="topic-metadata">

**Author:** [@roua.B](https://discuss.elastic.co/u/roua.B)\
**Replies:** 3\
**Last updated:** [May 3, 2021, 7:41pm UTC](https://discuss.elastic.co/t/auto-flush-interval-with-ordered-pipeline/271924 "2021-05-03T19:41:34Z")

</div>

Hello, So I was facing an issue with logstash not parsing the last line of my xml log file. I found that the answer would be to add auto\_flush\_interval =\> 1 to my multiline codec. I would like my pipeline to be ordered …

---

## [Hosting Elastic Maps Service Locally with 7.12](https://discuss.elastic.co/t/hosting-elastic-maps-service-locally-with-7-12/270401)

<div class="topic-metadata">

**Author:** [@Chris6](https://discuss.elastic.co/u/Chris6)\
**Replies:** 9\
**Last updated:** [May 3, 2021, 6:31pm UTC](https://discuss.elastic.co/t/hosting-elastic-maps-service-locally-with-7-12/270401 "2021-05-03T18:31:00Z")

</div>

I am trying to host elastic maps service locally with the new way to host the service on your my infrastructure. I have been following this guide Connect to Elastic Maps Service | Kibana Guide \[8.11\] | Elastic and have h…

---

## [Logstash mongodb output plugin fails to authenticate](https://discuss.elastic.co/t/logstash-mongodb-output-plugin-fails-to-authenticate/272014)

<div class="topic-metadata">

**Author:** [@aaron-dsouza](https://discuss.elastic.co/u/aaron-dsouza)\
**Replies:** 0\
**Last updated:** [May 3, 2021, 6:09pm UTC](https://discuss.elastic.co/t/logstash-mongodb-output-plugin-fails-to-authenticate/272014 "2021-05-03T18:09:43Z")

</div>

I'm using the logstash mongodb output plugin to write documents to Azure cosmos DB. I am facing the exact same issue as reported here Logstash MongoDB Output Plugin - command insert requires authentication Here is my co…

---

## [Disk threshold](https://discuss.elastic.co/t/disk-threshold/271414)

<div class="topic-metadata">

**Author:** [@Abhishek\_Shinde](https://discuss.elastic.co/u/Abhishek_Shinde)\
**Replies:** 6\
**Last updated:** [May 3, 2021, 5:57pm UTC](https://discuss.elastic.co/t/disk-threshold/271414 "2021-05-03T17:57:35Z")

</div>

We are trying to implement single node cluster of Elasticsearch per installation of our application. Our application is on-prem. I was looking at the indexing data location parameters in the Elastic documentation. I came…

---

## [IP based failover in Logstash](https://discuss.elastic.co/t/ip-based-failover-in-logstash/271978)

<div class="topic-metadata">

**Author:** [@Debarati\_Goswami](https://discuss.elastic.co/u/Debarati_Goswami)\
**Replies:** 3\
**Last updated:** [May 3, 2021, 5:49pm UTC](https://discuss.elastic.co/t/ip-based-failover-in-logstash/271978 "2021-05-03T17:49:29Z")

</div>

Hi All , I have a requirement to collect logs from various sources into Logstash cluster (of 6 nodes) of which 4 nodes are for 4 different types of logs (rsyslog , IPFIX , SFTP and FluentD) and the last two nodes would …

---

## [List all the stale data that is no longer referenced by existing snapshots](https://discuss.elastic.co/t/list-all-the-stale-data-that-is-no-longer-referenced-by-existing-snapshots/271988)

<div class="topic-metadata">

**Author:** [@Aeres-u99](https://discuss.elastic.co/u/Aeres-u99)\
**Replies:** 4\
**Last updated:** [May 3, 2021, 5:48pm UTC](https://discuss.elastic.co/t/list-all-the-stale-data-that-is-no-longer-referenced-by-existing-snapshots/271988 "2021-05-03T17:48:34Z")

</div>

We have a small setup where in we have been taking snapshots since last two years and I would like to clean it up to make some storage space on our backup server. I was going through this documentation Clean up snapsho…

---

## [Kibana not loading completely](https://discuss.elastic.co/t/kibana-not-loading-completely/271923)

<div class="topic-metadata">

**Author:** [@soberCoder](https://discuss.elastic.co/u/soberCoder)\
**Replies:** 3\
**Last updated:** [May 3, 2021, 5:03pm UTC](https://discuss.elastic.co/t/kibana-not-loading-completely/271923 "2021-05-03T17:03:26Z")

</div>

Hi, Kibana is loading half of the calls and only a blank screen is visible to the user(after the loading logo, nothing loads). I am working with ELK Stack version = 7.10.2 I am trying to share dashboards with reverse…

---

## [Change mapping of a list of indices (rollover)](https://discuss.elastic.co/t/change-mapping-of-a-list-of-indices-rollover/271614)

<div class="topic-metadata">

**Author:** [@samia](https://discuss.elastic.co/u/samia)\
**Replies:** 7\
**Last updated:** [May 3, 2021, 4:36pm UTC](https://discuss.elastic.co/t/change-mapping-of-a-list-of-indices-rollover/271614 "2021-05-03T16:36:13Z")

</div>

Hi, I'm using Elastic 7.11 I have a series of indices (not DataStreams) which rollover through an ILM policy. There's a legacy index template which refer to them. I would like to change the mapping of the future ind…

---

## [Cluster is frequently lost with no master and data nodes removed after upgrade from 7.2.1 to 7.10.2](https://discuss.elastic.co/t/cluster-is-frequently-lost-with-no-master-and-data-nodes-removed-after-upgrade-from-7-2-1-to-7-10-2/271907)

<div class="topic-metadata">

**Author:** [@rpremnath](https://discuss.elastic.co/u/rpremnath)\
**Replies:** 5\
**Last updated:** [May 3, 2021, 4:46pm UTC](https://discuss.elastic.co/t/cluster-is-frequently-lost-with-no-master-and-data-nodes-removed-after-upgrade-from-7-2-1-to-7-10-2/271907 "2021-05-03T16:46:13Z")

</div>

we are testing upgrade of Elasticsearch from 7.2.1 to 7.10.2 and we have developed custom Rollup and Alias management plugin using NodeClient. In our 3 node set up, all nodes are master, data, ingest nodes. We did not ha…

---

## [Automatic Agent Configuration Options are not working](https://discuss.elastic.co/t/automatic-agent-configuration-options-are-not-working/269862)

<div class="topic-metadata">

**Author:** [@Kevin\_Christopher](https://discuss.elastic.co/u/Kevin_Christopher)\
**Replies:** 4\
**Last updated:** [April 19, 2021, 4:06pm UTC](https://discuss.elastic.co/t/automatic-agent-configuration-options-are-not-working/269862 "2021-04-19T16:06:32Z")

</div>

Kibana version: 7.12 Elasticsearch version: 7.12 APM Server version: 7.12 APM Agent language and version: 1.21.0 Browser version: Chrome 86 Original install method (e.g. download page, yum, deb, from source, et…

---

## [Looking for a way to autocreate visualizations on kibana](https://discuss.elastic.co/t/looking-for-a-way-to-autocreate-visualizations-on-kibana/271839)

<div class="topic-metadata">

**Author:** [@Shreesh\_Narayanan](https://discuss.elastic.co/u/Shreesh_Narayanan)\
**Replies:** 2\
**Last updated:** [May 3, 2021, 4:17pm UTC](https://discuss.elastic.co/t/looking-for-a-way-to-autocreate-visualizations-on-kibana/271839 "2021-05-03T16:17:16Z")

</div>

Is there a way to autocreate visualizations on Kibana .? I have a considerable amount of logs from different machines that follow the same pattern and logstash is able to parse them successfully . However is there a wa…

---

## [MongoDB Input threw an exception, restarting {:exception=\>#\<BSON::ObjectId::Invalid: '2221275031010008292CAInvoiceCCEPrimary' is an invalid ObjectId.\>}](https://discuss.elastic.co/t/mongodb-input-threw-an-exception-restarting-exception-bson-2221275031010008292cainvoicecceprimary-is-an-invalid-objectid/271932)

<div class="topic-metadata">

**Author:** [@BASHEER\_DS](https://discuss.elastic.co/u/BASHEER_DS)\
**Replies:** 3\
**Last updated:** [May 3, 2021, 4:10pm UTC](https://discuss.elastic.co/t/mongodb-input-threw-an-exception-restarting-exception-bson-2221275031010008292cainvoicecceprimary-is-an-invalid-objectid/271932 "2021-05-03T16:10:41Z")

</div>

Hi, I am getting below error while creating pipeline. please help in resolving this error. MongoDB Input threw an exception, restarting {:exception=\>#\<BSON::ObjectId::Invalid: '2221275031010008292CAInvoiceCCEPrimary' i…

---

## [Last empty field](https://discuss.elastic.co/t/last-empty-field/271980)

<div class="topic-metadata">

**Author:** [@Emanuel\_Prado](https://discuss.elastic.co/u/Emanuel_Prado)\
**Replies:** 2\
**Last updated:** [May 3, 2021, 3:29pm UTC](https://discuss.elastic.co/t/last-empty-field/271980 "2021-05-03T15:29:39Z")

</div>

How can I get it to be ingested when the last information field is empty? Example all fields complete: 05.03.2021 06:20:00;BTUC8;10168.00;66.66;66.39;0.00;1.60 05.03.2021 06:20:00;BTUC8;10168.00;66.66;66.39;0.00;1.60 …

---

## [How to modified configure logstash add geo\_point and load data with logstash to elasticsearch](https://discuss.elastic.co/t/how-to-modified-configure-logstash-add-geo-point-and-load-data-with-logstash-to-elasticsearch/271984)

<div class="topic-metadata">

**Author:** [@Rizky\_Hudha](https://discuss.elastic.co/u/Rizky_Hudha)\
**Replies:** 1\
**Last updated:** [May 3, 2021, 3:10pm UTC](https://discuss.elastic.co/t/how-to-modified-configure-logstash-add-geo-point-and-load-data-with-logstash-to-elasticsearch/271984 "2021-05-03T15:10:03Z")

</div>

I have a column device.latlong where the longtitude and latitude values ​​become one column, how to add a geo\_point file to the logstash configuration, and display it in the kibana visualization and this my configure ap…

---

## [Kibana export png/PDF report missing in trial license](https://discuss.elastic.co/t/kibana-export-png-pdf-report-missing-in-trial-license/271538)

<div class="topic-metadata">

**Author:** [@dcamozzato](https://discuss.elastic.co/u/dcamozzato)\
**Replies:** 4\
**Last updated:** [May 3, 2021, 2:44pm UTC](https://discuss.elastic.co/t/kibana-export-png-pdf-report-missing-in-trial-license/271538 "2021-05-03T14:44:10Z")

</div>

I am currently using a trial license to test some of the gold subscription features. After activating the trial, I don't see the PDF / png export options in the "Share" menu in Kibana. Environment: I am running the do…

---

## [Can't setup filebeat](https://discuss.elastic.co/t/cant-setup-filebeat/271843)

<div class="topic-metadata">

**Author:** [@angeling](https://discuss.elastic.co/u/angeling)\
**Replies:** 3\
**Last updated:** [May 3, 2021, 2:56pm UTC](https://discuss.elastic.co/t/cant-setup-filebeat/271843 "2021-05-03T14:56:55Z")

</div>

Can anyone help me? I've an elk intance, it's working well, but when I try to setup a new filebeat in another instance it throws me the following: I read that I could remove the filebeat index and then it would work f…

---

## [Change color of some field based on a value of another field in the same document](https://discuss.elastic.co/t/change-color-of-some-field-based-on-a-value-of-another-field-in-the-same-document/271315)

<div class="topic-metadata">

**Author:** [@Manjula\_Piyumal](https://discuss.elastic.co/u/Manjula_Piyumal)\
**Replies:** 4\
**Last updated:** [May 3, 2021, 2:51pm UTC](https://discuss.elastic.co/t/change-color-of-some-field-based-on-a-value-of-another-field-in-the-same-document/271315 "2021-05-03T14:51:49Z")

</div>

Hi, In Kibana, is it possible to change the color of a numeric field based on a value in another filed in the same document? My document contains below two fields, I want to change the color of "count", based on the fi…

---

## [Can we have multiple HTTP input plugin configured into single logstash.conf file like below](https://discuss.elastic.co/t/can-we-have-multiple-http-input-plugin-configured-into-single-logstash-conf-file-like-below/271950)

<div class="topic-metadata">

**Author:** [@Learn\_Mulesoft\_With](https://discuss.elastic.co/u/Learn_Mulesoft_With)\
**Replies:** 1\
**Last updated:** [May 3, 2021, 2:50pm UTC](https://discuss.elastic.co/t/can-we-have-multiple-http-input-plugin-configured-into-single-logstash-conf-file-like-below/271950 "2021-05-03T14:50:50Z")

</div>

input { http { host =\> "localhost" port =\> "5044" response\_code =\> 201 } http { host =\> "localhost" port =\> "5045" response\_code =\> 201 } http { host =\> "localhost" port =\> "5046" response\_code =\> 201 } } …

---

## [Watcher using metadata array in input terms](https://discuss.elastic.co/t/watcher-using-metadata-array-in-input-terms/271273)

<div class="topic-metadata">

**Author:** [@Destan](https://discuss.elastic.co/u/Destan)\
**Replies:** 2\
**Last updated:** [May 3, 2021, 2:47pm UTC](https://discuss.elastic.co/t/watcher-using-metadata-array-in-input-terms/271273 "2021-05-03T14:47:45Z")

</div>

Hello guys, I would like to know if it's possible to use metadata as an array like this: "metadata": { "MyList": \[ "1", "2", "3", "4" \], "from": "60m" } and use it as a par…

---

## [How to install custom Kibana plugin 7.9.2 from local directory inside Docker container?](https://discuss.elastic.co/t/how-to-install-custom-kibana-plugin-7-9-2-from-local-directory-inside-docker-container/271959)

<div class="topic-metadata">

**Author:** [@theonlycatonice](https://discuss.elastic.co/u/theonlycatonice)\
**Replies:** 2\
**Last updated:** [May 3, 2021, 2:44pm UTC](https://discuss.elastic.co/t/how-to-install-custom-kibana-plugin-7-9-2-from-local-directory-inside-docker-container/271959 "2021-05-03T14:44:23Z")

</div>

Good day, in order to troubleshoot our plugin we wanted to test it via a docker container. So at the moment I have managed to download a plugin zip from our repository to the Kibana docker container but I cannot figure …

[Previous page](https://discuss.elastic.co/latest.md?page=1696)

[Next page](https://discuss.elastic.co/latest.md?page=1698)
