# Latest

**URL:** https://discuss.elastic.co/latest.md?page=1714

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1715

---

## [Should A Full DLQ Queue Effect Logstash Performance Signifigantly?](https://discuss.elastic.co/t/should-a-full-dlq-queue-effect-logstash-performance-signifigantly/271036)

<div class="topic-metadata">

**Author:** [@scott\_stash](https://discuss.elastic.co/u/scott_stash)\
**Replies:** 7\
**Last updated:** [April 25, 2021, 3:49am UTC](https://discuss.elastic.co/t/should-a-full-dlq-queue-effect-logstash-performance-signifigantly/271036 "2021-04-25T03:49:08Z")

</div>

I'm sending logs from Filebeat -\> Logstash -\> ES with 7.10.2. I have enabled DLQ and set it to 50 MB's. Once something is in the DLQ I do not bother reprocessing it and I'm fine with the data loss. Once I start seeing…

---

## [Table column value update into existing index(pdf ingest) column](https://discuss.elastic.co/t/table-column-value-update-into-existing-index-pdf-ingest-column/271162)

<div class="topic-metadata">

**Author:** [@joseph-l.amalraj](https://discuss.elastic.co/u/joseph-l.amalraj)\
**Replies:** 0\
**Last updated:** [April 25, 2021, 1:40am UTC](https://discuss.elastic.co/t/table-column-value-update-into-existing-index-pdf-ingest-column/271162 "2021-04-25T01:40:23Z")

</div>

Hi, I am new to elasticsearch. I have set of pdf files, i did ingested through FSCrawler(index=pdfvalitate). so, i got details in ElasticSearch. Now, i have a Table in mySQL TMPLT\_META(tmpl\_id, eff\_frm\_date, doc\_number),…

---

## [Correlation rules not working](https://discuss.elastic.co/t/correlation-rules-not-working/271147)

<div class="topic-metadata">

**Author:** [@Nil\_Battey\_Sannata](https://discuss.elastic.co/u/Nil_Battey_Sannata)\
**Replies:** 0\
**Last updated:** [April 24, 2021, 2:35pm UTC](https://discuss.elastic.co/t/correlation-rules-not-working/271147 "2021-04-24T14:35:46Z")

</div>

I was trying to test some of the prebuilt elastic detection rules with my Beat-Elasticsearch-Kibana setup. All other rules with simple query was working but the rules with event correlation was not working. I tried all p…

---

## [How do you increase the GB storage without increasing the RAM and CPU. Is there a way?](https://discuss.elastic.co/t/how-do-you-increase-the-gb-storage-without-increasing-the-ram-and-cpu-is-there-a-way/271146)

<div class="topic-metadata">

**Author:** [@Yash\_Srivastava](https://discuss.elastic.co/u/Yash_Srivastava)\
**Replies:** 3\
**Last updated:** [April 24, 2021, 7:41pm UTC](https://discuss.elastic.co/t/how-do-you-increase-the-gb-storage-without-increasing-the-ram-and-cpu-is-there-a-way/271146 "2021-04-24T19:41:56Z")

</div>

how do you increase the GB storage without increasing the RAM and CPU. Is there a way?

---

## [Filebeat sonicwall module not parsing correctly many messages](https://discuss.elastic.co/t/filebeat-sonicwall-module-not-parsing-correctly-many-messages/268232)

<div class="topic-metadata">

**Author:** [@Rodrigo\_Bernardo](https://discuss.elastic.co/u/Rodrigo_Bernardo)\
**Replies:** 6\
**Last updated:** [April 24, 2021, 6:28pm UTC](https://discuss.elastic.co/t/filebeat-sonicwall-module-not-parsing-correctly-many-messages/268232 "2021-04-24T18:28:01Z")

</div>

Hello there, Our Sonicwall generates this message: \<110\> id=yyyy sn=C0EAE4F9FB00 time="2021-03-24 14:35:31 UTC" fw=xx.xx.xx.xx pri=6 c=262144 m=98 msg="Connection Opened" app=49177 appName="General HTTPS" n=2185104…

---

## [Get previous docs and following docs at innerHits](https://discuss.elastic.co/t/get-previous-docs-and-following-docs-at-innerhits/271156)

<div class="topic-metadata">

**Author:** [@Benjamin\_S](https://discuss.elastic.co/u/Benjamin_S)\
**Replies:** 0\
**Last updated:** [April 24, 2021, 4:29pm UTC](https://discuss.elastic.co/t/get-previous-docs-and-following-docs-at-innerhits/271156 "2021-04-24T16:29:44Z")

</div>

Hello, I have an index for comments. Comments can also get sub-comments. If I search my InnerHits query for the most popular one (most likes etc). Can I somehow get the information at which position this comment is. So …

---

## [Data transfer rates costs in ElasticCloud direct purchased and Azure Marketplace enabled purchase](https://discuss.elastic.co/t/data-transfer-rates-costs-in-elasticcloud-direct-purchased-and-azure-marketplace-enabled-purchase/271145)

<div class="topic-metadata">

**Author:** [@Yash\_Srivastava](https://discuss.elastic.co/u/Yash_Srivastava)\
**Replies:** 1\
**Last updated:** [April 24, 2021, 3:10pm UTC](https://discuss.elastic.co/t/data-transfer-rates-costs-in-elasticcloud-direct-purchased-and-azure-marketplace-enabled-purchase/271145 "2021-04-24T15:10:17Z")

</div>

data transfer rates costs in ElasticCloud direct purchased and Azure Marketplace enabled purchase

---

## [Kibana alerts: Calculate percentage of errors for a given period time](https://discuss.elastic.co/t/kibana-alerts-calculate-percentage-of-errors-for-a-given-period-time/271133)

<div class="topic-metadata">

**Author:** [@Rahul\_Miragi](https://discuss.elastic.co/u/Rahul_Miragi)\
**Replies:** 1\
**Last updated:** [April 24, 2021, 1:59pm UTC](https://discuss.elastic.co/t/kibana-alerts-calculate-percentage-of-errors-for-a-given-period-time/271133 "2021-04-24T13:59:20Z")

</div>

I’m looking for a solution to following problem: In ELK, I have to create an alert which will trigger - when an error field logged for an index is greater than 80% in last 30 mins The field name is status and it takes i…

---

## [How to Get all the Lens visualization using Rest API call](https://discuss.elastic.co/t/how-to-get-all-the-lens-visualization-using-rest-api-call/270987)

<div class="topic-metadata">

**Author:** [@Sagesh](https://discuss.elastic.co/u/Sagesh)\
**Replies:** 2\
**Last updated:** [April 24, 2021, 11:41am UTC](https://discuss.elastic.co/t/how-to-get-all-the-lens-visualization-using-rest-api-call/270987 "2021-04-24T11:41:52Z")

</div>

How to Get all the Lens visualization using Rest API call?

---

## [Automatic dashboards are not getting created when I change index name in filebeat.yml](https://discuss.elastic.co/t/automatic-dashboards-are-not-getting-created-when-i-change-index-name-in-filebeat-yml/271086)

<div class="topic-metadata">

**Author:** [@Husnain](https://discuss.elastic.co/u/Husnain)\
**Replies:** 6\
**Last updated:** [April 24, 2021, 11:39am UTC](https://discuss.elastic.co/t/automatic-dashboards-are-not-getting-created-when-i-change-index-name-in-filebeat-yml/271086 "2021-04-24T11:39:08Z")

</div>

Hii.I am ingesting netflow data using filebeat netflow module.I have configured "filebeat.yml" file for automatic creation of dashboards.Filebeat creates index with name "filebeat-\*" and it also creates dashboards auto…

---

## [Filebeat & Windows DHCP Logging](https://discuss.elastic.co/t/filebeat-windows-dhcp-logging/271017)

<div class="topic-metadata">

**Author:** [@billkindle](https://discuss.elastic.co/u/billkindle)\
**Replies:** 1\
**Last updated:** [April 24, 2021, 9:45am UTC](https://discuss.elastic.co/t/filebeat-windows-dhcp-logging/271017 "2021-04-24T09:45:36Z")

</div>

I'm trying to locate some examples that are specific to elastic cloud when using filebeat to capture Microsoft DHCP logs. All the examples I find online aren't really matching what I'm seeing in 7.12.0 example files, or …

---

## [Monitoring Sync gateway using ELK](https://discuss.elastic.co/t/monitoring-sync-gateway-using-elk/271134)

<div class="topic-metadata">

**Author:** [@sahere37](https://discuss.elastic.co/u/sahere37)\
**Replies:** 0\
**Last updated:** [April 24, 2021, 9:24am UTC](https://discuss.elastic.co/t/monitoring-sync-gateway-using-elk/271134 "2021-04-24T09:24:15Z")

</div>

Hi all, I am monitoring couchbase database using couchbase module of metricbeat. is there any way to monitor sync gateway ? Regards

---

## [java.io.StreamCorruptedException: invalid internal transport message format](https://discuss.elastic.co/t/java-io-streamcorruptedexception-invalid-internal-transport-message-format/269899)

<div class="topic-metadata">

**Author:** [@sahere37](https://discuss.elastic.co/u/sahere37)\
**Replies:** 6\
**Last updated:** [April 24, 2021, 9:21am UTC](https://discuss.elastic.co/t/java-io-streamcorruptedexception-invalid-internal-transport-message-format/269899 "2021-04-24T09:21:45Z")

</div>

Hi all, I have a three node ES cluster with IP (10.0.1.10,10.0.1.11,10.0.1.12), following WARN has been found in the log. in the following log, a remote address has been mentioned which is not a member of cluster (10.0…

---

## [Can not add a node](https://discuss.elastic.co/t/can-not-add-a-node/271131)

<div class="topic-metadata">

**Author:** [@Farid\_N](https://discuss.elastic.co/u/Farid_N)\
**Replies:** 2\
**Last updated:** [April 24, 2021, 9:18am UTC](https://discuss.elastic.co/t/can-not-add-a-node/271131 "2021-04-24T09:18:24Z")

</div>

Hi there Unfortunately, I can not add another node to my single node cluster. The elasticsearch.yml of master node is: cluster.name: logServer node.name: elk1 node.master: true node.data: true path.data: /var/lib/elas…

---

## [(urgent) Converting a list of decimals to float in CSV](https://discuss.elastic.co/t/urgent-converting-a-list-of-decimals-to-float-in-csv/268772)

<div class="topic-metadata">

**Author:** [@shafeeka](https://discuss.elastic.co/u/shafeeka)\
**Replies:** 4\
**Last updated:** [April 24, 2021, 9:14am UTC](https://discuss.elastic.co/t/urgent-converting-a-list-of-decimals-to-float-in-csv/268772 "2021-04-24T09:14:11Z")

</div>

mutate { convert =\> { "Question\_Vector" =\> "float\_eu" } I am trying to push a CSV file to elasticsearch using logstash. One of the column contains a list of vectors and I am trying to conv…

---

## [How to order the query for searching the fields in a particular order](https://discuss.elastic.co/t/how-to-order-the-query-for-searching-the-fields-in-a-particular-order/270912)

<div class="topic-metadata">

**Author:** [@vsr](https://discuss.elastic.co/u/vsr)\
**Replies:** 3\
**Last updated:** [April 24, 2021, 6:19am UTC](https://discuss.elastic.co/t/how-to-order-the-query-for-searching-the-fields-in-a-particular-order/270912 "2021-04-24T06:19:49Z")

</div>

I am new to elastic enterprise search and working on elastic cloud .We would like to rank the searching the fields in the query . Please help us how to achieve this .

---

## [Connecting filebeat to elastic cloud](https://discuss.elastic.co/t/connecting-filebeat-to-elastic-cloud/270788)

<div class="topic-metadata">

**Author:** [@Richard\_Phillips\_Roy](https://discuss.elastic.co/u/Richard_Phillips_Roy)\
**Replies:** 4\
**Last updated:** [April 24, 2021, 5:07am UTC](https://discuss.elastic.co/t/connecting-filebeat-to-elastic-cloud/270788 "2021-04-24T05:07:16Z")

</div>

Hi, I would i configure the output of this filebeat.yml file to send logs to elastic cloud filebeat.inputs: - enabled: true paths: - /data/fatt/log/fatt.log fields: type: Fatt fields\_under\_root…

---

## [Single Engine for multiple sites?](https://discuss.elastic.co/t/single-engine-for-multiple-sites/271113)

<div class="topic-metadata">

**Author:** [@elasticuser7](https://discuss.elastic.co/u/elasticuser7)\
**Replies:** 2\
**Last updated:** [April 24, 2021, 3:38am UTC](https://discuss.elastic.co/t/single-engine-for-multiple-sites/271113 "2021-04-24T03:38:28Z")

</div>

Are there any recommendations or guidelines for using a single engine vs multiple engines when search has to be implemented for multiple sites? Does it depend on the amount of data or other factors like the amount of typ…

---

## [Watcher that counts the documents that arrive to an index in kibana](https://discuss.elastic.co/t/watcher-that-counts-the-documents-that-arrive-to-an-index-in-kibana/270609)

<div class="topic-metadata">

**Author:** [@Juan\_David\_Jaramillo](https://discuss.elastic.co/u/Juan_David_Jaramillo)\
**Replies:** 45\
**Last updated:** [April 24, 2021, 2:06am UTC](https://discuss.elastic.co/t/watcher-that-counts-the-documents-that-arrive-to-an-index-in-kibana/270609 "2021-04-24T02:06:21Z")

</div>

I have a problem with this watcher, I need to get the number of samples of an index, that is, the count of the documents sent by heartbeat to kibana and send an email every day with the number of documents that arrived t…

---

## [How to register a new S3 bucket as a snapshot repository to my existing elastic cloud?](https://discuss.elastic.co/t/how-to-register-a-new-s3-bucket-as-a-snapshot-repository-to-my-existing-elastic-cloud/271093)

<div class="topic-metadata">

**Author:** [@zozo6015](https://discuss.elastic.co/u/zozo6015)\
**Replies:** 3\
**Last updated:** [April 23, 2021, 10:18pm UTC](https://discuss.elastic.co/t/how-to-register-a-new-s3-bucket-as-a-snapshot-repository-to-my-existing-elastic-cloud/271093 "2021-04-23T22:18:18Z")

</div>

Hello, I want to use my own S3 bucket as a snapshot repository in case we sometime decide to not use elastic cloud for some reason we don't loose the data ingested until that moment. Is there a way to easily add one? In…

---

## [Set up minimal security elasticsearch failed](https://discuss.elastic.co/t/set-up-minimal-security-elasticsearch-failed/270356)

<div class="topic-metadata">

**Author:** [@alipujaistopo](https://discuss.elastic.co/u/alipujaistopo)\
**Replies:** 15\
**Last updated:** [April 23, 2021, 9:36pm UTC](https://discuss.elastic.co/t/set-up-minimal-security-elasticsearch-failed/270356 "2021-04-23T21:36:08Z")

</div>

i try setup minimal security in here Set up minimal security for Elasticsearch | Elasticsearch Guide \[7.12\] | Elastic but still failed, and this the complete log i had. i will separate in 7 parts. please help why? \[20…

---

## [App Search vs Site Search?](https://discuss.elastic.co/t/app-search-vs-site-search/271001)

<div class="topic-metadata">

**Author:** [@elasticuser7](https://discuss.elastic.co/u/elasticuser7)\
**Replies:** 1\
**Last updated:** [April 23, 2021, 9:29pm UTC](https://discuss.elastic.co/t/app-search-vs-site-search/271001 "2021-04-23T21:29:28Z")

</div>

Hello, I see two different sets of API documentation here one under site-search the other under app-search: They seem to be quite different in their syntax and execution and doesn't seem interchangeable.. what's the …

---

## [Analytics: Filter Results by URL](https://discuss.elastic.co/t/analytics-filter-results-by-url/269892)

<div class="topic-metadata">

**Author:** [@tushintees](https://discuss.elastic.co/u/tushintees)\
**Replies:** 1\
**Last updated:** [April 23, 2021, 9:06pm UTC](https://discuss.elastic.co/t/analytics-filter-results-by-url/269892 "2021-04-23T21:06:02Z")

</div>

Howdy. We have search across a few domains and we need to break out the analytics/reports to reflect the domains. Is there a way to export or filter data to show urls for website.com/URL1/ separate from website.com/URL2/ …

---

## [Synthetics 1.0.0-beta.0 + Breaking Changes](https://discuss.elastic.co/t/synthetics-1-0-0-beta-0-breaking-changes/271122)

<div class="topic-metadata">

**Author:** [@Andrew\_Cholakian1](https://discuss.elastic.co/u/Andrew_Cholakian1)\
**Replies:** 0\
**Last updated:** [April 23, 2021, 6:41pm UTC](https://discuss.elastic.co/t/synthetics-1-0-0-beta-0-breaking-changes/271122 "2021-04-23T18:41:49Z")

</div>

We're really excited to announce the 1.0.0-beta.0 version of the Elastic Synthetics JS/TS library. However, don't upgrade to this until the 7.13.0 release is available and you've upgraded to it! This release is in prepar…

---

## [Synthetics 1.0.0-beta.0 + Breaking Changes](https://discuss.elastic.co/t/synthetics-1-0-0-beta-0-breaking-changes/271120)

<div class="topic-metadata">

**Author:** [@Andrew\_Cholakian1](https://discuss.elastic.co/u/Andrew_Cholakian1)\
**Replies:** 0\
**Last updated:** [April 23, 2021, 6:08pm UTC](https://discuss.elastic.co/t/synthetics-1-0-0-beta-0-breaking-changes/271120 "2021-04-23T18:08:53Z")

</div>

We're really excited to announce the 1.0.0-beta.0 version of the Elastic Synthetics JS/TS library. However, don't upgrade to this until the 7.13.0 release is available and you've upgraded to it! This release is in prepar…

---

## [Heat map X axis misaligned when using the print to PDF on Canvas](https://discuss.elastic.co/t/heat-map-x-axis-misaligned-when-using-the-print-to-pdf-on-canvas/271000)

<div class="topic-metadata">

**Author:** [@azulgrana](https://discuss.elastic.co/u/azulgrana)\
**Replies:** 10\
**Last updated:** [April 23, 2021, 5:21pm UTC](https://discuss.elastic.co/t/heat-map-x-axis-misaligned-when-using-the-print-to-pdf-on-canvas/271000 "2021-04-23T17:21:36Z")

</div>

Hi team, I'm playing with visualization and the print to PDF feature within Kibana. And I just realized the X axis on Heat Map get misaligned when I print to PDF. See Image I'm sorry I had to blur some of my data, b…

---

## [Detection result in new Index](https://discuss.elastic.co/t/detection-result-in-new-index/270347)

<div class="topic-metadata">

**Author:** [@xahmi](https://discuss.elastic.co/u/xahmi)\
**Replies:** 5\
**Last updated:** [April 23, 2021, 5:05pm UTC](https://discuss.elastic.co/t/detection-result-in-new-index/270347 "2021-04-23T17:05:43Z")

</div>

Hi, is there a way to save the custom query Job results/anomalies in a new Index? I think we can do that with ML but is there a way to do the same with other detection types like Custom query , Threshold, Event Correla…

---

## [Kibana Generate PDF Report Cutting Off X-Axis](https://discuss.elastic.co/t/kibana-generate-pdf-report-cutting-off-x-axis/270624)

<div class="topic-metadata">

**Author:** [@thedevelpr](https://discuss.elastic.co/u/thedevelpr)\
**Replies:** 8\
**Last updated:** [April 23, 2021, 4:44pm UTC](https://discuss.elastic.co/t/kibana-generate-pdf-report-cutting-off-x-axis/270624 "2021-04-23T16:44:26Z")

</div>

I'm having issues generating reports using Kibana. All my charts get cut off on the x-axis whether I optimize for printing or not. I've also tried to generate pdfs by creating a canvas and adding Kibana elements into …

---

## [Change the certificates](https://discuss.elastic.co/t/change-the-certificates/268158)

<div class="topic-metadata">

**Author:** [@adityak248](https://discuss.elastic.co/u/adityak248)\
**Replies:** 5\
**Last updated:** [April 23, 2021, 4:39pm UTC](https://discuss.elastic.co/t/change-the-certificates/268158 "2021-04-23T16:39:44Z")

</div>

Hello Team, I have an ELK stack running with hot warm architecture. Everything is fine until I was asked to add new nodes to the stack... How am I supposed to add new nodes and how can I create new certificates for the…

---

## [Configure postgresql module with csv fileset through Hints](https://discuss.elastic.co/t/configure-postgresql-module-with-csv-fileset-through-hints/271114)

<div class="topic-metadata">

**Author:** [@lchdev](https://discuss.elastic.co/u/lchdev)\
**Replies:** 0\
**Last updated:** [April 23, 2021, 4:39pm UTC](https://discuss.elastic.co/t/configure-postgresql-module-with-csv-fileset-through-hints/271114 "2021-04-23T16:39:17Z")

</div>

Hi, Running Filebeat 7.12 in Kubernetes, I'm unable to configure the postgresql module to parse CSV logs through hints. I added the following annotations ( logreaper is the sidecar container that outputs postgres csv l…

[Previous page](https://discuss.elastic.co/latest.md?page=1713)

[Next page](https://discuss.elastic.co/latest.md?page=1715)
