# Top

**URL:** https://discuss.elastic.co/top.md?page=1474&period=all

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1475

---

## [Logstash Error: Invalid FieldReference: \`\[iso-8859-1\]to\`](https://discuss.elastic.co/t/logstash-error-invalid-fieldreference-iso-8859-1-to/248712)

<div class="topic-metadata">

**Author:** [@adamzarn](https://discuss.elastic.co/u/adamzarn)\
**Replies:** 5\
**Last updated:** [September 15, 2020, 8:40pm UTC](https://discuss.elastic.co/t/logstash-error-invalid-fieldreference-iso-8859-1-to/248712 "2020-09-15T20:40:11Z")

</div>

I'm using ELK v7.9.1 and I get this error with some of records that are coming from CouchDB: logstash | \[2020-09-15T16:03:20,662\]\[ERROR\]\[logstash.javapipeline \]\[main\]\[69664fe8e111893f386d879e5cd848742ac1a327f…

---

## [Continuous failure for report generation](https://discuss.elastic.co/t/continuous-failure-for-report-generation/215671)

<div class="topic-metadata">

**Author:** [@Nithani25](https://discuss.elastic.co/u/Nithani25)\
**Replies:** 5\
**Last updated:** [January 23, 2020, 8:39am UTC](https://discuss.elastic.co/t/continuous-failure-for-report-generation/215671 "2020-01-23T08:39:58Z")

</div>

Hi Team, I am getting continuous failure with report generation and slack alerting in kibana 6.4. I am trying to generate a dashboard report and send it as a watcher alert(daily,weekly and monthly) alerts. But i am get…

---

## [Some confusion about translog](https://discuss.elastic.co/t/some-confusion-about-translog/195592)

<div class="topic-metadata">

**Author:** [@KellyK313](https://discuss.elastic.co/u/KellyK313)\
**Replies:** 5\
**Last updated:** [August 26, 2019, 2:05pm UTC](https://discuss.elastic.co/t/some-confusion-about-translog/195592 "2019-08-26T14:05:32Z")

</div>

Hello everyone，I have known that "index.translog.durability" make the data from page cache fsync to translog file,but what is the mechanism about fsync the data from page cache to segment file?Is it controlled by OS not …

---

## [Fscrawler/Elasticsearch page by page indexing](https://discuss.elastic.co/t/fscrawler-elasticsearch-page-by-page-indexing/187972)

<div class="topic-metadata">

**Author:** [@Gael\_Latouche](https://discuss.elastic.co/u/Gael_Latouche)\
**Replies:** 5\
**Last updated:** [June 28, 2019, 6:12pm UTC](https://discuss.elastic.co/t/fscrawler-elasticsearch-page-by-page-indexing/187972 "2019-06-28T18:12:20Z")

</div>

Hello, My question is, can we index page by page of PDFs with fscrawler directly. E.g, can fscrawler do the parent/child relationship while indexing the docs and then, when doing the search query in Elasticsearch, it re…

---

## [Recover Canvas workpads from .kibana backup index](https://discuss.elastic.co/t/recover-canvas-workpads-from-kibana-backup-index/184302)

<div class="topic-metadata">

**Author:** [@tomhe](https://discuss.elastic.co/u/tomhe)\
**Replies:** 5\
**Last updated:** [June 5, 2019, 7:15pm UTC](https://discuss.elastic.co/t/recover-canvas-workpads-from-kibana-backup-index/184302 "2019-06-05T19:15:59Z")

</div>

During upgrade of Kibana from 6.7.2 to 7.0.1 I ran into this issue: My workaround was to export all saved objects, delete the .kibana\* indices, do the upgrade, and then import all saved objects. I just discovered tha…

---

## [ElasticSearch S3 Repository : Question on what is "repository"?](https://discuss.elastic.co/t/elasticsearch-s3-repository-question-on-what-is-repository/123138)

<div class="topic-metadata">

**Author:** [@titan1978](https://discuss.elastic.co/u/titan1978)\
**Replies:** 5\
**Last updated:** [March 8, 2018, 9:19pm UTC](https://discuss.elastic.co/t/elasticsearch-s3-repository-question-on-what-is-repository/123138 "2018-03-08T21:19:50Z")

</div>

Hello, I'm trying to understand the nuance of "repository" when it comes to restoring a snapshot on a DIFFERENT newly constructed stack. Here's the scenario: I create an ELK stack in US-EAST-1. I use the PUT/snapshot/…

---

## [Kibana Plugin](https://discuss.elastic.co/t/kibana-plugin/62483)

<div class="topic-metadata">

**Author:** [@Mohana01](https://discuss.elastic.co/u/Mohana01)\
**Replies:** 5\
**Last updated:** [October 12, 2016, 4:51am UTC](https://discuss.elastic.co/t/kibana-plugin/62483 "2016-10-12T04:51:07Z")

</div>

Hi all i installed kibana-plugin-gauge-sg-master from git hub.And it is working in Kibana. I want to know is it possible to edit the java script within this plugin based on my need.(Like changing the color,Max gauge va…

---

## [How to Differentiate Elastic Agent with same hostname](https://discuss.elastic.co/t/how-to-differentiate-elastic-agent-with-same-hostname/324763)

<div class="topic-metadata">

**Author:** [@OmFJ](https://discuss.elastic.co/u/OmFJ)\
**Replies:** 0\
**Last updated:** [February 6, 2023, 8:01am UTC](https://discuss.elastic.co/t/how-to-differentiate-elastic-agent-with-same-hostname/324763 "2023-02-06T08:01:15Z")

</div>

Hi Everyone, I have multiple CentOS 7 running on VM. What i am trying to do is to monitor processes or services within each host. the problem is that all my host has default hostname. i already placed tags in fleet menu…

---

## [💠 JSON format for Server log connector](https://discuss.elastic.co/t/json-format-for-server-log-connector/315178)

<div class="topic-metadata">

**Author:** [@Its\_Anton](https://discuss.elastic.co/u/Its_Anton)\
**Replies:** 0\
**Last updated:** [September 26, 2022, 2:34pm UTC](https://discuss.elastic.co/t/json-format-for-server-log-connector/315178 "2022-09-26T14:34:06Z")

</div>

Hi! I have switched all logs from Kibana to JSON format and that work awesome! But when I use the Server log connector in my alerting rules, it adds annoying ''Server log: " text that breaks the JSON being logged: …

---

## [How to write bool query in completion suggestor?](https://discuss.elastic.co/t/how-to-write-bool-query-in-completion-suggestor/141691)

<div class="topic-metadata">

**Author:** [@kartheek91](https://discuss.elastic.co/u/kartheek91)\
**Replies:** 0\
**Last updated:** [July 26, 2018, 5:20am UTC](https://discuss.elastic.co/t/how-to-write-bool-query-in-completion-suggestor/141691 "2018-07-26T05:20:07Z")

</div>

Hi All, I have occurred a situation where we need to get suggestions based text they entered and we need to authentication id.How to achieve this. Thanks in advance, Kartheek Gummaluri

---

## [Failed to submit message: 'Connection to APM Server timed out (url: http://apm-server:8200/intake/v2/events, timeout: 10000.0 seconds)](https://discuss.elastic.co/t/failed-to-submit-message-connection-to-apm-server-timed-out-url-http-apm-server-8200-intake-v2-events-timeout-10000-0-seconds/324076)

<div class="topic-metadata">

**Author:** [@SELENAAA](https://discuss.elastic.co/u/SELENAAA)\
**Replies:** 1\
**Last updated:** [January 27, 2023, 10:34pm UTC](https://discuss.elastic.co/t/failed-to-submit-message-connection-to-apm-server-timed-out-url-http-apm-server-8200-intake-v2-events-timeout-10000-0-seconds/324076 "2023-01-27T22:34:32Z")

</div>

Kibana version: Elasticsearch version: elastic-apm==6.13.2 APM Server version: APM Agent language and version: python Browser version: safari Original install method (e.g. download page, yum, deb, from source, etc.)…

---

## [Custom query in dashboard](https://discuss.elastic.co/t/custom-query-in-dashboard/310165)

<div class="topic-metadata">

**Author:** [@Farah\_Bhr](https://discuss.elastic.co/u/Farah_Bhr)\
**Replies:** 1\
**Last updated:** [July 21, 2022, 1:33pm UTC](https://discuss.elastic.co/t/custom-query-in-dashboard/310165 "2022-07-21T13:33:19Z")

</div>

Hello I am a beginner in elastic I want to ask can I transform an advanced search of elasticsearch indices in kibana Dev Tools into a dashboard for example can I transform this get into a kibana dashboard or to a more…

---

## [Elasticsearch Reindex is slow compare to REALLOCATION](https://discuss.elastic.co/t/elasticsearch-reindex-is-slow-compare-to-reallocation/285785)

<div class="topic-metadata">

**Author:** [@tusharnemade](https://discuss.elastic.co/u/tusharnemade)\
**Replies:** 7\
**Last updated:** [October 4, 2021, 7:19am UTC](https://discuss.elastic.co/t/elasticsearch-reindex-is-slow-compare-to-reallocation/285785 "2021-10-04T07:19:27Z")

</div>

Hello Team I am using Elasticsearch version 7.8.0. I have opened this thread for my understanding in regards to Elasticsearch internal operations. A Cluster Version : 5.6.3.0 B Cluster Version : 7.8.0.0 We are not u…

---

## [AWS ElasticSearch - Manual Snapshot Archival](https://discuss.elastic.co/t/aws-elasticsearch-manual-snapshot-archival/234960)

<div class="topic-metadata">

**Author:** [@mehak](https://discuss.elastic.co/u/mehak)\
**Replies:** 7\
**Last updated:** [June 3, 2020, 8:07pm UTC](https://discuss.elastic.co/t/aws-elasticsearch-manual-snapshot-archival/234960 "2020-06-03T20:07:54Z")

</div>

Hi Everyone, I have a query regarding archival of ElasticSearch data. We are taking Manual snapshots of our ElasticSearch data after every 6 hours and it is getting stored in storage like S3. In our ElasticSearch, say w…

---

## [I get error when i try to parse json to elastic search](https://discuss.elastic.co/t/i-get-error-when-i-try-to-parse-json-to-elastic-search/176840)

<div class="topic-metadata">

**Author:** [@ridwan\_syarifudin1](https://discuss.elastic.co/u/ridwan_syarifudin1)\
**Replies:** 7\
**Last updated:** [April 16, 2019, 4:08am UTC](https://discuss.elastic.co/t/i-get-error-when-i-try-to-parse-json-to-elastic-search/176840 "2019-04-16T04:08:55Z")

</div>

when i use the curl command to parse json to elastic with this curl command: while read f1 do curl -XPOST 'http://localhost:9200/master\_product\_info/message?pipeline=parse\_master\_produk\_pipeline' -H "Content-Type: app…

---

## [How to forward logs from multiple folder storage locations of rsyslog server to ELK?](https://discuss.elastic.co/t/how-to-forward-logs-from-multiple-folder-storage-locations-of-rsyslog-server-to-elk/164575)

<div class="topic-metadata">

**Author:** [@vignesh.s2](https://discuss.elastic.co/u/vignesh.s2)\
**Replies:** 1\
**Last updated:** [January 22, 2019, 7:53am UTC](https://discuss.elastic.co/t/how-to-forward-logs-from-multiple-folder-storage-locations-of-rsyslog-server-to-elk/164575 "2019-01-22T07:53:33Z")

</div>

My case is, I have ELK setup were rsyslog forwards the logs to it. My templates are , $template templmesg,"/data01/RemoteLogs/DLF/%$YEAR%/%$MONTH%/%HOSTNAME%/%HOSTNAME%-%$DAY%-%$MONTH%-%$YEAR%.log" $template mylogsec,…

---

## [Renaming an index](https://discuss.elastic.co/t/renaming-an-index/122134)

<div class="topic-metadata">

**Author:** [@jchannon](https://discuss.elastic.co/u/jchannon)\
**Replies:** 1\
**Last updated:** [March 2, 2018, 1:26am UTC](https://discuss.elastic.co/t/renaming-an-index/122134 "2018-03-02T01:26:45Z")

</div>

Hi, I'm trying to think of a better approach than this (bearing in mind our application and logs and ES is on-prem): a) Customer sends an elasticdump of their data and their indexes will be in the format of fluend-YYYY…

---

## [HELP \[illegal\_argument\_exception: index.lifecycle.rollover\_alias \[sonicwall-\*\] does not point to index \[sonicwall-2020.09.28-000001\]\]](https://discuss.elastic.co/t/help-illegal-argument-exception-index-lifecycle-rollover-alias-sonicwall-does-not-point-to-index-sonicwall-2020-09-28-000001/250281)

<div class="topic-metadata">

**Author:** [@Akbar\_Maulana](https://discuss.elastic.co/u/Akbar_Maulana)\
**Replies:** 4\
**Last updated:** [October 5, 2020, 4:00am UTC](https://discuss.elastic.co/t/help-illegal-argument-exception-index-lifecycle-rollover-alias-sonicwall-does-not-point-to-index-sonicwall-2020-09-28-000001/250281 "2020-10-05T04:00:04Z")

</div>

I use this configuration for my indices but always returned with this error PUT \_template/sonicwall?include\_type\_name { "version": 60001, "order": 0, "index\_patterns": \[ "sonicwall-" \], "settings": { "index": { …

---

## [ElasticSearch Encryption](https://discuss.elastic.co/t/elasticsearch-encryption/204405)

<div class="topic-metadata">

**Author:** [@Kailash\_Karki](https://discuss.elastic.co/u/Kailash_Karki)\
**Replies:** 4\
**Last updated:** [October 23, 2019, 5:50am UTC](https://discuss.elastic.co/t/elasticsearch-encryption/204405 "2019-10-23T05:50:52Z")

</div>

Hi, I am new to elastic search. I want to encrypt all the data that I have saved in indices, my confusion is that, if I encrypt the data will I able to search for data or not? what approach should I follow to encrypt t…

---

## [Elasticsearch Read from Multiple Locations](https://discuss.elastic.co/t/elasticsearch-read-from-multiple-locations/174980)

<div class="topic-metadata">

**Author:** [@SISA\_Nirmal\_kumar\_B](https://discuss.elastic.co/u/SISA_Nirmal_kumar_B)\
**Replies:** 4\
**Last updated:** [April 3, 2019, 7:40am UTC](https://discuss.elastic.co/t/elasticsearch-read-from-multiple-locations/174980 "2019-04-03T07:40:03Z")

</div>

Is it possible to configure elasticsearch to read data from multiple locations / path ?

---

## [Kibana Visualization to create Pie chart](https://discuss.elastic.co/t/kibana-visualization-to-create-pie-chart/145316)

<div class="topic-metadata">

**Author:** [@thiraj89](https://discuss.elastic.co/u/thiraj89)\
**Replies:** 4\
**Last updated:** [August 23, 2018, 5:14am UTC](https://discuss.elastic.co/t/kibana-visualization-to-create-pie-chart/145316 "2018-08-23T05:14:26Z")

</div>

we have log stack the values in message filed. "message": "Store - Hit from smarty. \\tKey:paytm-hotels-booking\\tTime: 2018-08-20 19:29:58" "message": "Store - Hit from smarty. \\tKey:arzoo-domesticflights\\tTime: 2018-08…

---

## [@timestamp being represented as string in Logstash 1.5.1](https://discuss.elastic.co/t/timestamp-being-represented-as-string-in-logstash-1-5-1/23881)

<div class="topic-metadata">

**Author:** [@owenme26](https://discuss.elastic.co/u/owenme26)\
**Replies:** 4\
**Last updated:** [July 17, 2015, 10:43am UTC](https://discuss.elastic.co/t/timestamp-being-represented-as-string-in-logstash-1-5-1/23881 "2015-07-17T10:43:45Z")

</div>

Setup: I recently upgraded from logstash 1.4.2-1-2c0f5a1 to Logstash 1.5.1-1. I am using the date filter to replace the @timestamp with the event time of the log. I send all input to elasticsearch and I tag certain even…

---

## [System/socket dataset setup failed: guess\_struct\_creds](https://discuss.elastic.co/t/system-socket-dataset-setup-failed-guess-struct-creds/344175)

<div class="topic-metadata">

**Author:** [@0xdeadbeer](https://discuss.elastic.co/u/0xdeadbeer)\
**Replies:** 2\
**Last updated:** [October 19, 2023, 11:46am UTC](https://discuss.elastic.co/t/system-socket-dataset-setup-failed-guess-struct-creds/344175 "2023-10-19T11:46:06Z")

</div>

Auditbeat runs flawlessly without the socket module. However, whenever I turn it on the following error shows up: {"log.level":"info","@timestamp":"2023-09-30T20:01:20.511+0200","log.origin":{"file.name":"instance/beat.…

---

## [How do I delete data from elasticsearch within a Range?](https://discuss.elastic.co/t/how-do-i-delete-data-from-elasticsearch-within-a-range/305858)

<div class="topic-metadata">

**Author:** [@dineshsekar](https://discuss.elastic.co/u/dineshsekar)\
**Replies:** 2\
**Last updated:** [May 30, 2022, 4:25am UTC](https://discuss.elastic.co/t/how-do-i-delete-data-from-elasticsearch-within-a-range/305858 "2022-05-30T04:25:42Z")

</div>

How do I delete data from Elasticsearch within a Range? I'm looking for an example. between 2022-01-22 and 2022-05-28

---

## [Hiding Index Patterns](https://discuss.elastic.co/t/hiding-index-patterns/297512)

<div class="topic-metadata">

**Author:** [@shinobu](https://discuss.elastic.co/u/shinobu)\
**Replies:** 2\
**Last updated:** [February 22, 2022, 8:17am UTC](https://discuss.elastic.co/t/hiding-index-patterns/297512 "2022-02-22T08:17:20Z")

</div>

Hello, would you know if it is possible to hide certain Index Patterns for users in discovery if they do not have the permission to view the indexes? Thank you. Best Regards.

---

## [Creating certs for kibana connecting to elastic](https://discuss.elastic.co/t/creating-certs-for-kibana-connecting-to-elastic/244236)

<div class="topic-metadata">

**Author:** [@AirJordan](https://discuss.elastic.co/u/AirJordan)\
**Replies:** 2\
**Last updated:** [August 12, 2020, 4:13pm UTC](https://discuss.elastic.co/t/creating-certs-for-kibana-connecting-to-elastic/244236 "2020-08-12T16:13:23Z")

</div>

So I am doing a demo of Elastic SIEM. Everything is working fine using http. Only a one server setup. Basic minimum, testing using PoC Domain. I do for the future want to know how to create certs using our domain using A…

---

## [Watcher results into new index](https://discuss.elastic.co/t/watcher-results-into-new-index/196051)

<div class="topic-metadata">

**Author:** [@Denis.topa](https://discuss.elastic.co/u/Denis.topa)\
**Replies:** 2\
**Last updated:** [August 22, 2019, 6:39am UTC](https://discuss.elastic.co/t/watcher-results-into-new-index/196051 "2019-08-22T06:39:06Z")

</div>

Hello. Is there a way to copy the entire document from a index to another as an watcher action? Here is what I want to achieve: I have several watchers configured which currently are sending alerts to email, but I wou…

---

## [Please help with Elasticsearch SQL Error: "Does not know how to convert argument Div\[\] for function Max\[\]"](https://discuss.elastic.co/t/please-help-with-elasticsearch-sql-error-does-not-know-how-to-convert-argument-div-for-function-max/161308)

<div class="topic-metadata">

**Author:** [@999chris](https://discuss.elastic.co/u/999chris)\
**Replies:** 2\
**Last updated:** [December 19, 2018, 10:11pm UTC](https://discuss.elastic.co/t/please-help-with-elasticsearch-sql-error-does-not-know-how-to-convert-argument-div-for-function-max/161308 "2018-12-19T22:11:47Z")

</div>

I'm getting the error on the following: SELECT AVG(((dateupdated-datecreated) + 0.0) / (DURATIONMILLIS + 0.0)) AS "Ratio" FROM "mip\*" WHERE key = 'ottvod' AND WORKFLOWSTATUSID = 0 GROUP BY 'PROVIDERID' Elasticsearch SQ…

---

## [Logstash : Cant filter syslog from Pfsense firewall](https://discuss.elastic.co/t/logstash-cant-filter-syslog-from-pfsense-firewall/66404)

<div class="topic-metadata">

**Author:** [@Patriote](https://discuss.elastic.co/u/Patriote)\
**Replies:** 2\
**Last updated:** [November 17, 2016, 4:54pm UTC](https://discuss.elastic.co/t/logstash-cant-filter-syslog-from-pfsense-firewall/66404 "2016-11-17T16:54:58Z")

</div>

hi everyone, i have an hard time filtering logs comming from a pfsense firewall i tried a lot of filters and groks but nothing's working it seems that logstash isnt reading filters or something doesnt any one have an id…

---

## [Negative HTTP responsetime](https://discuss.elastic.co/t/negative-http-responsetime/59988)

<div class="topic-metadata">

**Author:** [@cikenerd](https://discuss.elastic.co/u/cikenerd)\
**Replies:** 2\
**Last updated:** [September 8, 2016, 1:16pm UTC](https://discuss.elastic.co/t/negative-http-responsetime/59988 "2016-09-08T13:16:29Z")

</div>

Hi, I install packetbeat 1.3 ,I notice the negative response time in the kibana. Version: packetbeat version 1.3.0 (amd64) Operating System: CentOS release 6.5 (Final) , 2.6.32-431.23.3.el6.x86\_64 packetbeat.yml int…

---

## [Logstash partial updates](https://discuss.elastic.co/t/logstash-partial-updates/56378)

<div class="topic-metadata">

**Author:** [@lorello](https://discuss.elastic.co/u/lorello)\
**Replies:** 2\
**Last updated:** [July 27, 2016, 7:22am UTC](https://discuss.elastic.co/t/logstash-partial-updates/56378 "2016-07-27T07:22:24Z")

</div>

Can logstash run partial updates reading from a logfile? Example: index contains fields ID (used as document id), NAME, VALUE I read data from a logfile made of json lines and containing updates on the same records …

---

## [Attempting to use drop filter to discard events that match a type and string](https://discuss.elastic.co/t/attempting-to-use-drop-filter-to-discard-events-that-match-a-type-and-string/52921)

<div class="topic-metadata">

**Author:** [@skynardo](https://discuss.elastic.co/u/skynardo)\
**Replies:** 2\
**Last updated:** [June 17, 2016, 6:08am UTC](https://discuss.elastic.co/t/attempting-to-use-drop-filter-to-discard-events-that-match-a-type-and-string/52921 "2016-06-17T06:08:07Z")

</div>

This seems to not be working. Messages that I want dropped (postgres messages that contain the string "password") are being sent to Elasticsearch. Can someone help me with the error in my ways? elasticsearch-output.co…

---

## [Problem Plotting Zero values with Kibana](https://discuss.elastic.co/t/problem-plotting-zero-values-with-kibana/19213)

<div class="topic-metadata">

**Author:** [@shriyansh\_jain](https://discuss.elastic.co/u/shriyansh_jain)\
**Replies:** 2\
**Last updated:** [August 12, 2014, 12:13am UTC](https://discuss.elastic.co/t/problem-plotting-zero-values-with-kibana/19213 "2014-08-12T00:13:22Z")

</div>

Hi, I am using a ELK stack for log processing. One of the problem I am facing with kibana is that, I have some fields in my log whose values is zero, and zero is considered as legitimate value in my case. But when…

---

## [Kibana 8.19.21, 9.4.6, 9.5.3 Security Update (ESA-2026-178)](https://discuss.elastic.co/t/kibana-8-19-21-9-4-6-9-5-3-security-update-esa-2026-178/390164)

<div class="topic-metadata">

**Author:** [@Bryan\_Garcia](https://discuss.elastic.co/u/Bryan_Garcia)\
**Replies:** 0\
**Last updated:** [September 3, 2026, 6:03pm UTC](https://discuss.elastic.co/t/kibana-8-19-21-9-4-6-9-5-3-security-update-esa-2026-178/390164 "2026-09-03T18:03:25Z")

</div>

Incorrect Authorization in Kibana Leading to Unauthorized Configuration Modification Incorrect Authorization (CWE-863) in Kibana can lead to unauthorized configuration modification via Exploiting Incorrectly Configured …

---

## [Ingestion performance dropping by 10x daily](https://discuss.elastic.co/t/ingestion-performance-dropping-by-10x-daily/288537)

<div class="topic-metadata">

**Author:** [@TanguyB](https://discuss.elastic.co/u/TanguyB)\
**Replies:** 3\
**Last updated:** [November 6, 2021, 11:19am UTC](https://discuss.elastic.co/t/ingestion-performance-dropping-by-10x-daily/288537 "2021-11-06T11:19:46Z")

</div>

Hello, :wave: We are using Fluentbit to ingest Kubernetes cluster logs into Elasticsearch. Not sure what I am setting wrong, but every day, as the index grows, ingestion is worsening from 550k op/s to 40k op/s... Inge…

---

## [How to scrape a page with logstash](https://discuss.elastic.co/t/how-to-scrape-a-page-with-logstash/279892)

<div class="topic-metadata">

**Author:** [@francieliton\_araujo](https://discuss.elastic.co/u/francieliton_araujo)\
**Replies:** 3\
**Last updated:** [August 9, 2021, 11:26am UTC](https://discuss.elastic.co/t/how-to-scrape-a-page-with-logstash/279892 "2021-08-09T11:26:11Z")

</div>

We have an application that does not save to the database in real time, however it has a page that has some information in real time, I would like to access and scrape this information and put it inside elasticseach. ob…

---

## [Functionbeat deploy fails, citing issue with s3 bucket](https://discuss.elastic.co/t/functionbeat-deploy-fails-citing-issue-with-s3-bucket/260767)

<div class="topic-metadata">

**Author:** [@Jonathan\_Detert](https://discuss.elastic.co/u/Jonathan_Detert)\
**Replies:** 3\
**Last updated:** [January 12, 2021, 7:36pm UTC](https://discuss.elastic.co/t/functionbeat-deploy-fails-citing-issue-with-s3-bucket/260767 "2021-01-12T19:36:59Z")

</div>

I'm trying to use functionbeat for my first time, with a single function, of type kinesis, using functionbeat v6.8.13. When I run 'functionbeat deploy kinesis' (where 'kinesis' is the name i chose for the function name)…

---

## [Collapse inner hits](https://discuss.elastic.co/t/collapse-inner-hits/151337)

<div class="topic-metadata">

**Author:** [@zouxiang](https://discuss.elastic.co/u/zouxiang)\
**Replies:** 0\
**Last updated:** [October 7, 2018, 6:56am UTC](https://discuss.elastic.co/t/collapse-inner-hits/151337 "2018-10-07T06:56:10Z")

</div>

I use collapse to get goods with the lowest price: GET xxx/sku/\_search { "from": 0, "size": 10, "sort": \[ { "firstUpTime": { "order": "desc" } } \], "collapse": { "field": "goods…

---

## [OpsGenie Integration with elasticsearch](https://discuss.elastic.co/t/opsgenie-integration-with-elasticsearch/108184)

<div class="topic-metadata">

**Author:** [@Michael.Craig](https://discuss.elastic.co/u/Michael.Craig)\
**Replies:** 0\
**Last updated:** [November 17, 2017, 6:22pm UTC](https://discuss.elastic.co/t/opsgenie-integration-with-elasticsearch/108184 "2017-11-17T18:22:14Z")

</div>

Hello I am trying to print out the value which triggered my watcher to fire on OpsGenie. I can put the following fields into the alert fields as seen in the image \[upload\] After studying the json object in the logs f…

---

## [Postgresql Module Missing Field Errors](https://discuss.elastic.co/t/postgresql-module-missing-field-errors/100097)

<div class="topic-metadata">

**Author:** [@kwojcicki](https://discuss.elastic.co/u/kwojcicki)\
**Replies:** 3\
**Last updated:** [September 12, 2017, 3:10pm UTC](https://discuss.elastic.co/t/postgresql-module-missing-field-errors/100097 "2017-09-12T15:10:53Z")

</div>

Using PostgreSQL with dockerimage: library/postgres:9.5-alpine my metricbeat container (5.5.0) spits out the following errors: 2017/09/11 16:41:56.911310 schema.go:38: ERR Error on field 'query\_start': Error converting …

---

## [How to visualize data from different tables in database in a single visualization](https://discuss.elastic.co/t/how-to-visualize-data-from-different-tables-in-database-in-a-single-visualization/58428)

<div class="topic-metadata">

**Author:** [@sudarshan](https://discuss.elastic.co/u/sudarshan)\
**Replies:** 3\
**Last updated:** [August 19, 2016, 10:13pm UTC](https://discuss.elastic.co/t/how-to-visualize-data-from-different-tables-in-database-in-a-single-visualization/58428 "2016-08-19T22:13:12Z")

</div>

Hello I have two tables indexed as two different types into the same index. I need to create a single visualization out of two types based on a common column name. How can I do that? I am using "Enhanced Search Res…

---

## [Default codecs are different for 3.0 Kafka plugins](https://discuss.elastic.co/t/default-codecs-are-different-for-3-0-kafka-plugins/54468)

<div class="topic-metadata">

**Author:** [@sundar](https://discuss.elastic.co/u/sundar)\
**Replies:** 3\
**Last updated:** [July 13, 2016, 5:11pm UTC](https://discuss.elastic.co/t/default-codecs-are-different-for-3-0-kafka-plugins/54468 "2016-07-13T17:11:54Z")

</div>

Hello Logstash Team! Thanks for your help in pointing me to the correct plugin versions which support Kafka 0.9 in this topic: One peculiar thing we noticed (after much hair-pulling on why field extraction with KV fil…

---

## [Help elk stack](https://discuss.elastic.co/t/help-elk-stack/342595)

<div class="topic-metadata">

**Author:** [@Farah\_Bannour](https://discuss.elastic.co/u/Farah_Bannour)\
**Replies:** 6\
**Last updated:** [September 15, 2023, 6:05am UTC](https://discuss.elastic.co/t/help-elk-stack/342595 "2023-09-15T06:05:54Z")

</div>

Bonjour j'ai une question j ai un champs date\_le(qui contient le date exemple 20 tte date juillet 2022,13 aout 2023 etc je voulais faire le split de ca comme l annee , le mois et apres la date comment je peux faire ca …

---

## [Count occurrences of a variable term](https://discuss.elastic.co/t/count-occurrences-of-a-variable-term/304511)

<div class="topic-metadata">

**Author:** [@MobileOne](https://discuss.elastic.co/u/MobileOne)\
**Replies:** 6\
**Last updated:** [May 13, 2022, 6:24am UTC](https://discuss.elastic.co/t/count-occurrences-of-a-variable-term/304511 "2022-05-13T06:24:55Z")

</div>

In my logs I have a field "message" that has in it among other strings one term "UserID:" followed by a value. This value is mostly different in each document, but sometimes the same UserID is logged. I am trying to fi…

---

## [Index template order fields seems not to work](https://discuss.elastic.co/t/index-template-order-fields-seems-not-to-work/271778)

<div class="topic-metadata">

**Author:** [@Adriann](https://discuss.elastic.co/u/Adriann)\
**Replies:** 6\
**Last updated:** [May 6, 2021, 6:07pm UTC](https://discuss.elastic.co/t/index-template-order-fields-seems-not-to-work/271778 "2021-05-06T18:07:33Z")

</div>

Hello, I have few templates each for every index name based on the module name for ilm management. I notice that after the update to 7.12.1 all my indices have applied templates with order value 10 event though there a…

---

## [ECS fields not applied from index template](https://discuss.elastic.co/t/ecs-fields-not-applied-from-index-template/267056)

<div class="topic-metadata">

**Author:** [@jfs1](https://discuss.elastic.co/u/jfs1)\
**Replies:** 6\
**Last updated:** [March 25, 2021, 10:01am UTC](https://discuss.elastic.co/t/ecs-fields-not-applied-from-index-template/267056 "2021-03-25T10:01:02Z")

</div>

I'm trying to reformat my index template to migrate to ECS. I think I'm missing something because the field format for the multi-level keys is not taken into account. My index template looks like this : { "te…

---

## [Elasticsearch DB backup for last one hour for a particular index](https://discuss.elastic.co/t/elasticsearch-db-backup-for-last-one-hour-for-a-particular-index/238377)

<div class="topic-metadata">

**Author:** [@ad1982](https://discuss.elastic.co/u/ad1982)\
**Replies:** 6\
**Last updated:** [June 24, 2020, 7:04am UTC](https://discuss.elastic.co/t/elasticsearch-db-backup-for-last-one-hour-for-a-particular-index/238377 "2020-06-24T07:04:51Z")

</div>

Is there a way to take a backup a particular index for just the last 1 hour ? snapshot doesnt provide the time period option? Any ideas?

---

## [How to get only the information we want from the metricsbeat cloudwatch set?](https://discuss.elastic.co/t/how-to-get-only-the-information-we-want-from-the-metricsbeat-cloudwatch-set/206075)

<div class="topic-metadata">

**Author:** [@Ryan\_Waldron](https://discuss.elastic.co/u/Ryan_Waldron)\
**Replies:** 6\
**Last updated:** [November 1, 2019, 7:36pm UTC](https://discuss.elastic.co/t/how-to-get-only-the-information-we-want-from-the-metricsbeat-cloudwatch-set/206075 "2019-11-01T19:36:53Z")

</div>

We are trying to get only a few specific metrics from cloudwatch about our RDS instances (CPU, Memory, Etc). I have followed the documentation to try and come up with a configuration for metricbeats that works, and nothi…

---

## [GEOIP woes](https://discuss.elastic.co/t/geoip-woes/165467)

<div class="topic-metadata">

**Author:** [@nsutton](https://discuss.elastic.co/u/nsutton)\
**Replies:** 6\
**Last updated:** [January 24, 2019, 2:52pm UTC](https://discuss.elastic.co/t/geoip-woes/165467 "2019-01-24T14:52:26Z")

</div>

I've trawled through post after post about GEOIP to on avail. I think my problem might lie in a minimul understanding of mappings. I have a fortigate firewall that is sending its logs via syslog to logstash. This all …

---

## [Remove Elasticsearch Timer Daemon Threads](https://discuss.elastic.co/t/remove-elasticsearch-timer-daemon-threads/127998)

<div class="topic-metadata">

**Author:** [@neel\_patel](https://discuss.elastic.co/u/neel_patel)\
**Replies:** 6\
**Last updated:** [April 16, 2018, 12:14pm UTC](https://discuss.elastic.co/t/remove-elasticsearch-timer-daemon-threads/127998 "2018-04-16T12:14:36Z")

</div>

Hi While doing bulk request to elasticsearch ,we are observing to many daemon thread. Which are Elasticsearch Timer daemon thread. How we can stop or kill these and free the memory? For every bulk request it generati…

[Previous page](https://discuss.elastic.co/top.md?page=1473&per_page=50&period=all)

[Next page](https://discuss.elastic.co/top.md?page=1475&per_page=50&period=all)
