# Top

**URL:** https://discuss.elastic.co/top.md?page=1709&period=all

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1710

---

## [Changing Unique Key of Elastic Search Index (Id column)](https://discuss.elastic.co/t/changing-unique-key-of-elastic-search-index-id-column/289582)

<div class="topic-metadata">

**Author:** [@amey\_kulkarni](https://discuss.elastic.co/u/amey_kulkarni)\
**Replies:** 1\
**Last updated:** [November 22, 2021, 12:12am UTC](https://discuss.elastic.co/t/changing-unique-key-of-elastic-search-index-id-column/289582 "2021-11-22T00:12:05Z")

</div>

We have a requirement to set value of id column (unique key) of an index to values coming from data (values of couple of columns from data). Id column value is set for each document by default. We want to override it wi…

---

## [How to apply parse failure tag only when message fails BOTH filters instead of just one?](https://discuss.elastic.co/t/how-to-apply-parse-failure-tag-only-when-message-fails-both-filters-instead-of-just-one/244833)

<div class="topic-metadata">

**Author:** [@drjosephliu](https://discuss.elastic.co/u/drjosephliu)\
**Replies:** 1\
**Last updated:** [August 13, 2020, 2:28pm UTC](https://discuss.elastic.co/t/how-to-apply-parse-failure-tag-only-when-message-fails-both-filters-instead-of-just-one/244833 "2020-08-13T14:28:45Z")

</div>

My logtash config has two filters: 1) parses a log message and 2) parses a JSON message: filter { grok { match =\> { "message" =\> "\\\[%{TIMESTAMP\_ISO8601:log\_time}\\\]\\\[%{LOGLEVEL:log\_level}(?\<space\>\\s\*)\\\]\\\[%{DATA…

---

## [Looking for a way to prune fields with certain text in them but struggling with the prune filter and regex](https://discuss.elastic.co/t/looking-for-a-way-to-prune-fields-with-certain-text-in-them-but-struggling-with-the-prune-filter-and-regex/154804)

<div class="topic-metadata">

**Author:** [@shog1466112](https://discuss.elastic.co/u/shog1466112)\
**Replies:** 1\
**Last updated:** [October 31, 2018, 5:57pm UTC](https://discuss.elastic.co/t/looking-for-a-way-to-prune-fields-with-certain-text-in-them-but-struggling-with-the-prune-filter-and-regex/154804 "2018-10-31T17:57:17Z")

</div>

I'm pushing logstash node stats into Elasticsearch with the following pipeline setup: input { exec { command =\> "curl -s http://localhost:9600/\_node/stats" interval =\> 15 } } filter { json { source =\> …

---

## [Kibana Reporting is not working : Max attempts reached (3)](https://discuss.elastic.co/t/kibana-reporting-is-not-working-max-attempts-reached-3/113770)

<div class="topic-metadata">

**Author:** [@uvarisubash](https://discuss.elastic.co/u/uvarisubash)\
**Replies:** 1\
**Last updated:** [January 3, 2018, 2:59am UTC](https://discuss.elastic.co/t/kibana-reporting-is-not-working-max-attempts-reached-3/113770 "2018-01-03T02:59:30Z")

</div>

Continuing the discussion from Kibana Reporting: Max attempts reached (3): Kibana Reporting is not working : Max attempts reached (3)

---

## [Event Handling in Kibana](https://discuss.elastic.co/t/event-handling-in-kibana/50178)

<div class="topic-metadata">

**Author:** [@GINS007](https://discuss.elastic.co/u/GINS007)\
**Replies:** 1\
**Last updated:** [May 17, 2016, 3:38pm UTC](https://discuss.elastic.co/t/event-handling-in-kibana/50178 "2016-05-17T15:38:05Z")

</div>

I want to handle events triggering on Kibana visualizations from the dashboard.When a click event is triggered I want to open a popup or navigate to other screen.Can anyone help me on this ?

---

## [Shield integration with CAS](https://discuss.elastic.co/t/shield-integration-with-cas/44515)

<div class="topic-metadata">

**Author:** [@udaykirankona](https://discuss.elastic.co/u/udaykirankona)\
**Replies:** 1\
**Last updated:** [March 16, 2016, 10:14am UTC](https://discuss.elastic.co/t/shield-integration-with-cas/44515 "2016-03-16T10:14:40Z")

</div>

Can we integrate shield with CAS (Central Authentication Service). If yes, can you please provide the procedure to do it. Thanks in Advance

---

## [Logstash service fails to start due to Ruby Error](https://discuss.elastic.co/t/logstash-service-fails-to-start-due-to-ruby-error/300902)

<div class="topic-metadata">

**Author:** [@ASA01](https://discuss.elastic.co/u/ASA01)\
**Replies:** 2\
**Last updated:** [March 29, 2022, 12:45pm UTC](https://discuss.elastic.co/t/logstash-service-fails-to-start-due-to-ruby-error/300902 "2022-03-29T12:45:25Z")

</div>

I cannot get logstash to start and keep running. I have verified all my logstash confs work individually with test\_and\_exit, but when I try to start it as a service I get the following error. \[2022-03-29T01:37:10,010\]\[…

---

## [Unable to have data in kibana from filebeat](https://discuss.elastic.co/t/unable-to-have-data-in-kibana-from-filebeat/262534)

<div class="topic-metadata">

**Author:** [@Jean-P](https://discuss.elastic.co/u/Jean-P)\
**Replies:** 2\
**Last updated:** [February 2, 2021, 9:29am UTC](https://discuss.elastic.co/t/unable-to-have-data-in-kibana-from-filebeat/262534 "2021-02-02T09:29:50Z")

</div>

Hello, Actually, I tried to use Filebeat to transmit my logs to elastcisearch to have data in kibana. But I receive no data in Kibana. Here is my config file for Filebeat: filebeat.yml: filebeat.inputs: type: log …

---

## [Kibana canvas datatable in multiple pages](https://discuss.elastic.co/t/kibana-canvas-datatable-in-multiple-pages/257483)

<div class="topic-metadata">

**Author:** [@Hugo\_Barbachano](https://discuss.elastic.co/u/Hugo_Barbachano)\
**Replies:** 2\
**Last updated:** [December 3, 2020, 12:54pm UTC](https://discuss.elastic.co/t/kibana-canvas-datatable-in-multiple-pages/257483 "2020-12-03T12:54:10Z")

</div>

Hello, Is there a way to display data tables in a canvas in such a way that each data table takes multiple pages if needed instead of having it displayed in a scrollbar view? I am asking this because my client needs pr…

---

## [Ingest pipeline not working correctly?](https://discuss.elastic.co/t/ingest-pipeline-not-working-correctly/253291)

<div class="topic-metadata">

**Author:** [@iamtheliquor](https://discuss.elastic.co/u/iamtheliquor)\
**Replies:** 2\
**Last updated:** [October 27, 2020, 10:36am UTC](https://discuss.elastic.co/t/ingest-pipeline-not-working-correctly/253291 "2020-10-27T10:36:55Z")

</div>

Hi everybody, We have two pipelines, that are identical, one is for staging and one is for production logs; { "staging\_pipeline" : { "description" : "Staging Pipeline", "processors" : \[ …

---

## [Filebeat error with helm3](https://discuss.elastic.co/t/filebeat-error-with-helm3/246181)

<div class="topic-metadata">

**Author:** [@Raman\_Sawhney](https://discuss.elastic.co/u/Raman_Sawhney)\
**Replies:** 2\
**Last updated:** [August 25, 2020, 6:28pm UTC](https://discuss.elastic.co/t/filebeat-error-with-helm3/246181 "2020-08-25T18:28:19Z")

</div>

I am getting error while deploying autodiscover in our environment Error: Exiting: error in autodiscover provider settings: error setting up kubernetes autodiscover provider: missing field accessing 'filebeat.autodiscov…

---

## [Metricbeat - Add a custom field with existing value](https://discuss.elastic.co/t/metricbeat-add-a-custom-field-with-existing-value/213873)

<div class="topic-metadata">

**Author:** [@Sudharshan\_K\_S](https://discuss.elastic.co/u/Sudharshan_K_S)\
**Replies:** 2\
**Last updated:** [January 31, 2020, 8:15am UTC](https://discuss.elastic.co/t/metricbeat-add-a-custom-field-with-existing-value/213873 "2020-01-31T08:15:20Z")

</div>

How can i add a custom field whose value will be equal to an exiting field Eg processors: -add\_fields: fields: new\_field: host.name

---

## [How to reset elastic user?](https://discuss.elastic.co/t/how-to-reset-elastic-user/192750)

<div class="topic-metadata">

**Author:** [@Duggina](https://discuss.elastic.co/u/Duggina)\
**Replies:** 2\
**Last updated:** [August 7, 2019, 7:55pm UTC](https://discuss.elastic.co/t/how-to-reset-elastic-user/192750 "2019-08-07T19:55:51Z")

</div>

Hi, is there any way to reset elastic user password with out going to the deployment/security ? Thanks Gopala

---

## [Frozen indices does not return data](https://discuss.elastic.co/t/frozen-indices-does-not-return-data/192273)

<div class="topic-metadata">

**Author:** [@aurimas](https://discuss.elastic.co/u/aurimas)\
**Replies:** 2\
**Last updated:** [July 26, 2019, 9:45am UTC](https://discuss.elastic.co/t/frozen-indices-does-not-return-data/192273 "2019-07-26T09:45:38Z")

</div>

Hi, I am running Elastic 6.61 version and trying to use frozen indices. But same queries I used before does not return any data neither in Grafana nor in Postman. Do I have to do anything different when I use frozen in…

---

## [Help on a query with dev tools](https://discuss.elastic.co/t/help-on-a-query-with-dev-tools/190282)

<div class="topic-metadata">

**Author:** [@Pierre-Philippe](https://discuss.elastic.co/u/Pierre-Philippe)\
**Replies:** 2\
**Last updated:** [July 22, 2019, 5:37pm UTC](https://discuss.elastic.co/t/help-on-a-query-with-dev-tools/190282 "2019-07-22T17:37:09Z")

</div>

Hi there, I'm trying to get the first occurence of the logs containing a given {user\_uuid + user\_agent}, the objective being to retrieve the my users' user\_agent (both platform and string) at the time of the first connex…

---

## [After upgrading from Elasticsearch 6.5 to 6.6 - All shards failed](https://discuss.elastic.co/t/after-upgrading-from-elasticsearch-6-5-to-6-6-all-shards-failed/167366)

<div class="topic-metadata">

**Author:** [@rafael.gumiero](https://discuss.elastic.co/u/rafael.gumiero)\
**Replies:** 2\
**Last updated:** [February 25, 2019, 8:27am UTC](https://discuss.elastic.co/t/after-upgrading-from-elasticsearch-6-5-to-6-6-all-shards-failed/167366 "2019-02-25T08:27:59Z")

</div>

Hi Team, I have performed update via repository and the following error is occurring in Elasticsearch: Environment: uname -r 3.10.0-957.5.1.el7.x86\_64 cat /etc/redhat-release Red Hat Enterprise Linux Server release 7…

---

## [Watcher hits return only 10 documents](https://discuss.elastic.co/t/watcher-hits-return-only-10-documents/159357)

<div class="topic-metadata">

**Author:** [@Francisca\_Lima](https://discuss.elastic.co/u/Francisca_Lima)\
**Replies:** 2\
**Last updated:** [December 4, 2018, 3:53pm UTC](https://discuss.elastic.co/t/watcher-hits-return-only-10-documents/159357 "2018-12-04T15:53:41Z")

</div>

Hello, I'm trying to do a chain input in X-Pack Watcher, querying the same index with different filters and aggregating values. I use the results of the aggregation and transform them in a script. However, each aggregat…

---

## [How to restart a data node that was stopped for a long time](https://discuss.elastic.co/t/how-to-restart-a-data-node-that-was-stopped-for-a-long-time/157675)

<div class="topic-metadata">

**Author:** [@mahn](https://discuss.elastic.co/u/mahn)\
**Replies:** 2\
**Last updated:** [November 21, 2018, 5:02pm UTC](https://discuss.elastic.co/t/how-to-restart-a-data-node-that-was-stopped-for-a-long-time/157675 "2018-11-21T17:02:55Z")

</div>

We plan to restart a data note that was stopped for a long time ( \> 20 days). Cluster version is 6.4.1 and it is in green state. Can we simply restart elasticsearch on the node or should we perform some operations befo…

---

## [Performances ruby/redis vs translate filter](https://discuss.elastic.co/t/performances-ruby-redis-vs-translate-filter/150094)

<div class="topic-metadata">

**Author:** [@drosys](https://discuss.elastic.co/u/drosys)\
**Replies:** 2\
**Last updated:** [September 27, 2018, 10:37pm UTC](https://discuss.elastic.co/t/performances-ruby-redis-vs-translate-filter/150094 "2018-09-27T22:37:28Z")

</div>

Dear All, I have a use case where i need to be able to compare high volume of data (fields like ip addr) to large IP databases. I have think about the approach of using ruby filter with redis socket connection (with in…

---

## [Client node unable to discover master node after master restarts and gets new IP](https://discuss.elastic.co/t/client-node-unable-to-discover-master-node-after-master-restarts-and-gets-new-ip/140635)

<div class="topic-metadata">

**Author:** [@Sonia\_Gupta](https://discuss.elastic.co/u/Sonia_Gupta)\
**Replies:** 2\
**Last updated:** [July 19, 2018, 3:54am UTC](https://discuss.elastic.co/t/client-node-unable-to-discover-master-node-after-master-restarts-and-gets-new-ip/140635 "2018-07-19T03:54:26Z")

</div>

I have a 1 client/ 2 data/ 3 master Elasticsearch 6.2.2 cluster spread over 3 node vpshere environment. This is a kubernetes system. Data and master are statefulsets. Master has a service sitting on it acting as the disc…

---

## [Handling duplicate data in Logstash + Elastic Search](https://discuss.elastic.co/t/handling-duplicate-data-in-logstash-elastic-search/116229)

<div class="topic-metadata">

**Author:** [@Patrik\_Iselind](https://discuss.elastic.co/u/Patrik_Iselind)\
**Replies:** 2\
**Last updated:** [January 28, 2018, 9:28pm UTC](https://discuss.elastic.co/t/handling-duplicate-data-in-logstash-elastic-search/116229 "2018-01-28T21:28:10Z")

</div>

Hi, First some background: I have an ELK stack running in an docker compose environment, so far for learning purposes. Logstash gets its input from a AWS S3 bucket and sends its output to the Elastic Search server. The…

---

## [@metadata and regexp named groups](https://discuss.elastic.co/t/metadata-and-regexp-named-groups/93237)

<div class="topic-metadata">

**Author:** [@danielmotaleite](https://discuss.elastic.co/u/danielmotaleite)\
**Replies:** 2\
**Last updated:** [August 4, 2017, 5:35pm UTC](https://discuss.elastic.co/t/metadata-and-regexp-named-groups/93237 "2017-08-04T17:35:18Z")

</div>

in the url https://www.elastic.co/guide/en/logstash/current/event-dependent-configuration.html we can see that we can use \[@metadata\]\[timestamp\] in a grok: filter { grok { match =\> \[ "message", "%{HTTPDATE:\[@metadat…

---

## [Openshift and logstash](https://discuss.elastic.co/t/openshift-and-logstash/87776)

<div class="topic-metadata">

**Author:** [@pahermoso](https://discuss.elastic.co/u/pahermoso)\
**Replies:** 2\
**Last updated:** [May 31, 2017, 4:47pm UTC](https://discuss.elastic.co/t/openshift-and-logstash/87776 "2017-05-31T16:47:58Z")

</div>

Hi, I'm thinking to use logstash to increase the quality of logs coming from an Openshift platform. These logs are captured with FluentD and included into an Elasticsearch index directly. My intention is to handle log…

---

## [Logstash & JSON](https://discuss.elastic.co/t/logstash-json/72377)

<div class="topic-metadata">

**Author:** [@alexus](https://discuss.elastic.co/u/alexus)\
**Replies:** 2\
**Last updated:** [January 23, 2017, 5:45pm UTC](https://discuss.elastic.co/t/logstash-json/72377 "2017-01-23T17:45:02Z")

</div>

I'm trying to configure Logstash with JSON. logstash configuration: root@596f81c45ea4:~# cat /etc/logstash/conf.d/\* | grep -v \\# input { gelf { codec =\> "json" } } filter { json { source =\> "message" } } …

---

## [Display of date ranges in x Axis is not readable in visualizations](https://discuss.elastic.co/t/display-of-date-ranges-in-x-axis-is-not-readable-in-visualizations/48303)

<div class="topic-metadata">

**Author:** [@christophe\_spielmann](https://discuss.elastic.co/u/christophe_spielmann)\
**Replies:** 2\
**Last updated:** [April 28, 2016, 3:34pm UTC](https://discuss.elastic.co/t/display-of-date-ranges-in-x-axis-is-not-readable-in-visualizations/48303 "2016-04-28T15:34:35Z")

</div>

Kibana 4.2.0 I have set up a date range visualize as a trend using 'now' as end time. Unfortunately the X Axis date range is too large to be displayed correctly. I am not able to find a workaround yet. Formatting o…

---

## [How do I know/or make sure that elastic search does not add same log file twice?](https://discuss.elastic.co/t/how-do-i-know-or-make-sure-that-elastic-search-does-not-add-same-log-file-twice/45736)

<div class="topic-metadata">

**Author:** [@Dani](https://discuss.elastic.co/u/Dani)\
**Replies:** 2\
**Last updated:** [March 30, 2016, 5:37am UTC](https://discuss.elastic.co/t/how-do-i-know-or-make-sure-that-elastic-search-does-not-add-same-log-file-twice/45736 "2016-03-30T05:37:52Z")

</div>

When using a file input, with elasticsearch output how do I make sure that each of the lines in the log files I generate, and have logstash process only get added once? If I add another output, like S3 some time late…

---

## [Index meta data stored in seperate files](https://discuss.elastic.co/t/index-meta-data-stored-in-seperate-files/39279)

<div class="topic-metadata">

**Author:** [@snkevin](https://discuss.elastic.co/u/snkevin)\
**Replies:** 2\
**Last updated:** [January 14, 2016, 9:58pm UTC](https://discuss.elastic.co/t/index-meta-data-stored-in-seperate-files/39279 "2016-01-14T21:58:28Z")

</div>

I'm wondering if elastic is capable of this, I'm using the attachment-mapper plugin and the river web crawler to index PDF files and webpages. I'd like to have a metadata file accompany each PDF and webpage with meta dat…

---

## [Scoring inconsistency across shards](https://discuss.elastic.co/t/scoring-inconsistency-across-shards/33063)

<div class="topic-metadata">

**Author:** [@arunnrajagopalan](https://discuss.elastic.co/u/arunnrajagopalan)\
**Replies:** 2\
**Last updated:** [October 27, 2015, 12:20pm UTC](https://discuss.elastic.co/t/scoring-inconsistency-across-shards/33063 "2015-10-27T12:20:59Z")

</div>

Hi , I am trying to run a like\_text query with tf set to false. I am seeing the queryNorm being inconsistent across shards. This is causing issues with sorting. Here is my query : { …

---

## [RabbitMQ Ack Question](https://discuss.elastic.co/t/rabbitmq-ack-question/31715)

<div class="topic-metadata">

**Author:** [@spynxo](https://discuss.elastic.co/u/spynxo)\
**Replies:** 2\
**Last updated:** [October 6, 2015, 7:27pm UTC](https://discuss.elastic.co/t/rabbitmq-ack-question/31715 "2015-10-06T19:27:32Z")

</div>

It seems like with RabbitMQ you can enable acknowledgements on the input so the message only gets deleted from the server if it was successfully received. Is there any way to make it so acknowledgments are sent only if t…

---

## [SSL/TLS connection between ELK-Stack with Docker](https://discuss.elastic.co/t/ssl-tls-connection-between-elk-stack-with-docker/331040)

<div class="topic-metadata">

**Author:** [@Lokutus25](https://discuss.elastic.co/u/Lokutus25)\
**Replies:** 5\
**Last updated:** [June 5, 2023, 8:01am UTC](https://discuss.elastic.co/t/ssl-tls-connection-between-elk-stack-with-docker/331040 "2023-06-05T08:01:08Z")

</div>

Hi, I have a big problem with my ELK-Stack (version 8.7.0) created with docker. I have created elasticsearch, kibana, logstash and filebeat with docker-compose. elasticsearch and kibana connects per ssl with the token…

---

## [Rollup - date histogram issues](https://discuss.elastic.co/t/rollup-date-histogram-issues/328509)

<div class="topic-metadata">

**Author:** [@JeroenK](https://discuss.elastic.co/u/JeroenK)\
**Replies:** 5\
**Last updated:** [April 14, 2023, 3:47pm UTC](https://discuss.elastic.co/t/rollup-date-histogram-issues/328509 "2023-04-14T15:47:42Z")

</div>

I have a rollup job with the following settings: "groups": { "date\_histogram": { "field": "timestamp", "time\_zone": "Europe/Stockholm", "calendar\_interval"…

---

## [Logstash xml split filter](https://discuss.elastic.co/t/logstash-xml-split-filter/141154)

<div class="topic-metadata">

**Author:** [@Naveen\_Reddy\_Sama](https://discuss.elastic.co/u/Naveen_Reddy_Sama)\
**Replies:** 5\
**Last updated:** [July 23, 2018, 12:42pm UTC](https://discuss.elastic.co/t/logstash-xml-split-filter/141154 "2018-07-23T12:42:36Z")

</div>

Hi team, using the below logstash confg file xml filter filter { xml { source =\> "message" target =\> "xml\_content" } split { field =\> "xml\_content\[station\]" } split { field =\> "xml\_content\[station\]\[name\]" } …

---

## [Difference between sqto and sfto](https://discuss.elastic.co/t/difference-between-sqto-and-sfto/133890)

<div class="topic-metadata">

**Author:** [@pratik.tari](https://discuss.elastic.co/u/pratik.tari)\
**Replies:** 5\
**Last updated:** [June 1, 2018, 7:00am UTC](https://discuss.elastic.co/t/difference-between-sqto-and-sfto/133890 "2018-06-01T07:00:45Z")

</div>

What is the difference between sqto and sfto. I assume sqto is search query operation per shard and sfto is fetching source of the document once we have document ids from search query operations. I cannot find anything …

---

## [Strange Highlighting](https://discuss.elastic.co/t/strange-highlighting/70361)

<div class="topic-metadata">

**Author:** [@vikas.saini](https://discuss.elastic.co/u/vikas.saini)\
**Replies:** 5\
**Last updated:** [January 4, 2017, 1:36pm UTC](https://discuss.elastic.co/t/strange-highlighting/70361 "2017-01-04T13:36:32Z")

</div>

Along with the matched word elasticsearch is highlighting single letter present in the content field . I am using elasticsearch1.7.2 . Below are mapping I am using . I am highlighting content field . PUT nms\_reposito…

---

## [When I index some documents and they are not refreshed yet, can I deleted them?](https://discuss.elastic.co/t/when-i-index-some-documents-and-they-are-not-refreshed-yet-can-i-deleted-them/45085)

<div class="topic-metadata">

**Author:** [@makeyang](https://discuss.elastic.co/u/makeyang)\
**Replies:** 5\
**Last updated:** [March 22, 2016, 11:09am UTC](https://discuss.elastic.co/t/when-i-index-some-documents-and-they-are-not-refreshed-yet-can-i-deleted-them/45085 "2016-03-22T11:09:42Z")

</div>

let's say I bulk insert some documents and then I want to delete them, can ES handle it properly? if so, how?

---

## [Shards fail to reallocate](https://discuss.elastic.co/t/shards-fail-to-reallocate/9212)

<div class="topic-metadata">

**Author:** [@Ivan](https://discuss.elastic.co/u/Ivan)\
**Replies:** 5\
**Last updated:** [October 2, 2012, 9:36pm UTC](https://discuss.elastic.co/t/shards-fail-to-reallocate/9212 "2012-10-02T21:36:05Z")

</div>

I have a 12 node cluster running 0.19.8 with two-three 100gb indices that have between six-eight shards and one replica. Not in production, so there are not many queries. One index gets bulk updated about every 2 hours…

---

## [Gather logs from podman containers](https://discuss.elastic.co/t/gather-logs-from-podman-containers/333073)

<div class="topic-metadata">

**Author:** [@asp](https://discuss.elastic.co/u/asp)\
**Replies:** 0\
**Last updated:** [May 10, 2023, 10:44am UTC](https://discuss.elastic.co/t/gather-logs-from-podman-containers/333073 "2023-05-10T10:44:40Z")

</div>

Hi, If I understand the documentation correctly the best practice for shipping logs of docker-container is the following: using container input - type: container stream: stdout paths: - "/var/log/containers/\*.…

---

## [Adding Custom processors with Elastic-Agent](https://discuss.elastic.co/t/adding-custom-processors-with-elastic-agent/324958)

<div class="topic-metadata">

**Author:** [@Blason](https://discuss.elastic.co/u/Blason)\
**Replies:** 3\
**Last updated:** [February 8, 2023, 3:47am UTC](https://discuss.elastic.co/t/adding-custom-processors-with-elastic-agent/324958 "2023-02-08T03:47:20Z")

</div>

Hi, I wrote a custom parser with dissect processor for collecting fail2ban-logs. Those are working fine for the servers where logs are being collected using filebeat however I am not sure how do I add those with where I…

---

## [Limit of total fields \[1000\] has been exceeded- elasticsearch\_metrics](https://discuss.elastic.co/t/limit-of-total-fields-1000-has-been-exceeded-elasticsearch-metrics/275848)

<div class="topic-metadata">

**Author:** [@ethrbunny](https://discuss.elastic.co/u/ethrbunny)\
**Replies:** 0\
**Last updated:** [June 14, 2021, 2:05pm UTC](https://discuss.elastic.co/t/limit-of-total-fields-1000-has-been-exceeded-elasticsearch-metrics/275848 "2021-06-14T14:05:42Z")

</div>

Im attempting to reroute elasticsearch metrics (via metricbeat) from my primary cluster to a monitoring cluster. Monitoring cluster is running 7.13.1 on Centos 8 - main is 7.11.1. Hitting this error when I restart metri…

---

## [Kibana converts any date and month to a specific date and month](https://discuss.elastic.co/t/kibana-converts-any-date-and-month-to-a-specific-date-and-month/272838)

<div class="topic-metadata">

**Author:** [@SUMANT\_MISHRA](https://discuss.elastic.co/u/SUMANT_MISHRA)\
**Replies:** 3\
**Last updated:** [May 13, 2021, 4:17am UTC](https://discuss.elastic.co/t/kibana-converts-any-date-and-month-to-a-specific-date-and-month/272838 "2021-05-13T04:17:41Z")

</div>

Hi All, I am facing issues in date format. I have dates in '2021-05-03 23:11:25.84' format. If I create mapping like: { "format": "YYYY-MM-DD HH:mm:ss.SSS||YYYY-MM-DD HH:mm: ss.SS ||YYYY-MM-DD HH:mm:ss.S", …

---

## [CentOS: Failed to start Elasticsearch 7.3.1](https://discuss.elastic.co/t/centos-failed-to-start-elasticsearch-7-3-1/254767)

<div class="topic-metadata">

**Author:** [@obi134](https://discuss.elastic.co/u/obi134)\
**Replies:** 3\
**Last updated:** [November 10, 2020, 7:54pm UTC](https://discuss.elastic.co/t/centos-failed-to-start-elasticsearch-7-3-1/254767 "2020-11-10T19:54:34Z")

</div>

Hi there, Some time ago I installed ELKB-Stack on CentOS7. It was running great. Everything was working. Unfortunately it was broken about half a year ago, but I did not got time to look after it earlier. In meantime I…

---

## [SSL with Filebeat not working](https://discuss.elastic.co/t/ssl-with-filebeat-not-working/250520)

<div class="topic-metadata">

**Author:** [@santos1204](https://discuss.elastic.co/u/santos1204)\
**Replies:** 3\
**Last updated:** [September 30, 2020, 5:00pm UTC](https://discuss.elastic.co/t/ssl-with-filebeat-not-working/250520 "2020-09-30T17:00:54Z")

</div>

Hi, I'm trying to secure the traffic between filebeats hosts and the logstash server, my logstash config is; input { beats { port =\> 5044 ssl =\> true ssl\_certificate\_authorities =\> \["/etc/filebeat/removed.pem"\] s…

---

## [How to add multiple conditions in single if statement if ((A==1) && (B==( 2 || 3))](https://discuss.elastic.co/t/how-to-add-multiple-conditions-in-single-if-statement-if-a-1-b-2-3/212103)

<div class="topic-metadata">

**Author:** [@Abdulrahman\_Batis](https://discuss.elastic.co/u/Abdulrahman_Batis)\
**Replies:** 3\
**Last updated:** [December 17, 2019, 2:56pm UTC](https://discuss.elastic.co/t/how-to-add-multiple-conditions-in-single-if-statement-if-a-1-b-2-3/212103 "2019-12-17T14:56:26Z")

</div>

I want to add tags to some known issue to make it easier to identified as known issue what we want to do is to add tag to logs messages only if that message came from 2 or 3 different process , for example: if "error…

---

## [\[ANNOUNCEMENT\] Logstash H3 filter plugin released](https://discuss.elastic.co/t/announcement-logstash-h3-filter-plugin-released/207830)

<div class="topic-metadata">

**Author:** [@val](https://discuss.elastic.co/u/val)\
**Replies:** 0\
**Last updated:** [November 14, 2019, 7:54am UTC](https://discuss.elastic.co/t/announcement-logstash-h3-filter-plugin-released/207830 "2019-11-14T07:54:35Z")

</div>

Following up on the release of the ingest-h3 ingest processor a few weeks ago, I'm happy to announce that a Logstash h3 filter is now also available for generating Uber H3 indexes from a given geolocation point at specif…

---

## [Retrofitting Filebeat into my ELK stack](https://discuss.elastic.co/t/retrofitting-filebeat-into-my-elk-stack/203282)

<div class="topic-metadata">

**Author:** [@mhare](https://discuss.elastic.co/u/mhare)\
**Replies:** 8\
**Last updated:** [October 24, 2019, 4:47pm UTC](https://discuss.elastic.co/t/retrofitting-filebeat-into-my-elk-stack/203282 "2019-10-24T16:47:22Z")

</div>

I am ingesting 8 different CSV file schemas using 8 logstash pipelines and reading from a Windows file share. IT has been recommending to not read across the file share but use Filebeat. Not finding just a whole bunch o…

---

## [Updating date fields not working](https://discuss.elastic.co/t/updating-date-fields-not-working/199492)

<div class="topic-metadata">

**Author:** [@ebdavison](https://discuss.elastic.co/u/ebdavison)\
**Replies:** 3\
**Last updated:** [September 16, 2019, 1:40pm UTC](https://discuss.elastic.co/t/updating-date-fields-not-working/199492 "2019-09-16T13:40:19Z")

</div>

I have a document that I am trying to update and it contains a date. If the source gets updated (in a RDBMS) then I am trying to update the document in elasticsearch. The document, ID 1, is like this: { '@…

---

## [Logstash-plain.log에 특정 에러가 나타납니다](https://discuss.elastic.co/t/logstash-plain-log/146610)

<div class="topic-metadata">

**Author:** [@wonki](https://discuss.elastic.co/u/wonki)\
**Replies:** 0\
**Last updated:** [August 30, 2018, 4:16am UTC](https://discuss.elastic.co/t/logstash-plain-log/146610 "2018-08-30T04:16:04Z")

</div>

안녕하세요? 현재 filebeat - logstash -elasticsearch 까지 특정 데이터 파일을 읽어와서 e/s에 저장하는건 문제가 없는데, 우연히 logstash-plain.log 데이터를 살펴보니 주기적으로 아래와 같은 오류가 기록되고 있었습니다. ( 30초에 한번씩은 기록되는 것 같아요) 현재 var/lib/logstash/queue directory의 permission…

---

## [Kibana watcher to email dashboard report error](https://discuss.elastic.co/t/kibana-watcher-to-email-dashboard-report-error/141429)

<div class="topic-metadata">

**Author:** [@gursharanaulakh](https://discuss.elastic.co/u/gursharanaulakh)\
**Replies:** 3\
**Last updated:** [July 25, 2018, 12:54am UTC](https://discuss.elastic.co/t/kibana-watcher-to-email-dashboard-report-error/141429 "2018-07-25T00:54:53Z")

</div>

I have setup kibana watcher to email me pdf attachment of my dashboard but every time it fails with connection time out error. Watcher setting: "actions": { "email\_admin": { "email": { "profile": "standard", "attach…

---

## [Filebeat losing pointer and reading file from start](https://discuss.elastic.co/t/filebeat-losing-pointer-and-reading-file-from-start/137331)

<div class="topic-metadata">

**Author:** [@paano](https://discuss.elastic.co/u/paano)\
**Replies:** 3\
**Last updated:** [June 27, 2018, 1:25am UTC](https://discuss.elastic.co/t/filebeat-losing-pointer-and-reading-file-from-start/137331 "2018-06-27T01:25:38Z")

</div>

Beats: 6.2.3 Have using filebeat for most of the our ELK solution to stream log files in to Elastic. IN one of the scenario, filebeat is reading the file from start. scenario: On a secure server, have rsync service sh…

---

## [Getting saved searches (objects) for plugin use](https://discuss.elastic.co/t/getting-saved-searches-objects-for-plugin-use/104098)

<div class="topic-metadata">

**Author:** [@Usama\_Ahmad](https://discuss.elastic.co/u/Usama_Ahmad)\
**Replies:** 3\
**Last updated:** [October 17, 2017, 11:58am UTC](https://discuss.elastic.co/t/getting-saved-searches-objects-for-plugin-use/104098 "2017-10-17T11:58:44Z")

</div>

Hi, I'm new to kibana and i'm trying to experiment with its plugins. I want to get the saved searches (Objects) to use in my plugin. e.g. If i saved a search named "nameSearch" with the search content as "nabeel\*" . I w…

[Previous page](https://discuss.elastic.co/top.md?page=1708&per_page=50&period=all)

[Next page](https://discuss.elastic.co/top.md?page=1710&per_page=50&period=all)
