# Latest

**URL:** https://discuss.elastic.co/latest.md?page=1003

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1004

---

## [How keystore works](https://discuss.elastic.co/t/how-keystore-works/312274)

<div class="topic-metadata">

**Author:** [@GustavoPires](https://discuss.elastic.co/u/GustavoPires)\
**Replies:** 1\
**Last updated:** [August 18, 2022, 3:59am UTC](https://discuss.elastic.co/t/how-keystore-works/312274 "2022-08-18T03:59:31Z")

</div>

Hello, can someone explain me what is the purpose of the keystore and how can I configure it?

---

## [Backreference in regex](https://discuss.elastic.co/t/backreference-in-regex/312299)

<div class="topic-metadata">

**Author:** [@Lukas\_Hubl](https://discuss.elastic.co/u/Lukas_Hubl)\
**Replies:** 1\
**Last updated:** [August 18, 2022, 3:11am UTC](https://discuss.elastic.co/t/backreference-in-regex/312299 "2022-08-18T03:11:45Z")

</div>

Hi, is it possible to use backreference for regex in auditbeat/filebeat? I am trying something like this: \\"1\\":\\"(\\w+)\\",\\"2\\":\\"\\1\\" and the following string should match: "1":"string","2":"string" But I am getti…

---

## [Gcp pubsub input error](https://discuss.elastic.co/t/gcp-pubsub-input-error/312333)

<div class="topic-metadata">

**Author:** [@Gustavo\_Llermaly](https://discuss.elastic.co/u/Gustavo_Llermaly)\
**Replies:** 0\
**Last updated:** [August 18, 2022, 3:02am UTC](https://discuss.elastic.co/t/gcp-pubsub-input-error/312333 "2022-08-18T03:02:56Z")

</div>

Logstash 8.3.3, having this error with gcp pubsub input. Trying with basic settings. \[2022-08-17T22:52:45,136\]\[ERROR\]\[logstash.javapipeline \]\[main\]\[69466b68efba17b190dd16bcd12466cd5488773b860c9a0f79fa6c7c65f5ec61\] A …

---

## [Transform is not created when a particular field is not available in the index](https://discuss.elastic.co/t/transform-is-not-created-when-a-particular-field-is-not-available-in-the-index/312214)

<div class="topic-metadata">

**Author:** [@Amol](https://discuss.elastic.co/u/Amol)\
**Replies:** 2\
**Last updated:** [August 18, 2022, 2:31am UTC](https://discuss.elastic.co/t/transform-is-not-created-when-a-particular-field-is-not-available-in-the-index/312214 "2022-08-18T02:31:14Z")

</div>

Hello Team, I'm trying to create a transform, it is creating the transform index, but when the particular (Year column) is blank or not available in the Data set document, that document is not index. Could any one help…

---

## [Elastic Observability Engineer training - Lab 6.1](https://discuss.elastic.co/t/elastic-observability-engineer-training-lab-6-1/312327)

<div class="topic-metadata">

**Author:** [@deccman](https://discuss.elastic.co/u/deccman)\
**Replies:** 2\
**Last updated:** [August 18, 2022, 12:55am UTC](https://discuss.elastic.co/t/elastic-observability-engineer-training-lab-6-1/312327 "2022-08-18T00:55:19Z")

</div>

I am currently doing the Elastic Observability Engineer training and starting on the Machine Learning lab. Lab 6.1 mentions that under the Anomaly Detection section that I should have two ML jobs for the logs-ui group f…

---

## [How to generate shingles before synonyms filter?](https://discuss.elastic.co/t/how-to-generate-shingles-before-synonyms-filter/312235)

<div class="topic-metadata">

**Author:** [@mattkallo](https://discuss.elastic.co/u/mattkallo)\
**Replies:** 2\
**Last updated:** [August 17, 2022, 10:56pm UTC](https://discuss.elastic.co/t/how-to-generate-shingles-before-synonyms-filter/312235 "2022-08-17T22:56:32Z")

</div>

Hi, I understand we can't have token filters that produce multiple tokens before a synonyms filter. (Ensure TokenFilters only produce single tokens when parsing synonyms by romseygeek · Pull Request #34331 · elastic/ela…

---

## [Disk usage exceeded flood-stage watermark](https://discuss.elastic.co/t/disk-usage-exceeded-flood-stage-watermark/312294)

<div class="topic-metadata">

**Author:** [@Khaled\_Saidi](https://discuss.elastic.co/u/Khaled_Saidi)\
**Replies:** 1\
**Last updated:** [August 17, 2022, 9:53pm UTC](https://discuss.elastic.co/t/disk-usage-exceeded-flood-stage-watermark/312294 "2022-08-17T21:53:10Z")

</div>

Hello everybody, I need some help on conception and settings. I have a cluster of 6 nodes running each one an elasticsearch server instance. An error was logged in logstash log file : TOO\_MANY\_REQUESTS/12/disk usage …

---

## [Error “S02000B61A1A001\>Service 'Elasticsearch 8.1.3 (elasticsearch-service-x64)' is not running. (No automatic restart is attempted)](https://discuss.elastic.co/t/error-s02000b61a1a001-service-elasticsearch-8-1-3-elasticsearch-service-x64-is-not-running-no-automatic-restart-is-attempted/312303)

<div class="topic-metadata">

**Author:** [@Coen](https://discuss.elastic.co/u/Coen)\
**Replies:** 1\
**Last updated:** [August 17, 2022, 9:42pm UTC](https://discuss.elastic.co/t/error-s02000b61a1a001-service-elasticsearch-8-1-3-elasticsearch-service-x64-is-not-running-no-automatic-restart-is-attempted/312303 "2022-08-17T21:42:40Z")

</div>

As the title says “S02000B61A1A001\>Service 'Elasticsearch 8.1.3 (elasticsearch-service-x64)' is not running. (No automatic restart is attempted). This event seems to happen daily, the services are being started by us an…

---

## [MongoDB-SSPL-1.0 license issue](https://discuss.elastic.co/t/mongodb-sspl-1-0-license-issue/312317)

<div class="topic-metadata">

**Author:** [@xliu](https://discuss.elastic.co/u/xliu)\
**Replies:** 3\
**Last updated:** [August 17, 2022, 8:38pm UTC](https://discuss.elastic.co/t/mongodb-sspl-1-0-license-issue/312317 "2022-08-17T20:38:33Z")

</div>

We use elasticsearch 7.17.4. Nexus-iq reports 'Banned' license threat group ('MongoDB-SSPL-1.0'). Nexus IQ Server is Sonatype's policy engine. Sonatype has MongoDB-SSPL-1.0 in Banned list. The policy error comes out f…

---

## [Unable to create the repository for snapshots after mounting nfs share in the container](https://discuss.elastic.co/t/unable-to-create-the-repository-for-snapshots-after-mounting-nfs-share-in-the-container/312284)

<div class="topic-metadata">

**Author:** [@Bhagya\_09](https://discuss.elastic.co/u/Bhagya_09)\
**Replies:** 6\
**Last updated:** [August 17, 2022, 5:31pm UTC](https://discuss.elastic.co/t/unable-to-create-the-repository-for-snapshots-after-mounting-nfs-share-in-the-container/312284 "2022-08-17T17:31:31Z")

</div>

curl -k -u elastic:password -XPUT "http://localhost:9200/\_snapshot/backupes?pretty" -H 'Content-Type: application/json' -d'{"type": "fs","settings":{"location": "/es\_snapshots"}}' { "error" : { "root\_cause" : \[ { "t…

---

## [Elasticsearch into docker](https://discuss.elastic.co/t/elasticsearch-into-docker/311528)

<div class="topic-metadata">

**Author:** [@dav1](https://discuss.elastic.co/u/dav1)\
**Replies:** 1\
**Last updated:** [August 17, 2022, 4:17pm UTC](https://discuss.elastic.co/t/elasticsearch-into-docker/311528 "2022-08-17T16:17:19Z")

</div>

Hit. I would like to use docker to run my elascticsearch. I use this image : docker.elastic.co/elasticsearch/elasticsearch:7.7.0 My environment : Windows 10 Docker Desktop (Docker version 20.10.17, build 100c701) do…

---

## [Developing Custom Parser for Logs](https://discuss.elastic.co/t/developing-custom-parser-for-logs/312021)

<div class="topic-metadata">

**Author:** [@sta02](https://discuss.elastic.co/u/sta02)\
**Replies:** 2\
**Last updated:** [August 17, 2022, 3:36pm UTC](https://discuss.elastic.co/t/developing-custom-parser-for-logs/312021 "2022-08-17T15:36:26Z")

</div>

Hello, In my installation, the output of Logstash is set to Azure Sentinel. The installation is working fine. However, the client prefers to send logs from inhouse applications to Sentinel via Syslog. Is it possible to…

---

## [How to read mongoDB logs from logstash jdbc plugin](https://discuss.elastic.co/t/how-to-read-mongodb-logs-from-logstash-jdbc-plugin/312301)

<div class="topic-metadata">

**Author:** [@sundar\_elk](https://discuss.elastic.co/u/sundar_elk)\
**Replies:** 0\
**Last updated:** [August 17, 2022, 3:00pm UTC](https://discuss.elastic.co/t/how-to-read-mongodb-logs-from-logstash-jdbc-plugin/312301 "2022-08-17T15:00:28Z")

</div>

Hi All, We are trying to get logs from MongoDB database using logstash jdbc plugin and below is the Logstash version :- 7.16.2 MongoDB version :- 4.2 MongoJDBC driver version :- mongojdbc4.1.jar (download jar from Dow…

---

## [Logstash parse json child element, format and insert into elasticsearch](https://discuss.elastic.co/t/logstash-parse-json-child-element-format-and-insert-into-elasticsearch/312230)

<div class="topic-metadata">

**Author:** [@babuzrb](https://discuss.elastic.co/u/babuzrb)\
**Replies:** 9\
**Last updated:** [August 17, 2022, 2:46pm UTC](https://discuss.elastic.co/t/logstash-parse-json-child-element-format-and-insert-into-elasticsearch/312230 "2022-08-17T14:46:50Z")

</div>

I have a json file like this: "fruits": { "fruit": \[ { "id": 1, "label": "test", "tag": "fine", "start": "4", "end": "9" }, { "id": 2, "lab…

---

## [Does App search support substring search?](https://discuss.elastic.co/t/does-app-search-support-substring-search/312285)

<div class="topic-metadata">

**Author:** [@Gerardo\_Zenobi](https://discuss.elastic.co/u/Gerardo_Zenobi)\
**Replies:** 3\
**Last updated:** [August 17, 2022, 2:42pm UTC](https://discuss.elastic.co/t/does-app-search-support-substring-search/312285 "2022-08-17T14:42:53Z")

</div>

Hi there :wave: I wanted to know if App Search supported substring search ? E.g. if a user searches for “note”, this would find records with attributes containing “notepad” or “notebook”, but it would also match “keynot…

---

## [No field "postgresql.log.level" frome Filebat Posresql module in Kibana](https://discuss.elastic.co/t/no-field-postgresql-log-level-frome-filebat-posresql-module-in-kibana/311725)

<div class="topic-metadata">

**Author:** [@sadux](https://discuss.elastic.co/u/sadux)\
**Replies:** 1\
**Last updated:** [August 17, 2022, 2:23pm UTC](https://discuss.elastic.co/t/no-field-postgresql-log-level-frome-filebat-posresql-module-in-kibana/311725 "2022-08-17T14:23:48Z")

</div>

Hello! Just install filebeat (7.15.1)+postgresql module. filebeat.yml: output.logstash: hosts: \["logstash.test.com:5001","logstash2.test.com:5001"\] loadbalance: true fields: env: prod host\_type: postgresql fi…

---

## [Event/Resource Correlation Detection](https://discuss.elastic.co/t/event-resource-correlation-detection/312196)

<div class="topic-metadata">

**Author:** [@BenB196](https://discuss.elastic.co/u/BenB196)\
**Replies:** 3\
**Last updated:** [August 16, 2022, 8:20pm UTC](https://discuss.elastic.co/t/event-resource-correlation-detection/312196 "2022-08-16T20:20:12Z")

</div>

Hi All, I was wondering if anyone has any ideas on how to achieve correlation detection between events and resources. Use Case I have a visualization which shows the 10 top process by memory usage on a system. It also…

---

## [Elasticsearch query fails intermittently](https://discuss.elastic.co/t/elasticsearch-query-fails-intermittently/312295)

<div class="topic-metadata">

**Author:** [@dsc-dev](https://discuss.elastic.co/u/dsc-dev)\
**Replies:** 0\
**Last updated:** [August 17, 2022, 2:14pm UTC](https://discuss.elastic.co/t/elasticsearch-query-fails-intermittently/312295 "2022-08-17T14:14:11Z")

</div>

I am trying to analyze why my below elastic query fails intermittently. It fails like 1 out of 3 times. The query seems correct as it works other times. Below is the python script along with the logs. we are running th…

---

## [Filebeat cant monitor the log file that file name include \[\]](https://discuss.elastic.co/t/filebeat-cant-monitor-the-log-file-that-file-name-include/311758)

<div class="topic-metadata">

**Author:** [@zyjj1](https://discuss.elastic.co/u/zyjj1)\
**Replies:** 1\
**Last updated:** [August 17, 2022, 2:13pm UTC](https://discuss.elastic.co/t/filebeat-cant-monitor-the-log-file-that-file-name-include/311758 "2022-08-17T14:13:56Z")

</div>

We monitor a log file. The name of this log file is mwsummary-log\[0\].log. We found that filebeat cannot monitor any content of this file. Also no data is sent to elasticsearch. If we remove the in the log file name, fil…

---

## [Fscrawler only indexed 59 of a 2000 page pdf](https://discuss.elastic.co/t/fscrawler-only-indexed-59-of-a-2000-page-pdf/312262)

<div class="topic-metadata">

**Author:** [@defalt](https://discuss.elastic.co/u/defalt)\
**Replies:** 1\
**Last updated:** [August 17, 2022, 1:06pm UTC](https://discuss.elastic.co/t/fscrawler-only-indexed-59-of-a-2000-page-pdf/312262 "2022-08-17T13:06:10Z")

</div>

Hello :wave: i guess @dadoonet would know best about this but if someone else can answer this it would be great. I am currently trying to index pdfs into elasticsearch. I installed the 'Ingest Attachment Processor Plug…

---

## [Unstable response-timing App Search](https://discuss.elastic.co/t/unstable-response-timing-app-search/309383)

<div class="topic-metadata">

**Author:** [@SanderP](https://discuss.elastic.co/u/SanderP)\
**Replies:** 11\
**Last updated:** [August 17, 2022, 1:04pm UTC](https://discuss.elastic.co/t/unstable-response-timing-app-search/309383 "2022-08-17T13:04:28Z")

</div>

Dear all, I'm looking into the performance of App Search and am noticing that this is not stable. The response-time of a identical request ranges from 200ms towards 1000+ ms. How could this be made more stable to around…

---

## [Do Elastic Agent (integrations) and Logstash have best practices?a](https://discuss.elastic.co/t/do-elastic-agent-integrations-and-logstash-have-best-practices-a/312279)

<div class="topic-metadata">

**Author:** [@GustavoPires](https://discuss.elastic.co/u/GustavoPires)\
**Replies:** 1\
**Last updated:** [August 17, 2022, 12:16pm UTC](https://discuss.elastic.co/t/do-elastic-agent-integrations-and-logstash-have-best-practices-a/312279 "2022-08-17T12:16:21Z")

</div>

Hello, are there any good practices for using Logstash or Elastic Agent (integrations), for example, I have Pfsense Integration for Elastic Agent, at the same time I can send data via Syslog to Logstash. In what situatio…

---

## [Comparing the values of two fields](https://discuss.elastic.co/t/comparing-the-values-of-two-fields/312280)

<div class="topic-metadata">

**Author:** [@Lukas\_Hubl](https://discuss.elastic.co/u/Lukas_Hubl)\
**Replies:** 0\
**Last updated:** [August 17, 2022, 12:10pm UTC](https://discuss.elastic.co/t/comparing-the-values-of-two-fields/312280 "2022-08-17T12:10:05Z")

</div>

Hello, I am setting up the auditbeat processor, and I am trying to figure out comparison of two fields based on theirs values and use it in condition for processor, like: equals.field1.inner\_field: field2.inner\_field I…

---

## [Test multiline pattern - random order](https://discuss.elastic.co/t/test-multiline-pattern-random-order/312275)

<div class="topic-metadata">

**Author:** [@elkuser1234](https://discuss.elastic.co/u/elkuser1234)\
**Replies:** 0\
**Last updated:** [August 17, 2022, 12:00pm UTC](https://discuss.elastic.co/t/test-multiline-pattern-random-order/312275 "2022-08-17T12:00:01Z")

</div>

Hi I have elk stack 8.3 I need to test multiline patterns. I do it so that I write a given part of the log to the .txt file, and then rewrite it to the log file monitored by filebeat example: \[xxx @ xxx logs\] # cat …

---

## [Data Stream Backing Indice Count](https://discuss.elastic.co/t/data-stream-backing-indice-count/312271)

<div class="topic-metadata">

**Author:** [@Saeed\_Mozaffari](https://discuss.elastic.co/u/Saeed_Mozaffari)\
**Replies:** 1\
**Last updated:** [August 17, 2022, 11:28am UTC](https://discuss.elastic.co/t/data-stream-backing-indice-count/312271 "2022-08-17T11:28:00Z")

</div>

Dose the number of data stream backing indice have any effect on search time performance? for example if in one year i rollover every one month and in another scenario i rollover every one day, are these two scenarios d…

---

## [KQL to elastic query string](https://discuss.elastic.co/t/kql-to-elastic-query-string/312216)

<div class="topic-metadata">

**Author:** [@Drpkton](https://discuss.elastic.co/u/Drpkton)\
**Replies:** 0\
**Last updated:** [August 16, 2022, 7:30pm UTC](https://discuss.elastic.co/t/kql-to-elastic-query-string/312216 "2022-08-16T19:30:59Z")

</div>

When I perform a Kibana Query, ie, I know it is converted to a json blob which represents a valid elasticsearch json query, ie, { "version": true, "size": 500, "sort": \[ { "@timest…

---

## [Is Elasticsearch guide available in PDF?](https://discuss.elastic.co/t/is-elasticsearch-guide-available-in-pdf/312043)

<div class="topic-metadata">

**Author:** [@Blason](https://discuss.elastic.co/u/Blason)\
**Replies:** 3\
**Last updated:** [August 17, 2022, 10:23am UTC](https://discuss.elastic.co/t/is-elasticsearch-guide-available-in-pdf/312043 "2022-08-17T10:23:09Z")

</div>

Hi Team, Wondering if elasticsearch guide is available in PDF format?

---

## [Custom list of keywords](https://discuss.elastic.co/t/custom-list-of-keywords/312264)

<div class="topic-metadata">

**Author:** [@seeminglee](https://discuss.elastic.co/u/seeminglee)\
**Replies:** 0\
**Last updated:** [August 17, 2022, 9:44am UTC](https://discuss.elastic.co/t/custom-list-of-keywords/312264 "2022-08-17T09:44:35Z")

</div>

I have setup an index with the following settings: { "settings": { "analysis": { "analyzer": { "html\_analyzer": { "type": "custom", "tokeni…

---

## [Kubernetes API permission error log of Fleet server pod](https://discuss.elastic.co/t/kubernetes-api-permission-error-log-of-fleet-server-pod/296261)

<div class="topic-metadata">

**Author:** [@duclm2609](https://discuss.elastic.co/u/duclm2609)\
**Replies:** 2\
**Last updated:** [August 17, 2022, 9:40am UTC](https://discuss.elastic.co/t/kubernetes-api-permission-error-log-of-fleet-server-pod/296261 "2022-08-17T09:40:22Z")

</div>

I'm trying to deploy Fleet server as a deployment on Kubernetes. The server agent enrolls successfully to fleet but the log pod keep flooding with the following error: E0204 14:39:51.873097 8 leaderelection.go:325…

---

## [How to connect Winlogbeat to Elasticsearch using SSL?](https://discuss.elastic.co/t/how-to-connect-winlogbeat-to-elasticsearch-using-ssl/312238)

<div class="topic-metadata">

**Author:** [@Linyilan-zz](https://discuss.elastic.co/u/Linyilan-zz)\
**Replies:** 1\
**Last updated:** [August 17, 2022, 9:29am UTC](https://discuss.elastic.co/t/how-to-connect-winlogbeat-to-elasticsearch-using-ssl/312238 "2022-08-17T09:29:18Z")

</div>

Hello Team： We are having a single node ELK configuration, In the same server we have installed Elasticsearch and kibana (8.3.3) As per the guide if we are installing the Elasticsearch generates own SSL configuration …

[Previous page](https://discuss.elastic.co/latest.md?page=1002)

[Next page](https://discuss.elastic.co/latest.md?page=1004)
