# Latest

**URL:** https://discuss.elastic.co/latest.md?page=1395

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1396

---

## [Could not read repository data from index blob](https://discuss.elastic.co/t/could-not-read-repository-data-from-index-blob/288880)

<div class="topic-metadata">

**Author:** [@vaclav1](https://discuss.elastic.co/u/vaclav1)\
**Replies:** 0\
**Last updated:** [November 10, 2021, 11:14am UTC](https://discuss.elastic.co/t/could-not-read-repository-data-from-index-blob/288880 "2021-11-10T11:14:20Z")

</div>

When trying to read all snaphots from the repository in s3 we are getting the error: \[user@adapt103:~\]$ curl 'http://localhost:9200/\_cat/snapshots/adapt-prod\_202111?pretty' { "error" : { "root\_cause" : \[ { …

---

## [Index PDF with Ingest Attachement Plugin using NodeJS Client](https://discuss.elastic.co/t/index-pdf-with-ingest-attachement-plugin-using-nodejs-client/288870)

<div class="topic-metadata">

**Author:** [@BE-CH](https://discuss.elastic.co/u/BE-CH)\
**Replies:** 3\
**Last updated:** [November 10, 2021, 11:04am UTC](https://discuss.elastic.co/t/index-pdf-with-ingest-attachement-plugin-using-nodejs-client/288870 "2021-11-10T11:04:34Z")

</div>

I am having a hard time understanding how I can index files such PDF and .RTF files using the Ingest Attachment Processor Plugin and make them searchable. My main problem seems to be that I can't search for the files af…

---

## [Can't drop events from auditbeat](https://discuss.elastic.co/t/cant-drop-events-from-auditbeat/288221)

<div class="topic-metadata">

**Author:** [@sadux](https://discuss.elastic.co/u/sadux)\
**Replies:** 2\
**Last updated:** [November 10, 2021, 10:52am UTC](https://discuss.elastic.co/t/cant-drop-events-from-auditbeat/288221 "2021-11-10T10:52:09Z")

</div>

Hello! Just want to filter some useless logs from auditbeat. Try this config at auditbeat.yml: - module: system processors: - drop\_event: when: equals: event.action: "network\_flow" …

---

## [Failure authentication not displayed at "security-hosts-authentications"](https://discuss.elastic.co/t/failure-authentication-not-displayed-at-security-hosts-authentications/288096)

<div class="topic-metadata">

**Author:** [@sadux](https://discuss.elastic.co/u/sadux)\
**Replies:** 8\
**Last updated:** [November 10, 2021, 10:48am UTC](https://discuss.elastic.co/t/failure-authentication-not-displayed-at-security-hosts-authentications/288096 "2021-11-10T10:48:30Z")

</div>

Hello! Just upgrade Kibana and Elasticsearch from 7.8 to 7.15.1 and found, that Failure authentications not displayed at "security-hosts-authentications". With Success auth all good and they displayed at Authentications…

---

## [Results not displayed in kibana](https://discuss.elastic.co/t/results-not-displayed-in-kibana/288874)

<div class="topic-metadata">

**Author:** [@mostafaelsayed](https://discuss.elastic.co/u/mostafaelsayed)\
**Replies:** 0\
**Last updated:** [November 10, 2021, 10:34am UTC](https://discuss.elastic.co/t/results-not-displayed-in-kibana/288874 "2021-11-10T10:34:50Z")

</div>

Hello I have an Elasticsearch index that has one primary shard and one replica shard. This is a snapshot of the document count: document count on the primary shard is 677919 document count on the replica shard is 638…

---

## [SSL\_ERROR\_SYSCALL in connection to es01:9200](https://discuss.elastic.co/t/ssl-error-syscall-in-connection-to-es01-9200/288323)

<div class="topic-metadata">

**Author:** [@cocolab](https://discuss.elastic.co/u/cocolab)\
**Replies:** 2\
**Last updated:** [November 10, 2021, 10:32am UTC](https://discuss.elastic.co/t/ssl-error-syscall-in-connection-to-es01-9200/288323 "2021-11-10T10:32:31Z")

</div>

Hello, I am aware that other people have asked this before but it seems that none of those answers fit my case. I need to enable encryption on the communication between the nodes with TLS. (Currently one ES node + one …

---

## [Http\_poller plugin and parsing second level of json](https://discuss.elastic.co/t/http-poller-plugin-and-parsing-second-level-of-json/288872)

<div class="topic-metadata">

**Author:** [@111435](https://discuss.elastic.co/u/111435)\
**Replies:** 0\
**Last updated:** [November 10, 2021, 10:09am UTC](https://discuss.elastic.co/t/http-poller-plugin-and-parsing-second-level-of-json/288872 "2021-11-10T10:09:09Z")

</div>

Hello, I am using Http\_poller plugin for get api call. My conf.file: input { http\_poller { urls =\> { test2 =\> { method =\> get url =\> "https://somethin.somethin.kz/uapi/tickets?api\_token=fdf…

---

## [Problem getting text search hits](https://discuss.elastic.co/t/problem-getting-text-search-hits/288601)

<div class="topic-metadata">

**Author:** [@TS1997](https://discuss.elastic.co/u/TS1997)\
**Replies:** 1\
**Last updated:** [November 10, 2021, 9:47am UTC](https://discuss.elastic.co/t/problem-getting-text-search-hits/288601 "2021-11-10T09:47:29Z")

</div>

Hello, I'm currently trying to implement my first search using Elasticsearch in Pimcore but am having issues getting hits on text strings. I'm currently using the Kibana dev tools to perform my search so Pimcore is only…

---

## [Unfortunately I have deleted some index files](https://discuss.elastic.co/t/unfortunately-i-have-deleted-some-index-files/287878)

<div class="topic-metadata">

**Author:** [@Ravinder28](https://discuss.elastic.co/u/Ravinder28)\
**Replies:** 17\
**Last updated:** [November 10, 2021, 9:24am UTC](https://discuss.elastic.co/t/unfortunately-i-have-deleted-some-index-files/287878 "2021-11-10T09:24:18Z")

</div>

unfortunately i have deleted some index files in below path. home/Elasticsearch/data/nodes/0/indices/ Elasticsearch is stopped and we are trying to restart the Elasticsearch but am getting below error. "\[2021-10-25T11…

---

## [Securing search endpoint](https://discuss.elastic.co/t/securing-search-endpoint/288624)

<div class="topic-metadata">

**Author:** [@reka.gay](https://discuss.elastic.co/u/reka.gay)\
**Replies:** 4\
**Last updated:** [November 10, 2021, 8:42am UTC](https://discuss.elastic.co/t/securing-search-endpoint/288624 "2021-11-10T08:42:11Z")

</div>

We have a self-hosted Enterprise Search instance with sensitive search data in it. A permanent public search API key doesn't meet our security standards. What is the best way to ensure that only authenticated users can …

---

## [Limit of total fields has been exceeded -\> set for dynamic daily index](https://discuss.elastic.co/t/limit-of-total-fields-has-been-exceeded-set-for-dynamic-daily-index/288851)

<div class="topic-metadata">

**Author:** [@INS](https://discuss.elastic.co/u/INS)\
**Replies:** 0\
**Last updated:** [November 10, 2021, 7:46am UTC](https://discuss.elastic.co/t/limit-of-total-fields-has-been-exceeded-set-for-dynamic-daily-index/288851 "2021-11-10T07:46:49Z")

</div>

Hi How can I set permanently for my all index index.mapping.total\_fields.limit I've daily indexes index =\> "logstash-test2000-%{+YYYY.MM.dd}" below input was set for only one index PUT logstash-\*/\_settings { "index…

---

## [How to create Alerting/health checks for ELK services (filebeat/metricbeat/logstash)](https://discuss.elastic.co/t/how-to-create-alerting-health-checks-for-elk-services-filebeat-metricbeat-logstash/288844)

<div class="topic-metadata">

**Author:** [@Bharah01](https://discuss.elastic.co/u/Bharah01)\
**Replies:** 0\
**Last updated:** [November 10, 2021, 6:56am UTC](https://discuss.elastic.co/t/how-to-create-alerting-health-checks-for-elk-services-filebeat-metricbeat-logstash/288844 "2021-11-10T06:56:57Z")

</div>

I want to configure an Alerting seup for the ELK services (filebeat/metricbeat/logstash). The kibana version running is 6.5.1. The need is because whenever any of these services goes down there should be a trigger to Mi…

---

## [Elasticsearch not working after spring-boot upgrade to 2.2.0.RELEASE](https://discuss.elastic.co/t/elasticsearch-not-working-after-spring-boot-upgrade-to-2-2-0-release/288849)

<div class="topic-metadata">

**Author:** [@simarjsi](https://discuss.elastic.co/u/simarjsi)\
**Replies:** 0\
**Last updated:** [November 10, 2021, 7:43am UTC](https://discuss.elastic.co/t/elasticsearch-not-working-after-spring-boot-upgrade-to-2-2-0-release/288849 "2021-11-10T07:43:09Z")

</div>

I am upgrading one of our applications from spring-boot version 2.1.3.RELEASE to 2.2.0.RELEASE but I am facing some issues with Elasticsearch. Here is the error I am getting java.lang.IllegalStateException: Failed to lo…

---

## [Intermittently failed with 401 Unauthorized](https://discuss.elastic.co/t/intermittently-failed-with-401-unauthorized/288835)

<div class="topic-metadata">

**Author:** [@John\_Luong\_Nhat\_Truo](https://discuss.elastic.co/u/John_Luong_Nhat_Truo)\
**Replies:** 5\
**Last updated:** [November 10, 2021, 7:24am UTC](https://discuss.elastic.co/t/intermittently-failed-with-401-unauthorized/288835 "2021-11-10T07:24:22Z")

</div>

Hi, I'm using basic authentication with REST API but sometime server response 401 Unauthorized as: 401 Unauthorized {"error":{"root\_cause":\[{"type":"security\_exception","reason":"unable to authenticate user \[xxxxxxxxx\]…

---

## [A way better than rollup and transform](https://discuss.elastic.co/t/a-way-better-than-rollup-and-transform/288747)

<div class="topic-metadata">

**Author:** [@lstoneir](https://discuss.elastic.co/u/lstoneir)\
**Replies:** 1\
**Last updated:** [November 10, 2021, 6:50am UTC](https://discuss.elastic.co/t/a-way-better-than-rollup-and-transform/288747 "2021-11-10T06:50:29Z")

</div>

Hi there, Thanks a lot for your great and wonderful support team! At first step we use rollup jobs for create hourly and daily aggregation of our data, but rollup indices dont support ILM! unfortunately. At second st…

---

## [Heartbeat.yml file number\_of\_replicas not being applied](https://discuss.elastic.co/t/heartbeat-yml-file-number-of-replicas-not-being-applied/288691)

<div class="topic-metadata">

**Author:** [@Daniel.X](https://discuss.elastic.co/u/Daniel.X)\
**Replies:** 2\
**Last updated:** [November 10, 2021, 6:14am UTC](https://discuss.elastic.co/t/heartbeat-yml-file-number-of-replicas-not-being-applied/288691 "2021-11-10T06:14:38Z")

</div>

Heartbeat Version: 7.14.0 Hi there, I configured our heartbeat that runs as sidecar container on AWS ECS using the heartbeat.yml file configuration. I set the number\_of\_replicas to be 0 (see code snippet below). Howeve…

---

## [Kibana not found elasticsearch host](https://discuss.elastic.co/t/kibana-not-found-elasticsearch-host/288839)

<div class="topic-metadata">

**Author:** [@mehmood1](https://discuss.elastic.co/u/mehmood1)\
**Replies:** 14\
**Last updated:** [November 10, 2021, 5:15am UTC](https://discuss.elastic.co/t/kibana-not-found-elasticsearch-host/288839 "2021-11-10T05:15:02Z")

</div>

when i run kibana.bat on windows os it is showing error. Both are running in same machine. FATAL Error: \[config validation of \[server\].host\]: types that failed validation: \[config validation of \[server\].host.0\]: val…

---

## [Logstash showing Document count as 1. only last line of the syslog is displaying in kibana](https://discuss.elastic.co/t/logstash-showing-document-count-as-1-only-last-line-of-the-syslog-is-displaying-in-kibana/288787)

<div class="topic-metadata">

**Author:** [@kalyan\_M](https://discuss.elastic.co/u/kalyan_M)\
**Replies:** 0\
**Last updated:** [November 9, 2021, 4:02pm UTC](https://discuss.elastic.co/t/logstash-showing-document-count-as-1-only-last-line-of-the-syslog-is-displaying-in-kibana/288787 "2021-11-09T16:02:12Z")

</div>

Hi, I am new to ELK configurations. I configured the ubuntu VM logs to ELK VM. I am getting logs from the ubuntu VM to log stash. but it was showing document count as only 1. please help with the issue.

---

## [Curator is running but not deleting any index in elastic search and not printing any logs](https://discuss.elastic.co/t/curator-is-running-but-not-deleting-any-index-in-elastic-search-and-not-printing-any-logs/288800)

<div class="topic-metadata">

**Author:** [@Kumar\_Reddy](https://discuss.elastic.co/u/Kumar_Reddy)\
**Replies:** 3\
**Last updated:** [November 10, 2021, 4:00am UTC](https://discuss.elastic.co/t/curator-is-running-but-not-deleting-any-index-in-elastic-search-and-not-printing-any-logs/288800 "2021-11-10T04:00:04Z")

</div>

Hi, I am using docker-compose to run Elasticsearch with curator. Elasticsearch is working fine but curator is running but not deleting any index and not printing any logs. This is my docker-compose yml file :- version…

---

## [Kibana Development 7.15 Yarn Bootstrap Fails no native build was found for platform=linux](https://discuss.elastic.co/t/kibana-development-7-15-yarn-bootstrap-fails-no-native-build-was-found-for-platform-linux/288282)

<div class="topic-metadata">

**Author:** [@Jsof](https://discuss.elastic.co/u/Jsof)\
**Replies:** 4\
**Last updated:** [November 10, 2021, 1:47am UTC](https://discuss.elastic.co/t/kibana-development-7-15-yarn-bootstrap-fails-no-native-build-was-found-for-platform-linux/288282 "2021-11-10T01:47:28Z")

</div>

Hi, i am trying to get kibana development environment for kibana 7.15 running but i keep getting the error below when running "yarn kbn boostrap". I am running the dev environment on CentOS Linux release 7.8.2003 \[vsco…

---

## [CPU at 100% with XPACK security Enabled - ES 7.9.0](https://discuss.elastic.co/t/cpu-at-100-with-xpack-security-enabled-es-7-9-0/288820)

<div class="topic-metadata">

**Author:** [@ilavajuthy](https://discuss.elastic.co/u/ilavajuthy)\
**Replies:** 2\
**Last updated:** [November 9, 2021, 11:29pm UTC](https://discuss.elastic.co/t/cpu-at-100-with-xpack-security-enabled-es-7-9-0/288820 "2021-11-09T23:29:11Z")

</div>

Hi, We are noticing high CPU after upgrading to 7.9.0 with XPACK security. Earlier we had 6.8.7 version without XPACK auth. We are using ECK deployment. I see few posts on this issue, but none of the topic has resoluti…

---

## [Elasticsearch return empty list of objects to spark](https://discuss.elastic.co/t/elasticsearch-return-empty-list-of-objects-to-spark/288052)

<div class="topic-metadata">

**Author:** [@mohsen\_mortezapour](https://discuss.elastic.co/u/mohsen_mortezapour)\
**Replies:** 1\
**Last updated:** [November 9, 2021, 10:58pm UTC](https://discuss.elastic.co/t/elasticsearch-return-empty-list-of-objects-to-spark/288052 "2021-11-09T22:58:29Z")

</div>

I have a problem with Elasticsearch . I want to read data from Elasticsearch index with Pyspark . my data look like as below: user\_id: 123, features: { hashtags: \[ { text: "hello", c…

---

## [SQS client ignores the fips flag for the service endpoint](https://discuss.elastic.co/t/sqs-client-ignores-the-fips-flag-for-the-service-endpoint/288687)

<div class="topic-metadata">

**Author:** [@Andrew\_Chang](https://discuss.elastic.co/u/Andrew_Chang)\
**Replies:** 3\
**Last updated:** [November 9, 2021, 10:41pm UTC](https://discuss.elastic.co/t/sqs-client-ignores-the-fips-flag-for-the-service-endpoint/288687 "2021-11-09T22:41:54Z")

</div>

At least in 7.15.1 when using the fips\_enabled flag, only s3 respects the fips configuration. SQS does not. It seems to be hard coded. beats/input.go at master · elastic/beats · GitHub

---

## [OIDC token\_type issue, Token type must be Bearer](https://discuss.elastic.co/t/oidc-token-type-issue-token-type-must-be-bearer/288655)

<div class="topic-metadata">

**Author:** [@ibrooes](https://discuss.elastic.co/u/ibrooes)\
**Replies:** 2\
**Last updated:** [November 9, 2021, 10:31pm UTC](https://discuss.elastic.co/t/oidc-token-type-issue-token-type-must-be-bearer/288655 "2021-11-09T22:31:34Z")

</div>

Hi, I am trying to setup OIDC Authentication. Open ID Connect Provider I am using sends id\_token, access token, etc. All tokens are JWT. The issue I am facing is token\_type field sent from Open ID Connect provider. The v…

---

## [Beat for Status Interface Network](https://discuss.elastic.co/t/beat-for-status-interface-network/288826)

<div class="topic-metadata">

**Author:** [@Ing\_Carlos\_Salas](https://discuss.elastic.co/u/Ing_Carlos_Salas)\
**Replies:** 2\
**Last updated:** [November 9, 2021, 10:08pm UTC](https://discuss.elastic.co/t/beat-for-status-interface-network/288826 "2021-11-09T22:08:06Z")

</div>

Hi community I search a beat for view the status of interfaces network for example status up or down, bandwidth, errors THROUGHPUT I need monitoring state of the network interface to run the command, ifconfig IP ADDR …

---

## [Elasticsearch Storage Distribution](https://discuss.elastic.co/t/elasticsearch-storage-distribution/288774)

<div class="topic-metadata">

**Author:** [@gutierrezfj](https://discuss.elastic.co/u/gutierrezfj)\
**Replies:** 1\
**Last updated:** [November 9, 2021, 9:34pm UTC](https://discuss.elastic.co/t/elasticsearch-storage-distribution/288774 "2021-11-09T21:34:01Z")

</div>

Hi dear community, a doubt: for a small cluster: is it better to centralize the data of all nodes in a single storage unit or file system? Or is it better for each node on a dedicated host to store its own data? Tha…

---

## [Cross cluster replication Data streams](https://discuss.elastic.co/t/cross-cluster-replication-data-streams/288803)

<div class="topic-metadata">

**Author:** [@iasenzaniro](https://discuss.elastic.co/u/iasenzaniro)\
**Replies:** 0\
**Last updated:** [November 9, 2021, 5:41pm UTC](https://discuss.elastic.co/t/cross-cluster-replication-data-streams/288803 "2021-11-09T17:41:12Z")

</div>

Hi, here is the environment i am working with. Local cluster : running elastic stack. My local cluster is connected to the remote cluster. Remote cluster: vm running elk stack in aws cloud. This a single node cluster w…

---

## [How to handle this error](https://discuss.elastic.co/t/how-to-handle-this-error/288726)

<div class="topic-metadata">

**Author:** [@Mahrukh\_Malik](https://discuss.elastic.co/u/Mahrukh_Malik)\
**Replies:** 1\
**Last updated:** [November 9, 2021, 9:08pm UTC](https://discuss.elastic.co/t/how-to-handle-this-error/288726 "2021-11-09T21:08:01Z")

</div>

elasticsearch.service - Elasticsearch Loaded: loaded (/usr/lib/systemd/system/elasticsearch.service; enabled; vendor preset: disabled) Active: failed (Result: exit-code) since Tue 2021-11-09 13:38:12 PKT; 11s ago …

---

## [How to loop through nested field in painless script](https://discuss.elastic.co/t/how-to-loop-through-nested-field-in-painless-script/288695)

<div class="topic-metadata">

**Author:** [@Agnivesh\_Sharma](https://discuss.elastic.co/u/Agnivesh_Sharma)\
**Replies:** 1\
**Last updated:** [November 9, 2021, 8:44pm UTC](https://discuss.elastic.co/t/how-to-loop-through-nested-field-in-painless-script/288695 "2021-11-09T20:44:01Z")

</div>

I have following nested type mapping: "visitor\_data": { "type": "nested", "dynamic": "false", "properties": { "checkin\_time": { "type": "date", …

---

## [Parse Vsftp log (Filebeat + Logstash)](https://discuss.elastic.co/t/parse-vsftp-log-filebeat-logstash/288040)

<div class="topic-metadata">

**Author:** [@Hecha](https://discuss.elastic.co/u/Hecha)\
**Replies:** 2\
**Last updated:** [November 9, 2021, 8:21pm UTC](https://discuss.elastic.co/t/parse-vsftp-log-filebeat-logstash/288040 "2021-11-09T20:21:12Z")

</div>

Hello guys! I am trying to parse the logs of my FTP server (Vsftpd) with logstash but I am having trouble. The logs follow the following format Fri Oct 29 17:16:17 2021 \[pid 22947\] CONNECT: Client "::ffff:10.0.1.6" Fri…

[Previous page](https://discuss.elastic.co/latest.md?page=1394)

[Next page](https://discuss.elastic.co/latest.md?page=1396)
