# Elastic Stack

**URL:** https://discuss.elastic.co/c/elastic-stack/81.md?page=1136

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1137

---

## [Kibana stop working](https://discuss.elastic.co/t/kibana-stop-working/291086)

<div class="topic-metadata">

**Author:** [@elasticforme](https://discuss.elastic.co/u/elasticforme)\
**Replies:** 7\
**Last updated:** [December 7, 2021, 7:03pm UTC](https://discuss.elastic.co/t/kibana-stop-working/291086 "2021-12-07T19:03:09Z")

</div>

working kibana stop working here is message that comes up when I try to access kibana:5601 {"type":"log","@timestamp":"2021-12-06T19:18:16-06:00","tags":\["error","plugins","taskManager"\],"pid":3497,"message":"Failed to…

---

## [Connecting elastic search through pyspark](https://discuss.elastic.co/t/connecting-elastic-search-through-pyspark/283170)

<div class="topic-metadata">

**Author:** [@Destructord007](https://discuss.elastic.co/u/Destructord007)\
**Replies:** 1\
**Last updated:** [December 7, 2021, 6:56pm UTC](https://discuss.elastic.co/t/connecting-elastic-search-through-pyspark/283170 "2021-12-07T18:56:32Z")

</div>

def main(): es\_read\_conf = { "es.nodes": "ES\_LINK", "es.port": "9200", "es.net.http.auth.user": 'ES\_USERNAME', "es.net.http.auth.pass":'ES\_PASSWORD', } print("ES\_CONF\_START") …

---

## [Kibana login for new users failing](https://discuss.elastic.co/t/kibana-login-for-new-users-failing/291045)

<div class="topic-metadata">

**Author:** [@aditi\_salunke](https://discuss.elastic.co/u/aditi_salunke)\
**Replies:** 3\
**Last updated:** [December 7, 2021, 6:50pm UTC](https://discuss.elastic.co/t/kibana-login-for-new-users-failing/291045 "2021-12-07T18:50:51Z")

</div>

Hello, Can anyone explain what exactly happens in the following situation: Unless we sign in using elastic: ' built-in user ' and change password for new users who are created on kibana are not able to login and receiv…

---

## [Writing Spark Dataframe into ElasticSeach- Runs Successfully but Not all Data dumped](https://discuss.elastic.co/t/writing-spark-dataframe-into-elasticseach-runs-successfully-but-not-all-data-dumped/290051)

<div class="topic-metadata">

**Author:** [@Cloud11](https://discuss.elastic.co/u/Cloud11)\
**Replies:** 1\
**Last updated:** [December 7, 2021, 6:38pm UTC](https://discuss.elastic.co/t/writing-spark-dataframe-into-elasticseach-runs-successfully-but-not-all-data-dumped/290051 "2021-12-07T18:38:54Z")

</div>

I am writing data from my spark-dataframe into ES. i did print the schema and the total count of records and it seems all ok until the dump gets started. Job runs successfully and no issue /error raised in spark job but …

---

## [Error GETting document](https://discuss.elastic.co/t/error-getting-document/291143)

<div class="topic-metadata">

**Author:** [@iamtheschmitzer](https://discuss.elastic.co/u/iamtheschmitzer)\
**Replies:** 1\
**Last updated:** [December 7, 2021, 5:54pm UTC](https://discuss.elastic.co/t/error-getting-document/291143 "2021-12-07T17:54:07Z")

</div>

I PUT a document to index foo\_multi\_import\_20211207, and it results in an id of IGzLlX0B4Xv88DkYMDQL Then I GET the document with GET foo\_multi\_import\_20211207/IGzLlX0B4Xv88DkYMDQL, but get the error { "error" : "Inc…

---

## [Watcher condition setup](https://discuss.elastic.co/t/watcher-condition-setup/291151)

<div class="topic-metadata">

**Author:** [@Luis\_P](https://discuss.elastic.co/u/Luis_P)\
**Replies:** 0\
**Last updated:** [December 7, 2021, 5:40pm UTC](https://discuss.elastic.co/t/watcher-condition-setup/291151 "2021-12-07T17:40:06Z")

</div>

Hello, I've been having trouble creating a watcher. My query has a terms aggregation to aggregate by process, this aggregation has a date\_histogram sub-aggregation, which itself has other sub-aggregations for metrics. M…

---

## [Getting \_timestampparsefailure error in kibana tags](https://discuss.elastic.co/t/getting-timestampparsefailure-error-in-kibana-tags/291150)

<div class="topic-metadata">

**Author:** [@mangeshmj1992](https://discuss.elastic.co/u/mangeshmj1992)\
**Replies:** 0\
**Last updated:** [December 7, 2021, 5:39pm UTC](https://discuss.elastic.co/t/getting-timestampparsefailure-error-in-kibana-tags/291150 "2021-12-07T17:39:20Z")

</div>

Hello team, I am getting \_timestampparsefailure error in kibana tags. looks everything goods. Sample log line: 2021-12-03T12:31:57,176 DEBUG \[ghReVdD7RmwHTUFpx7WgdA\] com.pingidentity.pa.core.interceptor.flow - Invokin…

---

## [How to show Y axis in percentage instead of count in vertical bar chart](https://discuss.elastic.co/t/how-to-show-y-axis-in-percentage-instead-of-count-in-vertical-bar-chart/289778)

<div class="topic-metadata">

**Author:** [@Divyank\_Mahalle](https://discuss.elastic.co/u/Divyank_Mahalle)\
**Replies:** 5\
**Last updated:** [December 7, 2021, 5:15pm UTC](https://discuss.elastic.co/t/how-to-show-y-axis-in-percentage-instead-of-count-in-vertical-bar-chart/289778 "2021-12-07T17:15:43Z")

</div>

Hi, I am using a vertical bar chart for data visualization. I want percentage instead of count in Y-axis. I checked multiple options but was unable to get through it, Viz Pic-

---

## [How to use Kibana API in plugin development](https://discuss.elastic.co/t/how-to-use-kibana-api-in-plugin-development/291131)

<div class="topic-metadata">

**Author:** [@Fabio-sama](https://discuss.elastic.co/u/Fabio-sama)\
**Replies:** 3\
**Last updated:** [December 7, 2021, 4:55pm UTC](https://discuss.elastic.co/t/how-to-use-kibana-api-in-plugin-development/291131 "2021-12-07T16:55:32Z")

</div>

Hi there, we're trying to develop a custom plugin and we're stuck when it comes to call a Kibana APIs. We can import the RequestHandlerContext interface to provide a context we can use to call Elasticsearch APIs, but w…

---

## [How to fetch multiple metric dimensions from monitor metric set of azure metricbeat module](https://discuss.elastic.co/t/how-to-fetch-multiple-metric-dimensions-from-monitor-metric-set-of-azure-metricbeat-module/290364)

<div class="topic-metadata">

**Author:** [@adhiraj-g](https://discuss.elastic.co/u/adhiraj-g)\
**Replies:** 1\
**Last updated:** [December 7, 2021, 4:49pm UTC](https://discuss.elastic.co/t/how-to-fetch-multiple-metric-dimensions-from-monitor-metric-set-of-azure-metricbeat-module/290364 "2021-12-07T16:49:28Z")

</div>

Hi there, I was searching for ways to fetch out metric dimension values of azure application Gateway and landed on the following link: Metricbeat azure module - Simultaneously fetch multi-dimensional metric values Appa…

---

## [Exclude binary data filebeat in logfile](https://discuss.elastic.co/t/exclude-binary-data-filebeat-in-logfile/291031)

<div class="topic-metadata">

**Author:** [@MalfuncEddie](https://discuss.elastic.co/u/MalfuncEddie)\
**Replies:** 1\
**Last updated:** [December 7, 2021, 4:43pm UTC](https://discuss.elastic.co/t/exclude-binary-data-filebeat-in-logfile/291031 "2021-12-07T16:43:51Z")

</div>

Hi, I've got a multiline log file that has following structure 2021-12-06 11:36:31,088 .... 2021-12-06 11:36:32,588 ... 2021-12-06 11:36:34,127 --------------------------- ID: 82506 Response-Code: 200 Content-Type: ap…

---

## [Getting \_dateparsefailure for a log file having two timestamps](https://discuss.elastic.co/t/getting-dateparsefailure-for-a-log-file-having-two-timestamps/289643)

<div class="topic-metadata">

**Author:** [@Patr123](https://discuss.elastic.co/u/Patr123)\
**Replies:** 3\
**Last updated:** [December 7, 2021, 4:10pm UTC](https://discuss.elastic.co/t/getting-dateparsefailure-for-a-log-file-having-two-timestamps/289643 "2021-12-07T16:10:44Z")

</div>

Hello My log file looks like: \[ { "textPayload": "{'testkey': 'testvalue'}", "insertId": "12345-12345", "resource": { "type": "cloud\_function", "labels": { "project\_id": "project-p123",…

---

## [Need help to get only message](https://discuss.elastic.co/t/need-help-to-get-only-message/290123)

<div class="topic-metadata">

**Author:** [@sushant12](https://discuss.elastic.co/u/sushant12)\
**Replies:** 1\
**Last updated:** [December 7, 2021, 3:59pm UTC](https://discuss.elastic.co/t/need-help-to-get-only-message/290123 "2021-12-07T15:59:45Z")

</div>

logs logging messages in following pattern 2021-11-03 05:03:22,773,773 DEBUG \[controllers.requests\] log are logged in to system. i just want to extract following things so i can store in separate variables : Time stam…

---

## [ECK and xpack.security.authc.api\_key.enabled with no TLS....workaround or next release?](https://discuss.elastic.co/t/eck-and-xpack-security-authc-api-key-enabled-with-no-tls-workaround-or-next-release/291138)

<div class="topic-metadata">

**Author:** [@trudesea](https://discuss.elastic.co/u/trudesea)\
**Replies:** 0\
**Last updated:** [December 7, 2021, 3:25pm UTC](https://discuss.elastic.co/t/eck-and-xpack-security-authc-api-key-enabled-with-no-tls-workaround-or-next-release/291138 "2021-12-07T15:25:05Z")

</div>

Hi, I realize that this is being worked on, but is there any work around for this? Since I cannot enable the api service, I am unable to add agents to the fleet. If I have to wait until the next release, I assume it w…

---

## [Not able to get see logs until I delete the index](https://discuss.elastic.co/t/not-able-to-get-see-logs-until-i-delete-the-index/290728)

<div class="topic-metadata">

**Author:** [@manavtidhan](https://discuss.elastic.co/u/manavtidhan)\
**Replies:** 1\
**Last updated:** [December 7, 2021, 3:08pm UTC](https://discuss.elastic.co/t/not-able-to-get-see-logs-until-i-delete-the-index/290728 "2021-12-07T15:08:43Z")

</div>

Hi , I am not able to see logs next day , until I delete the index manually from Kibana Below is the status of my logstash and I am not able to see any error logs even I put the debug mode in logstash.yml Below is …

---

## [Kibana - Error: EACCES: permission denied, open '/etc/kibana/kibana.yml'](https://discuss.elastic.co/t/kibana-error-eacces-permission-denied-open-etc-kibana-kibana-yml/291117)

<div class="topic-metadata">

**Author:** [@Peter\_M](https://discuss.elastic.co/u/Peter_M)\
**Replies:** 14\
**Last updated:** [December 7, 2021, 2:16pm UTC](https://discuss.elastic.co/t/kibana-error-eacces-permission-denied-open-etc-kibana-kibana-yml/291117 "2021-12-07T14:16:13Z")

</div>

Hey all, Fairly new to setting up Kibana, we are setting up on a test environment at the moment, an azure vm using CentOs. We installed Elasticseach and Kibana with Ansible playbooks, during some troubleshooting we had…

---

## [Adding and removing a node fixed our latency issues](https://discuss.elastic.co/t/adding-and-removing-a-node-fixed-our-latency-issues/291059)

<div class="topic-metadata">

**Author:** [@alsyia](https://discuss.elastic.co/u/alsyia)\
**Replies:** 2\
**Last updated:** [December 7, 2021, 2:14pm UTC](https://discuss.elastic.co/t/adding-and-removing-a-node-fixed-our-latency-issues/291059 "2021-12-07T14:14:27Z")

</div>

Dear all, I'm observing a very strange behaviour in my Elasticsearch cluster. It has ~35 nodes and stores dozens of Terabytes of data. We are running ES 5.5.3. We recently recreated all of our warm nodes so that they u…

---

## [Why setting \`inflight\_requests.type\` is not supported?](https://discuss.elastic.co/t/why-setting-inflight-requests-type-is-not-supported/291002)

<div class="topic-metadata">

**Author:** [@ViggoC](https://discuss.elastic.co/u/ViggoC)\
**Replies:** 3\
**Last updated:** [December 7, 2021, 2:00pm UTC](https://discuss.elastic.co/t/why-setting-inflight-requests-type-is-not-supported/291002 "2021-12-07T14:00:05Z")

</div>

I found out that add inflight\_requests.type in elasticsearch.yml is not supported, but request.type is ok. uncaught exception in thread \[main\] java.lang.IllegalArgumentException: unknown setting \[network.breaker.infligh…

---

## [\[7.15.1\] Allow GET \_security/user avoiding permission bloat](https://discuss.elastic.co/t/7-15-1-allow-get-security-user-avoiding-permission-bloat/289064)

<div class="topic-metadata">

**Author:** [@Fabio-sama](https://discuss.elastic.co/u/Fabio-sama)\
**Replies:** 2\
**Last updated:** [December 7, 2021, 1:57pm UTC](https://discuss.elastic.co/t/7-15-1-allow-get-security-user-avoiding-permission-bloat/289064 "2021-12-07T13:57:25Z")

</div>

Hi there, I'd need to create a role which allows a user to make the following call GET \_security/user in order to list all the users of a cluster. Unfortunately, according to the API doc it seems to need the manage\_s…

---

## [Exact Match Term Query Filter](https://discuss.elastic.co/t/exact-match-term-query-filter/291123)

<div class="topic-metadata">

**Author:** [@Lockhead](https://discuss.elastic.co/u/Lockhead)\
**Replies:** 0\
**Last updated:** [December 7, 2021, 1:29pm UTC](https://discuss.elastic.co/t/exact-match-term-query-filter/291123 "2021-12-07T13:29:09Z")

</div>

I have a Keyword field, which can contain multiple values, is there a way to query only for documents that contain "only" a specific Keyword? Let's imagine I have an Index with the following 4 documents: {"tags": "a"} …

---

## [ILM policiy](https://discuss.elastic.co/t/ilm-policiy/290863)

<div class="topic-metadata">

**Author:** [@mrchile](https://discuss.elastic.co/u/mrchile)\
**Replies:** 2\
**Last updated:** [December 7, 2021, 12:50pm UTC](https://discuss.elastic.co/t/ilm-policiy/290863 "2021-12-07T12:50:47Z")

</div>

I have hot and warm. I want to move indexes that are more than one day old to a warm node. How can I achieve this - what steps should I follow? Logstash writes data to index =\> "name {date}" , not to datastreem

---

## [Rollovers always done on the same node](https://discuss.elastic.co/t/rollovers-always-done-on-the-same-node/291056)

<div class="topic-metadata">

**Author:** [@PEB](https://discuss.elastic.co/u/PEB)\
**Replies:** 2\
**Last updated:** [December 7, 2021, 12:23pm UTC](https://discuss.elastic.co/t/rollovers-always-done-on-the-same-node/291056 "2021-12-07T12:23:22Z")

</div>

Hi, I'm working on a small 7.15 cluster (8 data nodes named data-node-X), and for some time, I've observed an abnormal behaviour I can't find the origin of. Indeed, all new rollovers of major indexes (ILM managed) are …

---

## [Elasticstac 40min Data dealy](https://discuss.elastic.co/t/elasticstac-40min-data-dealy/291040)

<div class="topic-metadata">

**Author:** [@HannoKuegler](https://discuss.elastic.co/u/HannoKuegler)\
**Replies:** 4\
**Last updated:** [December 7, 2021, 10:23am UTC](https://discuss.elastic.co/t/elasticstac-40min-data-dealy/291040 "2021-12-07T10:23:23Z")

</div>

Hey there, We have currently running a Netflow setup with Elasticsearch. Data is collected on the Netflow router. Unfortunately it pops up at the Kibana dashboards 40 min later. What could be the Problem there? I'm lo…

---

## [Elastic Search cant find the results from Regex pattern](https://discuss.elastic.co/t/elastic-search-cant-find-the-results-from-regex-pattern/289049)

<div class="topic-metadata">

**Author:** [@rishabhtryroll](https://discuss.elastic.co/u/rishabhtryroll)\
**Replies:** 1\
**Last updated:** [December 7, 2021, 9:51am UTC](https://discuss.elastic.co/t/elastic-search-cant-find-the-results-from-regex-pattern/289049 "2021-12-07T09:51:32Z")

</div>

I am searching a particular regex pattern in the discover tab through KQL and Lucence but I got the error Expected ":", "\<", "\<=", "\>", "\>=", AND, OR, end of input, whitespace but "\\" found. log:"api.mydomain.com" AND '…

---

## [How to Build a Role with Java API for indices privileges](https://discuss.elastic.co/t/how-to-build-a-role-with-java-api-for-indices-privileges/290974)

<div class="topic-metadata">

**Author:** [@David\_Sheard](https://discuss.elastic.co/u/David_Sheard)\
**Replies:** 5\
**Last updated:** [December 7, 2021, 9:43am UTC](https://discuss.elastic.co/t/how-to-build-a-role-with-java-api-for-indices-privileges/290974 "2021-12-07T09:43:00Z")

</div>

Hi, I'm trying tp create an Indices Role using the Java API. Such as below: Role role = Role.builder() .name("testPutRole") .indicesPrivileges(???) .build(); The example in the doco shows it for a…

---

## [O365 module access through proxy](https://discuss.elastic.co/t/o365-module-access-through-proxy/291107)

<div class="topic-metadata">

**Author:** [@sadieshsanjivi](https://discuss.elastic.co/u/sadieshsanjivi)\
**Replies:** 0\
**Last updated:** [December 7, 2021, 9:40am UTC](https://discuss.elastic.co/t/o365-module-access-through-proxy/291107 "2021-12-07T09:40:13Z")

</div>

Hi all I have a problems with using the o365 module in filebeat. In our network in order to reach internet we need to go through a proxy server, and it is because of that the filebeat module cannot connect to the o365 …

---

## [About QueryContainerDescriptor function](https://discuss.elastic.co/t/about-querycontainerdescriptor-function/291103)

<div class="topic-metadata">

**Author:** [@Suki\_Yua](https://discuss.elastic.co/u/Suki_Yua)\
**Replies:** 0\
**Last updated:** [December 7, 2021, 9:22am UTC](https://discuss.elastic.co/t/about-querycontainerdescriptor-function/291103 "2021-12-07T09:22:42Z")

</div>

Hi I have a search document as below { "total": 1, "results": \[ { "id": 1346282, "studentname": "Casey", "studentnumber" :"YT2021" "favourbooks": \[ { "id": 1, …

---

## [Docker.network\_summary does not take hostfs into account](https://discuss.elastic.co/t/docker-network-summary-does-not-take-hostfs-into-account/290677)

<div class="topic-metadata">

**Author:** [@Julero](https://discuss.elastic.co/u/Julero)\
**Replies:** 3\
**Last updated:** [December 7, 2021, 9:22am UTC](https://discuss.elastic.co/t/docker-network-summary-does-not-take-hostfs-into-account/290677 "2021-12-07T09:22:32Z")

</div>

When using docker.network\_summary, I have the following error: 2021-12-01T13:56:00.159Z INFO module/wrapper.go:266 Error fetching data for metricset docker.network\_summary: error fetching namespace for PID 4…

---

## [Logstash service stopped without any specific error](https://discuss.elastic.co/t/logstash-service-stopped-without-any-specific-error/290504)

<div class="topic-metadata">

**Author:** [@alfianaf](https://discuss.elastic.co/u/alfianaf)\
**Replies:** 15\
**Last updated:** [December 7, 2021, 9:03am UTC](https://discuss.elastic.co/t/logstash-service-stopped-without-any-specific-error/290504 "2021-12-07T09:03:23Z")

</div>

Hello, I've been handling logstash this week, and the service always turned off at night (around 8pm-10pm), so I enabled the debug log, and I can't find any error log that lead to the stopped service here's the last log…

---

## [How to include some values and exclude some others on the same field?](https://discuss.elastic.co/t/how-to-include-some-values-and-exclude-some-others-on-the-same-field/291020)

<div class="topic-metadata">

**Author:** [@Huseyin\_Tunctepe](https://discuss.elastic.co/u/Huseyin_Tunctepe)\
**Replies:** 4\
**Last updated:** [December 7, 2021, 8:10am UTC](https://discuss.elastic.co/t/how-to-include-some-values-and-exclude-some-others-on-the-same-field/291020 "2021-12-07T08:10:36Z")

</div>

I have written a Lucene query and a KQL to show "puppet-disabled" and exclude values that contain "CHG", "INC" and "EXC" in the message field. However, all returned results include "puppet-disabled" text and the supposed…

[Previous page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1135)

[Next page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1137)
