# Elastic Stack

**URL:** https://discuss.elastic.co/c/elastic-stack/81.md?page=1037

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1038

---

## [8.X Python API call for data stream creation](https://discuss.elastic.co/t/8-x-python-api-call-for-data-stream-creation/298230)

<div class="topic-metadata">

**Author:** [@RogerS](https://discuss.elastic.co/u/RogerS)\
**Replies:** 0\
**Last updated:** [February 24, 2022, 11:48pm UTC](https://discuss.elastic.co/t/8-x-python-api-call-for-data-stream-creation/298230 "2022-02-24T23:48:45Z")

</div>

I am trying to move to data streams and have issues with 8. x File "/scripts/bin/test/test.py", line 49 response = es.cluster.put\_component\_template(name="icd6\_settings", template: icd6\_template ) ^ SyntaxError: pos…

---

## [Elastic search optimistic concurrency control not working as expected](https://discuss.elastic.co/t/elastic-search-optimistic-concurrency-control-not-working-as-expected/298208)

<div class="topic-metadata">

**Author:** [@reddroid](https://discuss.elastic.co/u/reddroid)\
**Replies:** 3\
**Last updated:** [February 24, 2022, 10:47pm UTC](https://discuss.elastic.co/t/elastic-search-optimistic-concurrency-control-not-working-as-expected/298208 "2022-02-24T22:47:35Z")

</div>

Hi, We are using Elasticsearch version 7.16.2 with the Java Rest client to process and store documents in Elasticsearch in a Spring application . We are noticing this intermittent issue where documents with lower seq n…

---

## [Kibana loading loop with .kibana-event-log has is\_hidden set to true on indices](https://discuss.elastic.co/t/kibana-loading-loop-with-kibana-event-log-has-is-hidden-set-to-true-on-indices/298088)

<div class="topic-metadata">

**Author:** [@kevb](https://discuss.elastic.co/u/kevb)\
**Replies:** 3\
**Last updated:** [February 24, 2022, 10:00pm UTC](https://discuss.elastic.co/t/kibana-loading-loop-with-kibana-event-log-has-is-hidden-set-to-true-on-indices/298088 "2022-02-24T22:00:20Z")

</div>

Hello everyone, I will try to get some help on the forum before trying a last update or crash something more. Here is my situation : I had a cluster elastic with rpm on 7.10.1 and I upgraded nearly 2 months ago in 7.1…

---

## [High disk READ](https://discuss.elastic.co/t/high-disk-read/298221)

<div class="topic-metadata">

**Author:** [@bknv](https://discuss.elastic.co/u/bknv)\
**Replies:** 0\
**Last updated:** [February 24, 2022, 9:33pm UTC](https://discuss.elastic.co/t/high-disk-read/298221 "2022-02-24T21:33:26Z")

</div>

Hello everybody. I have a problem with high activity (read) on the disk. Disk SSD load on 90%. "iostat" show me, what reading from disk 400-500+ M/s . in "iotop" i see process "java -Xshare:auto -Des.networkaddres…

---

## [Problem CPU Usage Gauge](https://discuss.elastic.co/t/problem-cpu-usage-gauge/297936)

<div class="topic-metadata">

**Author:** [@jorge\_Flores\_Machuca](https://discuss.elastic.co/u/jorge_Flores_Machuca)\
**Replies:** 4\
**Last updated:** [February 24, 2022, 8:57pm UTC](https://discuss.elastic.co/t/problem-cpu-usage-gauge/297936 "2022-02-24T20:57:03Z")

</div>

Hello, I have configured metricbeats from windows and for the part of memory use or CPU use, sometimes when it refreshes it shows me all the GAUGE in green without a usage metric some samaritan who can guide me, so th…

---

## [JSON parse error, original data now in message field](https://discuss.elastic.co/t/json-parse-error-original-data-now-in-message-field/298065)

<div class="topic-metadata">

**Author:** [@d6036de2b54af16665f4](https://discuss.elastic.co/u/d6036de2b54af16665f4)\
**Replies:** 2\
**Last updated:** [February 24, 2022, 8:54pm UTC](https://discuss.elastic.co/t/json-parse-error-original-data-now-in-message-field/298065 "2022-02-24T20:54:13Z")

</div>

HI, Error I am receiving in logstash logs is : \[2022-02-22T15:19:27,369\]\[ERROR\]\[logstash.codecs.json \] JSON parse error, original data now in message field {:error=\>#\<LogStash::Json::ParserError: Unexpected charact…

---

## [Can't send logs to data view](https://discuss.elastic.co/t/cant-send-logs-to-data-view/298176)

<div class="topic-metadata">

**Author:** [@martiros\_martiros](https://discuss.elastic.co/u/martiros_martiros)\
**Replies:** 1\
**Last updated:** [February 24, 2022, 8:49pm UTC](https://discuss.elastic.co/t/cant-send-logs-to-data-view/298176 "2022-02-24T20:49:47Z")

</div>

I got this in my spring boot this is my conf. file input { file { type =\> "java" path =\> "/UUUU\*\*\*\*\*\*\*\*/IdeaProjects/elk-stack-logging-example/elk-example.log" codec =\> multiline { …

---

## [Log stream with logstash](https://discuss.elastic.co/t/log-stream-with-logstash/298195)

<div class="topic-metadata">

**Author:** [@laolao](https://discuss.elastic.co/u/laolao)\
**Replies:** 1\
**Last updated:** [February 24, 2022, 8:45pm UTC](https://discuss.elastic.co/t/log-stream-with-logstash/298195 "2022-02-24T20:45:11Z")

</div>

I have a basic configuration of logstash sending syslogs to Elasticsearch. I created my index pattern and can make visualizations, etc. However, I want to view the logs in real time on my dashboard. My dashboard has 4 d…

---

## [Elastic Cloud Console Showing Unhealthy Deployment](https://discuss.elastic.co/t/elastic-cloud-console-showing-unhealthy-deployment/298076)

<div class="topic-metadata">

**Author:** [@daniel.talbot](https://discuss.elastic.co/u/daniel.talbot)\
**Replies:** 9\
**Last updated:** [February 24, 2022, 8:26pm UTC](https://discuss.elastic.co/t/elastic-cloud-console-showing-unhealthy-deployment/298076 "2022-02-24T20:26:16Z")

</div>

I currently am seeing in my cloud ELK stack (2 hot, 2 warm, 1 Integration, 1 Kibana, 1 Master instance) showing that one of the warm instances and the master instance are both unhealthy. Both are under 30% JVM memory pr…

---

## [Creating a visualization: aggregate data over time](https://discuss.elastic.co/t/creating-a-visualization-aggregate-data-over-time/298075)

<div class="topic-metadata">

**Author:** [@4art4](https://discuss.elastic.co/u/4art4)\
**Replies:** 3\
**Last updated:** [February 24, 2022, 8:20pm UTC](https://discuss.elastic.co/t/creating-a-visualization-aggregate-data-over-time/298075 "2022-02-24T20:20:46Z")

</div>

I am likely using the wrong terms... or I would have found this in my searching... I am getting documents every day that list activity for objects. Eg: Day 1: { objectOne: { countOfFirstAction: 3, …

---

## [Elasticsearch can't recognise \_ec2\_](https://discuss.elastic.co/t/elasticsearch-cant-recognise-ec2/298128)

<div class="topic-metadata">

**Author:** [@rachit\_upadhyay](https://discuss.elastic.co/u/rachit_upadhyay)\
**Replies:** 4\
**Last updated:** [February 24, 2022, 8:19pm UTC](https://discuss.elastic.co/t/elasticsearch-cant-recognise-ec2/298128 "2022-02-24T20:19:38Z")

</div>

Getting the following error "org.Elasticsearch.bootstrap.StartupException: java.lang.IllegalArgumentException: Failed to parse value \[ec2\] for setting \[transport.publish\_port\]". This is where in the Elasticsearch.yml, t…

---

## [Barracuda WAF log input format](https://discuss.elastic.co/t/barracuda-waf-log-input-format/298214)

<div class="topic-metadata">

**Author:** [@JGreene](https://discuss.elastic.co/u/JGreene)\
**Replies:** 0\
**Last updated:** [February 24, 2022, 8:07pm UTC](https://discuss.elastic.co/t/barracuda-waf-log-input-format/298214 "2022-02-24T20:07:09Z")

</div>

Continuing the discussion from Barracuda WAF Log Parsing: We are seeking guidance on how to configure the Barracuda WAF logs to output to Filebeat in a format that is accepted by the provided following scripts in the mo…

---

## [How to login as a different user after enabling anonymous access](https://discuss.elastic.co/t/how-to-login-as-a-different-user-after-enabling-anonymous-access/298187)

<div class="topic-metadata">

**Author:** [@Shreesh\_Narayanan](https://discuss.elastic.co/u/Shreesh_Narayanan)\
**Replies:** 1\
**Last updated:** [February 24, 2022, 6:58pm UTC](https://discuss.elastic.co/t/how-to-login-as-a-different-user-after-enabling-anonymous-access/298187 "2022-02-24T18:58:16Z")

</div>

I had enabled anonymous access for my kibana dashboards and it works flawlessly . However when i try to login as a different user , it brings me back to the anonymous user's account . is there a way to get the login pr…

---

## [Yarn start fails with custom plugin in 7.16.3](https://discuss.elastic.co/t/yarn-start-fails-with-custom-plugin-in-7-16-3/296013)

<div class="topic-metadata">

**Author:** [@kbujold\_wr](https://discuss.elastic.co/u/kbujold_wr)\
**Replies:** 3\
**Last updated:** [February 24, 2022, 6:05pm UTC](https://discuss.elastic.co/t/yarn-start-fails-with-custom-plugin-in-7-16-3/296013 "2022-02-24T18:05:17Z")

</div>

I am getting errors regarding webpack and visTypeTimeseries when I do 'yarn start'. These errirs appears to come from kibana and not my plugin. Note that we have just upgraded our plugin in from 7.9.3 to 7.16.3. This was…

---

## [Filebeat after v7.12 does not show dependency information](https://discuss.elastic.co/t/filebeat-after-v7-12-does-not-show-dependency-information/298012)

<div class="topic-metadata">

**Author:** [@bharathrajask](https://discuss.elastic.co/u/bharathrajask)\
**Replies:** 1\
**Last updated:** [February 24, 2022, 5:56pm UTC](https://discuss.elastic.co/t/filebeat-after-v7-12-does-not-show-dependency-information/298012 "2022-02-24T17:56:46Z")

</div>

Hi Team, We are using the filebeat 3pp in our project. We use few scanning tools like (trivy, anchore) to detect the vulnerabilities in the filebeat project. Till v7.12, we were able to detect the vulnerabilities. But a…

---

## [Null Values Being Ignored by Elasticsearch](https://discuss.elastic.co/t/null-values-being-ignored-by-elasticsearch/298199)

<div class="topic-metadata">

**Author:** [@xef](https://discuss.elastic.co/u/xef)\
**Replies:** 0\
**Last updated:** [February 24, 2022, 5:24pm UTC](https://discuss.elastic.co/t/null-values-being-ignored-by-elasticsearch/298199 "2022-02-24T17:24:24Z")

</div>

We are using the NEST library with Elasticsearch versions 7.14. Lets say we have assigned a field a value of "hello World". The filed is mapped as a Keyword type and Not Indexed. If you update that document using the …

---

## [Can plugin name on kibana UI is configurable?](https://discuss.elastic.co/t/can-plugin-name-on-kibana-ui-is-configurable/296835)

<div class="topic-metadata">

**Author:** [@prashant1](https://discuss.elastic.co/u/prashant1)\
**Replies:** 1\
**Last updated:** [February 24, 2022, 4:59pm UTC](https://discuss.elastic.co/t/can-plugin-name-on-kibana-ui-is-configurable/296835 "2022-02-24T16:59:42Z")

</div>

We have created a plugin with name sampleDemo in kibana version 7.10.2. It has created folder plugins\\sample\_demo structure. I have below queries on the behavior:- Why it has created a folder structure with "underscor…

---

## [Update values based on previous documents](https://discuss.elastic.co/t/update-values-based-on-previous-documents/296406)

<div class="topic-metadata">

**Author:** [@SKraine](https://discuss.elastic.co/u/SKraine)\
**Replies:** 2\
**Last updated:** [February 24, 2022, 4:34pm UTC](https://discuss.elastic.co/t/update-values-based-on-previous-documents/296406 "2022-02-24T16:34:48Z")

</div>

Hey Everyone! So I am very new to the elastic stack and am currently working on my first application using it. I have data that comes from different files via filebeat. They then go through logstash to parse out the fie…

---

## [Filebeat to Analyse Old Apache Logs](https://discuss.elastic.co/t/filebeat-to-analyse-old-apache-logs/297894)

<div class="topic-metadata">

**Author:** [@inf](https://discuss.elastic.co/u/inf)\
**Replies:** 1\
**Last updated:** [February 24, 2022, 4:30pm UTC](https://discuss.elastic.co/t/filebeat-to-analyse-old-apache-logs/297894 "2022-02-24T16:30:24Z")

</div>

Hi there, I have a set of old Apache logs that I have in an existing Elastic Stack, where it was piped in to the Elasticsearch node using Filebeat with no modules enabled. I would like to analyse this set of old Apache…

---

## [\[Vega\] Visualisation with multiple maps](https://discuss.elastic.co/t/vega-visualisation-with-multiple-maps/296824)

<div class="topic-metadata">

**Author:** [@Kayak007](https://discuss.elastic.co/u/Kayak007)\
**Replies:** 4\
**Last updated:** [February 24, 2022, 4:12pm UTC](https://discuss.elastic.co/t/vega-visualisation-with-multiple-maps/296824 "2022-02-24T16:12:46Z")

</div>

Hi, I'm trying to create a Vega visualization with a main map of a country and several zoomed maps on cities. Something like this: I could do that through a dashboard and four visualizations, but the data visualize…

---

## [How to perform sum aggregation and term aggregation in single query?](https://discuss.elastic.co/t/how-to-perform-sum-aggregation-and-term-aggregation-in-single-query/298151)

<div class="topic-metadata">

**Author:** [@Harish\_fragger](https://discuss.elastic.co/u/Harish_fragger)\
**Replies:** 1\
**Last updated:** [February 24, 2022, 3:52pm UTC](https://discuss.elastic.co/t/how-to-perform-sum-aggregation-and-term-aggregation-in-single-query/298151 "2022-02-24T15:52:44Z")

</div>

I want to know if there is a method to write a query that can get the sum of a field value and such type of fields top 10 occurrences. For example, if I have 20 IP address in 100 documents and each document also tells me…

---

## [ICU sorting of terms aggregation with multi-valued fields](https://discuss.elastic.co/t/icu-sorting-of-terms-aggregation-with-multi-valued-fields/297886)

<div class="topic-metadata">

**Author:** [@mhugo](https://discuss.elastic.co/u/mhugo)\
**Replies:** 6\
**Last updated:** [February 24, 2022, 3:35pm UTC](https://discuss.elastic.co/t/icu-sorting-of-terms-aggregation-with-multi-valued-fields/297886 "2022-02-24T15:35:32Z")

</div>

Hi. I struggle to sort buckets of a terms aggregation based on ICU collation to respect the ordering of accented words. And especially when the text field to sort is indexed with arrays. I started with a simple term ag…

---

## [Multisearch requests in new Java API do not support "sort" or "\_source" properties](https://discuss.elastic.co/t/multisearch-requests-in-new-java-api-do-not-support-sort-or-source-properties/297489)

<div class="topic-metadata">

**Author:** [@babayotakun](https://discuss.elastic.co/u/babayotakun)\
**Replies:** 4\
**Last updated:** [February 24, 2022, 3:28pm UTC](https://discuss.elastic.co/t/multisearch-requests-in-new-java-api-do-not-support-sort-or-source-properties/297489 "2022-02-24T15:28:13Z")

</div>

With brand new Elasticsearch Java API I cannot write multisearch requests like: curl -H 'Content-type: application/x-ndjson' -XGET 'http://localhost:9200/myindex/\_msearch' -d '{} { "sort": \[ { "text": { …

---

## [How to automate reading logs?](https://discuss.elastic.co/t/how-to-automate-reading-logs/297873)

<div class="topic-metadata">

**Author:** [@Mariem](https://discuss.elastic.co/u/Mariem)\
**Replies:** 4\
**Last updated:** [February 24, 2022, 1:38pm UTC](https://discuss.elastic.co/t/how-to-automate-reading-logs/297873 "2022-02-24T13:38:14Z")

</div>

Hi, i'm using elk on docker and i want to automate reading logs from different server can someone help me ??

---

## [Master node Rejecting the data node request](https://discuss.elastic.co/t/master-node-rejecting-the-data-node-request/298168)

<div class="topic-metadata">

**Author:** [@Arunkumar\_Chandran](https://discuss.elastic.co/u/Arunkumar_Chandran)\
**Replies:** 1\
**Last updated:** [February 24, 2022, 1:33pm UTC](https://discuss.elastic.co/t/master-node-rejecting-the-data-node-request/298168 "2022-02-24T13:33:39Z")

</div>

We are using Elasticsearch version 7.0 can someone pleasse help us to resolve this issue. Error: "error":{"root\_cause":\[{"type":"master\_not\_discovered\_exception","reason":null}\],"type":"master\_not\_discovered\_exception"…

---

## [Updating Kibana Filters from Vega-Lite](https://discuss.elastic.co/t/updating-kibana-filters-from-vega-lite/296333)

<div class="topic-metadata">

**Author:** [@Andrew22](https://discuss.elastic.co/u/Andrew22)\
**Replies:** 1\
**Last updated:** [February 24, 2022, 12:23pm UTC](https://discuss.elastic.co/t/updating-kibana-filters-from-vega-lite/296333 "2022-02-24T12:23:57Z")

</div>

Hello, I am wondering if it is possible to update kibana filter from Vega-Lite like it is possible in Vega? I found the Vega Tutorial here: Tutorial: Updating Kibana filters from Vega | Kibana Guide \[7.9\] | Elastic Th…

---

## [Alert on index patterns' filed conflicts](https://discuss.elastic.co/t/alert-on-index-patterns-filed-conflicts/298158)

<div class="topic-metadata">

**Author:** [@pszemesy](https://discuss.elastic.co/u/pszemesy)\
**Replies:** 0\
**Last updated:** [February 24, 2022, 12:19pm UTC](https://discuss.elastic.co/t/alert-on-index-patterns-filed-conflicts/298158 "2022-02-24T12:19:15Z")

</div>

Hi All, I need to crearte an alert to monitor if there are any conflicting fields in the index patterns. ES and Kibana version: 7.16.1 (platinum license) Thanks, Peter

---

## [How to add index pattern for a space in Kibana](https://discuss.elastic.co/t/how-to-add-index-pattern-for-a-space-in-kibana/298136)

<div class="topic-metadata">

**Author:** [@borisr84](https://discuss.elastic.co/u/borisr84)\
**Replies:** 1\
**Last updated:** [February 24, 2022, 12:06pm UTC](https://discuss.elastic.co/t/how-to-add-index-pattern-for-a-space-in-kibana/298136 "2022-02-24T12:06:19Z")

</div>

Hi, I'm trying to add an index pattern for a particular space. I tried using the provided API, described here: POST \<kibana host\>:\<port\>/s/\<space\_id\>/api/index\_patterns/index\_pattern But, I keep getting 404 response. …

---

## [Search performance issue on Elasticsearch cluster](https://discuss.elastic.co/t/search-performance-issue-on-elasticsearch-cluster/298156)

<div class="topic-metadata">

**Author:** [@alpernka](https://discuss.elastic.co/u/alpernka)\
**Replies:** 1\
**Last updated:** [February 24, 2022, 11:57am UTC](https://discuss.elastic.co/t/search-performance-issue-on-elasticsearch-cluster/298156 "2022-02-24T11:57:03Z")

</div>

In an 14 node, RAID 5 based Elasticsearch cluster, the search performance does not improve no matter how simple the full-text query is. There are two indices: one is 30 shard, 1 replica, 1.1tb and 110M document size. Th…

---

## [Custom Search Autocomplete](https://discuss.elastic.co/t/custom-search-autocomplete/295804)

<div class="topic-metadata">

**Author:** [@tstadler](https://discuss.elastic.co/u/tstadler)\
**Replies:** 1\
**Last updated:** [February 24, 2022, 11:42am UTC](https://discuss.elastic.co/t/custom-search-autocomplete/295804 "2022-02-24T11:42:11Z")

</div>

Is there a way (for an external plugin) to provide custom autocomplete (e.g. for a different query language than KQL) in the search bar? I am especially interested in a solution for the Vega visualization type.

[Previous page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1036)

[Next page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1038)
