# Elastic Stack

**URL:** https://discuss.elastic.co/c/elastic-stack/81.md?page=1527

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1528

---

## [High CPU and Memory Usage](https://discuss.elastic.co/t/high-cpu-and-memory-usage/265898)

<div class="topic-metadata">

**Author:** [@duck](https://discuss.elastic.co/u/duck)\
**Replies:** 1\
**Last updated:** [March 2, 2021, 7:10pm UTC](https://discuss.elastic.co/t/high-cpu-and-memory-usage/265898 "2021-03-02T19:10:25Z")

</div>

Hi, I've setup Elasticsearch and Kibana on Docker. For testing purpose, I've used "eCommerce Dashboard" example from Kibana(which has one index and almost 5,000 documents.). My Ubuntu server shows me Elasticsearch uses …

---

## [Unexpected json rejection](https://discuss.elastic.co/t/unexpected-json-rejection/265990)

<div class="topic-metadata">

**Author:** [@iakhmetzyanov](https://discuss.elastic.co/u/iakhmetzyanov)\
**Replies:** 4\
**Last updated:** [March 2, 2021, 5:50pm UTC](https://discuss.elastic.co/t/unexpected-json-rejection/265990 "2021-03-02T17:50:03Z")

</div>

Hello! Please help me to find out is it a bug or I can fix some configs to solve errors. I have ELK 7.9.2 installation. I'm sending logs from python app to Logstash to store them in Elastc and visualaize them with Kiba…

---

## [Logstash ('No configuration found in the configured sources')](https://discuss.elastic.co/t/logstash-no-configuration-found-in-the-configured-sources/265765)

<div class="topic-metadata">

**Author:** [@matteo001](https://discuss.elastic.co/u/matteo001)\
**Replies:** 9\
**Last updated:** [March 2, 2021, 5:48pm UTC](https://discuss.elastic.co/t/logstash-no-configuration-found-in-the-configured-sources/265765 "2021-03-02T17:48:26Z")

</div>

Hi everyone, I tried to load the JSON file in elastic search through Logstash in windows10. I show you my "MATTEOLOGSTASHCONF.conf" file: input { file { start\_position =\> "beginning" path =\> "C:/Users/matte/Desktop/…

---

## [Help importing text file split by |](https://discuss.elastic.co/t/help-importing-text-file-split-by/265951)

<div class="topic-metadata">

**Author:** [@randomrobbiebf](https://discuss.elastic.co/u/randomrobbiebf)\
**Replies:** 1\
**Last updated:** [March 2, 2021, 5:45pm UTC](https://discuss.elastic.co/t/help-importing-text-file-split-by/265951 "2021-03-02T17:45:32Z")

</div>

Hey all, I have multiple text files i am trying to import what i currently have imports the text files but ideally i need to split each line. the lines of the text files i am importing look like aXsdA|http://someurl W…

---

## [Failed to parse date field](https://discuss.elastic.co/t/failed-to-parse-date-field/265328)

<div class="topic-metadata">

**Author:** [@Alexandros888](https://discuss.elastic.co/u/Alexandros888)\
**Replies:** 5\
**Last updated:** [March 2, 2021, 5:36pm UTC](https://discuss.elastic.co/t/failed-to-parse-date-field/265328 "2021-03-02T17:36:07Z")

</div>

Hello, After upgrading to version 7.11 from version 7.9.3 suddenly one of my index patterns cant load properly results in kibana overview. The dark point is that it used to work fine before the update. The error mes…

---

## [S3 output configuration failing constantly](https://discuss.elastic.co/t/s3-output-configuration-failing-constantly/265812)

<div class="topic-metadata">

**Author:** [@qubusp](https://discuss.elastic.co/u/qubusp)\
**Replies:** 3\
**Last updated:** [March 2, 2021, 5:19pm UTC](https://discuss.elastic.co/t/s3-output-configuration-failing-constantly/265812 "2021-03-02T17:19:46Z")

</div>

input { java\_generator{ } } filter{ csv{ } } output { s3 { validate\_credentials\_on\_root\_bucket =\> false, endpoint =\> "http://nginx:9000", bucket =\> "rawdata", codec =\> "csv", addi…

---

## [How to get smaller intervals on x axis in bar visualization?](https://discuss.elastic.co/t/how-to-get-smaller-intervals-on-x-axis-in-bar-visualization/265932)

<div class="topic-metadata">

**Author:** [@NiclasK](https://discuss.elastic.co/u/NiclasK)\
**Replies:** 5\
**Last updated:** [March 2, 2021, 5:12pm UTC](https://discuss.elastic.co/t/how-to-get-smaller-intervals-on-x-axis-in-bar-visualization/265932 "2021-03-02T17:12:44Z")

</div>

Hi, Just upgraded Kibana to 7.11 and started using Lens to create visualizations. I'm creating a bar visualization using the interval function on the x axis. I would like to set a smaller interval than I can get using t…

---

## [Filter dashboard visualisations based on visible map area?](https://discuss.elastic.co/t/filter-dashboard-visualisations-based-on-visible-map-area/265952)

<div class="topic-metadata">

**Author:** [@rmoff](https://discuss.elastic.co/u/rmoff)\
**Replies:** 2\
**Last updated:** [March 2, 2021, 4:52pm UTC](https://discuss.elastic.co/t/filter-dashboard-visualisations-based-on-visible-map-area/265952 "2021-03-02T16:52:59Z")

</div>

In Kibana 7.11 is it possible to make visualisations on a dashboard filter based on the current visible area of a map that's present on the dashboard? I know that I can draw bounding boxes etc on the map in order to app…

---

## [Log4j2 how to log tags](https://discuss.elastic.co/t/log4j2-how-to-log-tags/265987)

<div class="topic-metadata">

**Author:** [@pippobaudo](https://discuss.elastic.co/u/pippobaudo)\
**Replies:** 0\
**Last updated:** [March 2, 2021, 4:45pm UTC](https://discuss.elastic.co/t/log4j2-how-to-log-tags/265987 "2021-03-02T16:45:55Z")

</div>

Hi, I'm trying to log the elastic field "tags" in a java app. Im using the java library log4j2 and I used the following code: List\<String\> tag\_example = new ArrayList(); tag\_example.add("local"); tag\_examp…

---

## [Logstash filebeat json payload problem](https://discuss.elastic.co/t/logstash-filebeat-json-payload-problem/265237)

<div class="topic-metadata">

**Author:** [@MMerel](https://discuss.elastic.co/u/MMerel)\
**Replies:** 2\
**Last updated:** [March 2, 2021, 4:15pm UTC](https://discuss.elastic.co/t/logstash-filebeat-json-payload-problem/265237 "2021-03-02T16:15:21Z")

</div>

Hello everyone, I´m having trouble trying to parse simple json data from logstash to elasticsearch . My config is : filebeat suscribed to some mosquitto topic \> logstash mqqt input \> elasticsearch \> kibana. @timestamp …

---

## [Upgrade path from v 6.8.14 to current 7.11.x](https://discuss.elastic.co/t/upgrade-path-from-v-6-8-14-to-current-7-11-x/265979)

<div class="topic-metadata">

**Author:** [@acaldwell](https://discuss.elastic.co/u/acaldwell)\
**Replies:** 0\
**Last updated:** [March 2, 2021, 3:58pm UTC](https://discuss.elastic.co/t/upgrade-path-from-v-6-8-14-to-current-7-11-x/265979 "2021-03-02T15:58:43Z")

</div>

Hello, My organization is currently running the elastic stack v6.8.14 and will be upgrading to current 7.11.x in the near future. We are running this on kubernetes and have two clusters - prod and nonprod. Our nonprod…

---

## [Version field type shows as unknown in the index pattern](https://discuss.elastic.co/t/version-field-type-shows-as-unknown-in-the-index-pattern/265973)

<div class="topic-metadata">

**Author:** [@Dor\_Dadush](https://discuss.elastic.co/u/Dor_Dadush)\
**Replies:** 1\
**Last updated:** [March 2, 2021, 3:50pm UTC](https://discuss.elastic.co/t/version-field-type-shows-as-unknown-in-the-index-pattern/265973 "2021-03-02T15:50:11Z")

</div>

Hi everyone :slight\_smile: I have an index template which contains a mapping of the field agent.version to the type version (introduced in 7.10.X if I'm not mistaken) But, in the index pattern of the relevant index, I …

---

## [Index.routing.allocation.require filter for \_name](https://discuss.elastic.co/t/index-routing-allocation-require-filter-for-name/265967)

<div class="topic-metadata">

**Author:** [@joemorris](https://discuss.elastic.co/u/joemorris)\
**Replies:** 6\
**Last updated:** [March 2, 2021, 3:29pm UTC](https://discuss.elastic.co/t/index-routing-allocation-require-filter-for-name/265967 "2021-03-02T15:29:09Z")

</div>

New to the inner workings of ES and stumbled on an error when testing a change in our staging environment. Before the change we had 3 master nodes (not in data mode) and 2 data nodes. We're now expanding the data mode to…

---

## [Kibana not work after upgrade](https://discuss.elastic.co/t/kibana-not-work-after-upgrade/265964)

<div class="topic-metadata">

**Author:** [@pauldon2](https://discuss.elastic.co/u/pauldon2)\
**Replies:** 4\
**Last updated:** [March 2, 2021, 3:24pm UTC](https://discuss.elastic.co/t/kibana-not-work-after-upgrade/265964 "2021-03-02T15:24:44Z")

</div>

I have ELK cluster with ver. 6.6.2-oss Works in docker. Last week I upgraded to version 6.8.14 (basic). Elasticsearch works without any problems. But any attempts to switch to kibana other than version 6.6.2-oss end i…

---

## [Getting Started: Contributing to Elasticsearch](https://discuss.elastic.co/t/getting-started-contributing-to-elasticsearch/265717)

<div class="topic-metadata">

**Author:** [@madumalt](https://discuss.elastic.co/u/madumalt)\
**Replies:** 2\
**Last updated:** [March 2, 2021, 3:12pm UTC](https://discuss.elastic.co/t/getting-started-contributing-to-elasticsearch/265717 "2021-03-02T15:12:55Z")

</div>

Hi All, I've been using ELK stack for sometime now and wanted to start contributing to the elasticsearch code base. I've setup the development environment and trying to understand the elasticsearch code base. However, …

---

## [Synchronization of Index among different ES-Clusters](https://discuss.elastic.co/t/synchronization-of-index-among-different-es-clusters/265774)

<div class="topic-metadata">

**Author:** [@jimchk](https://discuss.elastic.co/u/jimchk)\
**Replies:** 3\
**Last updated:** [March 2, 2021, 3:11pm UTC](https://discuss.elastic.co/t/synchronization-of-index-among-different-es-clusters/265774 "2021-03-02T15:11:14Z")

</div>

Hello, I would like to know about the best practice for synchronizing indexed data of an elastic search index to another index located in a different cluster. Currently, I have an index for reporting, which is my prima…

---

## [Don't see the metrics I expect](https://discuss.elastic.co/t/dont-see-the-metrics-i-expect/265871)

<div class="topic-metadata">

**Author:** [@mcco0l](https://discuss.elastic.co/u/mcco0l)\
**Replies:** 5\
**Last updated:** [March 2, 2021, 2:52pm UTC](https://discuss.elastic.co/t/dont-see-the-metrics-i-expect/265871 "2021-03-02T14:52:15Z")

</div>

Hi there, I'm trying to get some Fargate metrics using Cloudwatch namespaces, but I don't see a way to get them to Kibana. modules.d/aws.yml - module: aws period: 5m access\_key\_id: 'xxxxxxxxxxxxx' …

---

## [How to add the document id as currentdatetime in transform](https://discuss.elastic.co/t/how-to-add-the-document-id-as-currentdatetime-in-transform/264620)

<div class="topic-metadata">

**Author:** [@anjilinga](https://discuss.elastic.co/u/anjilinga)\
**Replies:** 8\
**Last updated:** [March 2, 2021, 2:50pm UTC](https://discuss.elastic.co/t/how-to-add-the-document-id-as-currentdatetime-in-transform/264620 "2021-03-02T14:50:31Z")

</div>

the transforma is running on every 5 sec, and the document is overwritng in the group by combination. Can you please suggest to create the record as separate one for each 5 sec. is it possible to add \_id with current d…

---

## [ES Continuous Transforms Checkpoint not updating](https://discuss.elastic.co/t/es-continuous-transforms-checkpoint-not-updating/265421)

<div class="topic-metadata">

**Author:** [@sphinx](https://discuss.elastic.co/u/sphinx)\
**Replies:** 1\
**Last updated:** [March 2, 2021, 2:42pm UTC](https://discuss.elastic.co/t/es-continuous-transforms-checkpoint-not-updating/265421 "2021-03-02T14:42:34Z")

</div>

Hi, this is pertaining to ES 7.10.2 with X-Pack. I am trying out transforms because we have a need to have a aggregate table of entities to be queried by downstream applications. we have a set of indices that the tran…

---

## [Two index pattern for same index, need to set different default time filter for each index pattern](https://discuss.elastic.co/t/two-index-pattern-for-same-index-need-to-set-different-default-time-filter-for-each-index-pattern/265829)

<div class="topic-metadata">

**Author:** [@qub123](https://discuss.elastic.co/u/qub123)\
**Replies:** 5\
**Last updated:** [March 2, 2021, 2:39pm UTC](https://discuss.elastic.co/t/two-index-pattern-for-same-index-need-to-set-different-default-time-filter-for-each-index-pattern/265829 "2021-03-02T14:39:35Z")

</div>

Hi, We have two timestamps in our document, during the index pattern creation we can only choose one timestamp for each index pattern, and that timestamp will affect the Kibana's Discover graph and the upper right corn…

---

## [How to get MonthYear from DateTime using Painless](https://discuss.elastic.co/t/how-to-get-monthyear-from-datetime-using-painless/264106)

<div class="topic-metadata">

**Author:** [@Rakesh\_Rayabarapu](https://discuss.elastic.co/u/Rakesh_Rayabarapu)\
**Replies:** 3\
**Last updated:** [March 2, 2021, 2:23pm UTC](https://discuss.elastic.co/t/how-to-get-monthyear-from-datetime-using-painless/264106 "2021-03-02T14:23:34Z")

</div>

Hello team, I wrote a script to get month (string) = doc\['@timstamp'\].value.getMonth(). Year=doc\['@timstamp'\].value.getYear(). Used concatenation montheYear=doc\['@timstamp'\].value.getMonth()+doc\['@timstamp'\].value.get…

---

## [Filebeat Error while parsing lastError field in Azure platform logs](https://discuss.elastic.co/t/filebeat-error-while-parsing-lasterror-field-in-azure-platform-logs/265940)

<div class="topic-metadata">

**Author:** [@jmmcorreia](https://discuss.elastic.co/u/jmmcorreia)\
**Replies:** 1\
**Last updated:** [March 2, 2021, 2:08pm UTC](https://discuss.elastic.co/t/filebeat-error-while-parsing-lasterror-field-in-azure-platform-logs/265940 "2021-03-02T14:08:45Z")

</div>

Hi everyone, I'm trying the filebeat beta feature to pull azure platform logs into ES and I'm hitting ing the following issue: When there is an error message on the APIM logs, the field lastError is being added to the …

---

## [Split string using Painless Scripted field](https://discuss.elastic.co/t/split-string-using-painless-scripted-field/265956)

<div class="topic-metadata">

**Author:** [@gaurav1](https://discuss.elastic.co/u/gaurav1)\
**Replies:** 1\
**Last updated:** [March 2, 2021, 2:04pm UTC](https://discuss.elastic.co/t/split-string-using-painless-scripted-field/265956 "2021-03-02T14:04:57Z")

</div>

I recently started working on Kibana, had a query regarding scripted field. Can scripted field return multiple value at same time? I have a field named Tags like "Tags": "Release-102;Release-103;version.1.0". I want to c…

---

## [Pink spaces in Elasticsearch field names](https://discuss.elastic.co/t/pink-spaces-in-elasticsearch-field-names/265762)

<div class="topic-metadata">

**Author:** [@awazanak](https://discuss.elastic.co/u/awazanak)\
**Replies:** 4\
**Last updated:** [March 2, 2021, 1:22pm UTC](https://discuss.elastic.co/t/pink-spaces-in-elasticsearch-field-names/265762 "2021-03-02T13:22:39Z")

</div>

Set-up Elasticsearch v7.10.0 Python 3.7+ Python script runs once each month to create a monthly index using the bulk insert function in the elasticsearch module. The script uses strings to define the field name during …

---

## [Elasticsearch server crashing](https://discuss.elastic.co/t/elasticsearch-server-crashing/265881)

<div class="topic-metadata">

**Author:** [@JPross](https://discuss.elastic.co/u/JPross)\
**Replies:** 5\
**Last updated:** [March 2, 2021, 1:01pm UTC](https://discuss.elastic.co/t/elasticsearch-server-crashing/265881 "2021-03-02T13:01:27Z")

</div>

Hello, We have two Elasticsearch server which are configured as the Master-slave, one server keeps getting crash.We have recently upgraded the Elasticsearch server 5.1 to 7.1.1 on our client, It is giving the following …

---

## [Can ES do a complex aggregation with WHERE and GROUP BY + ORDER BY like in MySQL](https://discuss.elastic.co/t/can-es-do-a-complex-aggregation-with-where-and-group-by-order-by-like-in-mysql/265559)

<div class="topic-metadata">

**Author:** [@Long\_Quanzheng](https://discuss.elastic.co/u/Long_Quanzheng)\
**Replies:** 7\
**Last updated:** [March 2, 2021, 12:45pm UTC](https://discuss.elastic.co/t/can-es-do-a-complex-aggregation-with-where-and-group-by-order-by-like-in-mysql/265559 "2021-03-02T12:45:13Z")

</div>

Hi, I have a query like this in MySQL that I am thinking to migrate to ElasticSearch for scalability: SELELCT userID,sum(countA) as sumA,sum(countB) as sumB FROM data\_table WHERE groupID=? AND date BETWEEN ? AND ?…

---

## [Sum aggregation precision](https://discuss.elastic.co/t/sum-aggregation-precision/265946)

<div class="topic-metadata">

**Author:** [@DawidS](https://discuss.elastic.co/u/DawidS)\
**Replies:** 1\
**Last updated:** [March 2, 2021, 12:13pm UTC](https://discuss.elastic.co/t/sum-aggregation-precision/265946 "2021-03-02T12:13:33Z")

</div>

Hello, I have a problem with sum fields with 3 decimal places. The Sum of all values is zero, but elastic sum aggregations return a very small number(like -2.837623469531536E-10). I have created a test index and put th…

---

## [Kibana not able to load Map tiles from maptiler](https://discuss.elastic.co/t/kibana-not-able-to-load-map-tiles-from-maptiler/263865)

<div class="topic-metadata">

**Author:** [@AlanMark](https://discuss.elastic.co/u/AlanMark)\
**Replies:** 2\
**Last updated:** [March 2, 2021, 11:48am UTC](https://discuss.elastic.co/t/kibana-not-able-to-load-map-tiles-from-maptiler/263865 "2021-03-02T11:48:30Z")

</div>

I've set up a Maptiler server with a world map as my environment is airgapped. In my Kibana.yml config i have: map.includeElasticMapsService: false map.tilemap.url: "localhost:3650/api/maps/streets/{z}/{x}/{y}.png" map…

---

## [Filebeat won't start](https://discuss.elastic.co/t/filebeat-wont-start/265889)

<div class="topic-metadata">

**Author:** [@its-ogawa](https://discuss.elastic.co/u/its-ogawa)\
**Replies:** 11\
**Last updated:** [March 2, 2021, 11:31am UTC](https://discuss.elastic.co/t/filebeat-wont-start/265889 "2021-03-02T11:31:06Z")

</div>

I'm trying to link filebeat with logstash, but filebeat suddenly stopped working. When I try systemctl start filebeat, it does not start. If I run systemctl status filebeat, I get the following message. ● filebeat.ser…

---

## [Set vega background color with threshold](https://discuss.elastic.co/t/set-vega-background-color-with-threshold/265038)

<div class="topic-metadata">

**Author:** [@111439](https://discuss.elastic.co/u/111439)\
**Replies:** 3\
**Last updated:** [March 2, 2021, 11:11am UTC](https://discuss.elastic.co/t/set-vega-background-color-with-threshold/265038 "2021-03-02T11:11:11Z")

</div>

Hello Everybody, I have question with vega visualize (pie chart). I want to set background color on vega visualize by condition using data. {"key": "tier1", "doc\_count": 1}, {"key": "tier2", "doc\_count": 2}, {"key": …

[Previous page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1526)

[Next page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1528)
