# Elastic Stack

**URL:** https://discuss.elastic.co/c/elastic-stack/81.md?page=1792

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1793

---

## [Export data from elasticsearch index to a file](https://discuss.elastic.co/t/export-data-from-elasticsearch-index-to-a-file/249525)

<div class="topic-metadata">

**Author:** [@Vladpov](https://discuss.elastic.co/u/Vladpov)\
**Replies:** 0\
**Last updated:** [September 22, 2020, 1:10pm UTC](https://discuss.elastic.co/t/export-data-from-elasticsearch-index-to-a-file/249525 "2020-09-22T13:10:59Z")

</div>

Hello, I'd like to get all data that I have in index to a file (text or json) or use logstash to fetch the data and transport the data directly to another database (InfluxDB in particular) by using elasticsearch input a…

---

## [Why does the replacement @timestamp fail？](https://discuss.elastic.co/t/why-does-the-replacement-timestamp-fail/249210)

<div class="topic-metadata">

**Author:** [@wajika](https://discuss.elastic.co/u/wajika)\
**Replies:** 5\
**Last updated:** [September 22, 2020, 1:09pm UTC](https://discuss.elastic.co/t/why-does-the-replacement-timestamp-fail/249210 "2020-09-22T13:09:15Z")

</div>

The index pattern was created without any timestamp. filter { date { match =\> \["\[CreationTime\]","yyyy-MM-dd HH:mm:ss.SSS"\] timezone =\> "Asia/Shanghai" target =\> "@timestamp" } } mutate { …

---

## [Is there any way not to use Elasticsearch's Clustering system? (in docker)](https://discuss.elastic.co/t/is-there-any-way-not-to-use-elasticsearchs-clustering-system-in-docker/249505)

<div class="topic-metadata">

**Author:** [@mcarthcat](https://discuss.elastic.co/u/mcarthcat)\
**Replies:** 2\
**Last updated:** [September 22, 2020, 12:40pm UTC](https://discuss.elastic.co/t/is-there-any-way-not-to-use-elasticsearchs-clustering-system-in-docker/249505 "2020-09-22T12:40:19Z")

</div>

first.. I'm not good at english. execuse me.. Hello. I don't want to manage Cluster(nods or shards). Please tell me how to set Docker-compose? (or any way in Docker) Thanks...

---

## [Creating New Indices using Functionbeat](https://discuss.elastic.co/t/creating-new-indices-using-functionbeat/246177)

<div class="topic-metadata">

**Author:** [@joabrb22](https://discuss.elastic.co/u/joabrb22)\
**Replies:** 3\
**Last updated:** [September 22, 2020, 12:39pm UTC](https://discuss.elastic.co/t/creating-new-indices-using-functionbeat/246177 "2020-09-22T12:39:52Z")

</div>

I have searched across the internet after having read the documentation, but I cannot seem to find the answer to my question. I want to create multiple new indicesfor Functionbeat, besides the default. I created a new i…

---

## [How to push winlogbeat logs to the kibana manually](https://discuss.elastic.co/t/how-to-push-winlogbeat-logs-to-the-kibana-manually/249467)

<div class="topic-metadata">

**Author:** [@neelu\_patel](https://discuss.elastic.co/u/neelu_patel)\
**Replies:** 1\
**Last updated:** [September 22, 2020, 12:36pm UTC](https://discuss.elastic.co/t/how-to-push-winlogbeat-logs-to-the-kibana-manually/249467 "2020-09-22T12:36:03Z")

</div>

is anyone know about , how to push winlogbeat logs to the kibana manually?

---

## [Querying and sorting using painless script and nested fields](https://discuss.elastic.co/t/querying-and-sorting-using-painless-script-and-nested-fields/249408)

<div class="topic-metadata">

**Author:** [@Emanuel\_Velzi](https://discuss.elastic.co/u/Emanuel_Velzi)\
**Replies:** 2\
**Last updated:** [September 22, 2020, 12:26pm UTC](https://discuss.elastic.co/t/querying-and-sorting-using-painless-script-and-nested-fields/249408 "2020-09-22T12:26:10Z")

</div>

Hi, I am querying an index in my ES cluster 7.9.1: { "query": { "multi\_match": { "query": "Ciudad Boli", "fields": \[ "name.\*.single" \], "type": "phrase\_prefix" …

---

## [Handling TB's of data in Elasticsearch](https://discuss.elastic.co/t/handling-tbs-of-data-in-elasticsearch/249455)

<div class="topic-metadata">

**Author:** [@Jayabal\_K](https://discuss.elastic.co/u/Jayabal_K)\
**Replies:** 3\
**Last updated:** [September 22, 2020, 12:19pm UTC](https://discuss.elastic.co/t/handling-tbs-of-data-in-elasticsearch/249455 "2020-09-22T12:19:57Z")

</div>

Hi all, In my case, I need to handle 3TB of data in elaticsearch, We have a job to rotate the index daily once. Each day a new index will be created, which is of size 100 GB. For 30 days we have 30 indices( 30 \* 100GB =…

---

## [Coordinator node failed to join the cluster](https://discuss.elastic.co/t/coordinator-node-failed-to-join-the-cluster/249517)

<div class="topic-metadata">

**Author:** [@Abdelhalim](https://discuss.elastic.co/u/Abdelhalim)\
**Replies:** 0\
**Last updated:** [September 22, 2020, 12:14pm UTC](https://discuss.elastic.co/t/coordinator-node-failed-to-join-the-cluster/249517 "2020-09-22T12:14:27Z")

</div>

Hello, I am trying to add a coordinator node to my cluster, but I am facing this error when I run it : \[2020-09-22T14:03:00,808\]\[INFO \]\[o.e.c.c.JoinHelper \] \[coordinator-node\] failed to join {VSELK-MASTER-02}{7ZS…

---

## [Which Spring Data design when the total\_fields limit is reached?](https://discuss.elastic.co/t/which-spring-data-design-when-the-total-fields-limit-is-reached/248315)

<div class="topic-metadata">

**Author:** [@juherr](https://discuss.elastic.co/u/juherr)\
**Replies:** 1\
**Last updated:** [September 22, 2020, 12:09pm UTC](https://discuss.elastic.co/t/which-spring-data-design-when-the-total-fields-limit-is-reached/248315 "2020-09-22T12:09:58Z")

</div>

Hi, We are using Elasticsearch through Spring Data and we reached the default "index.mapping.total\_fields.limit". We are indexing 5 different types of documents (via Java types, not index types). Each document has many…

---

## [Elasticsearch eat 100% of cpu](https://discuss.elastic.co/t/elasticsearch-eat-100-of-cpu/249076)

<div class="topic-metadata">

**Author:** [@vodka\_pivo](https://discuss.elastic.co/u/vodka_pivo)\
**Replies:** 5\
**Last updated:** [September 22, 2020, 12:02pm UTC](https://discuss.elastic.co/t/elasticsearch-eat-100-of-cpu/249076 "2020-09-22T12:02:12Z")

</div>

I have 3 node Elasticsearch cluster (7 verion) on this HW vCPU: 8 RAM 16 ( 8GB HEAP) disk SSD 300gb OS CentOS 7 so totally in my cluster i have 24 vCPU, 48 RAM, and 1,2 TB i have 70 indices (all of indices has 3 primar…

---

## [Elastic Agent 7.9.1 doesn´t send data on Windows](https://discuss.elastic.co/t/elastic-agent-7-9-1-doesn-t-send-data-on-windows/248273)

<div class="topic-metadata">

**Author:** [@hofrichterovak](https://discuss.elastic.co/u/hofrichterovak)\
**Replies:** 14\
**Last updated:** [September 22, 2020, 11:32am UTC](https://discuss.elastic.co/t/elastic-agent-7-9-1-doesn-t-send-data-on-windows/248273 "2020-09-22T11:32:03Z")

</div>

Hello, I have problem with Elastic Agent 7.9.1 on Windows. Agent doesn´t generate any data. I don´t see generated dataset on tab Datasets in Kibana. GET metrics-/\_search; GET logs-/\_search is without data too. At the b…

---

## [Formatnumber "0.000%" in PIE](https://discuss.elastic.co/t/formatnumber-0-000-in-pie/248673)

<div class="topic-metadata">

**Author:** [@francieliton\_araujo](https://discuss.elastic.co/u/francieliton_araujo)\
**Replies:** 2\
**Last updated:** [September 22, 2020, 11:28am UTC](https://discuss.elastic.co/t/formatnumber-0-000-in-pie/248673 "2020-09-22T11:28:46Z")

</div>

I created a pie view however as the value is very close to 100 percent, it doesn't really show the result as it rounds to 100 as follows in the image 287/5000 if you look you will see that in the graph it shows the res…

---

## [Deoptimised the styling of pitch\_presentation.js as it exceeds the max of 500KB](https://discuss.elastic.co/t/deoptimised-the-styling-of-pitch-presentation-js-as-it-exceeds-the-max-of-500kb/249473)

<div class="topic-metadata">

**Author:** [@aksadvance](https://discuss.elastic.co/u/aksadvance)\
**Replies:** 1\
**Last updated:** [September 22, 2020, 11:14am UTC](https://discuss.elastic.co/t/deoptimised-the-styling-of-pitch-presentation-js-as-it-exceeds-the-max-of-500kb/249473 "2020-09-22T11:14:57Z")

</div>

Hi, I am getting below issue on starting kibana 7.9.1 on ubuntu(8GB RAM) machine and its stuck at this point. \[BABEL\] Note: The code generator has deoptimised the styling of /export/home1/Elk\_Setup/kibana-7.9.1-linux-x…

---

## [TSVB, Value is 0 when time filter set to "Today" and "Data time range mode" set to"Last Value"](https://discuss.elastic.co/t/tsvb-value-is-0-when-time-filter-set-to-today-and-data-time-range-mode-set-to-last-value/246719)

<div class="topic-metadata">

**Author:** [@mcarthcat](https://discuss.elastic.co/u/mcarthcat)\
**Replies:** 5\
**Last updated:** [September 22, 2020, 11:00am UTC](https://discuss.elastic.co/t/tsvb-value-is-0-when-time-filter-set-to-today-and-data-time-range-mode-set-to-last-value/246719 "2020-09-22T11:00:59Z")

</div>

first.. i\`m not good at english. Excuse me.. scenario kibana v7.8.0 metricbeat (cpu) is running Time Filter : Today visulize : \[ TSVB / Gauge \] Data Metric Aggregation : Average Field: system. memory.used.pct G…

---

## [Search Query Help](https://discuss.elastic.co/t/search-query-help/249469)

<div class="topic-metadata">

**Author:** [@tolar](https://discuss.elastic.co/u/tolar)\
**Replies:** 3\
**Last updated:** [September 22, 2020, 10:33am UTC](https://discuss.elastic.co/t/search-query-help/249469 "2020-09-22T10:33:54Z")

</div>

I inserted records with below commands: POST dnmindex1/doc/ { "matches": \[ { "XURI": "xcp:4.1:a:abcv12:abcp12:6.0:\*:\*:\*:\*:\*:\*:\*" }, { …

---

## [Beats stopped working after enabled TLS/SSL on Elasticsearch and Kibana](https://discuss.elastic.co/t/beats-stopped-working-after-enabled-tls-ssl-on-elasticsearch-and-kibana/249354)

<div class="topic-metadata">

**Author:** [@ankitdevnalkar](https://discuss.elastic.co/u/ankitdevnalkar)\
**Replies:** 6\
**Last updated:** [September 22, 2020, 10:30am UTC](https://discuss.elastic.co/t/beats-stopped-working-after-enabled-tls-ssl-on-elasticsearch-and-kibana/249354 "2020-09-22T10:30:16Z")

</div>

Winlogbeat,packetbeat,auditbeat stopped working right after enabling TLS/SSL between Elasticsearch and Kibana. Attached image is my configuration for winlogbeat.yml. I tried putting https also but it is not working. Do I…

---

## [Kibana \> Lens Vis. \> Share](https://discuss.elastic.co/t/kibana-lens-vis-share/249456)

<div class="topic-metadata">

**Author:** [@Er.Sid](https://discuss.elastic.co/u/Er.Sid)\
**Replies:** 4\
**Last updated:** [September 22, 2020, 9:22am UTC](https://discuss.elastic.co/t/kibana-lens-vis-share/249456 "2020-09-22T09:22:55Z")

</div>

Hello All, I have created a Data Table in Kibana - Visualization - lens - Data Table I wish to export or Share this table to PDF or any other format. Normally ,,SHARE" button is available on every Visualisation, Ho…

---

## [ElasticSearch 7.4 taking 100% cpu usage](https://discuss.elastic.co/t/elasticsearch-7-4-taking-100-cpu-usage/249241)

<div class="topic-metadata">

**Author:** [@Pavan\_Kalyan\_Ladi](https://discuss.elastic.co/u/Pavan_Kalyan_Ladi)\
**Replies:** 4\
**Last updated:** [September 22, 2020, 8:39am UTC](https://discuss.elastic.co/t/elasticsearch-7-4-taking-100-cpu-usage/249241 "2020-09-22T08:39:07Z")

</div>

Recently we migrated from ES-5.1 to ES7.4 and the CPU usage too high in ES7.4 compared to ES5.1 With a given load the max. cpu usage of 5.1 is in between 0% to 10%. However the performance and max. cpu usage of 7.4 is …

---

## [Object mapping for \[Data\] tried to parse field \[Data\] as object, but found a concrete value](https://discuss.elastic.co/t/object-mapping-for-data-tried-to-parse-field-data-as-object-but-found-a-concrete-value/249476)

<div class="topic-metadata">

**Author:** [@wajika](https://discuss.elastic.co/u/wajika)\
**Replies:** 0\
**Last updated:** [September 22, 2020, 8:29am UTC](https://discuss.elastic.co/t/object-mapping-for-data-tried-to-parse-field-data-as-object-but-found-a-concrete-value/249476 "2020-09-22T08:29:25Z")

</div>

elasticsearch - Could not index event to Elasticsearch. {:status=\>400, :action=\>\["index", {:\_id=\>nil, :\_index=\>"mall\_log-2020.09", :routing=\>nil, :\_type=\>"\_doc"}, #LogStash::Event:0x52c34e1a\], :response=\>{"index"=\>{"\_in…

---

## [Can I predict how much memory do I need?](https://discuss.elastic.co/t/can-i-predict-how-much-memory-do-i-need/249431)

<div class="topic-metadata">

**Author:** [@monit\_pakubuwono](https://discuss.elastic.co/u/monit_pakubuwono)\
**Replies:** 1\
**Last updated:** [September 22, 2020, 7:56am UTC](https://discuss.elastic.co/t/can-i-predict-how-much-memory-do-i-need/249431 "2020-09-22T07:56:30Z")

</div>

Hi, I am sorry if my question is silly, I am actually a chemical engineer that want to use Elastic Search on my own mobile app. I want to make deployment using Elastic Cloud. there are storage and memory, I can predict…

---

## [Could not locate that index-pattern (id: filebeat-\*)](https://discuss.elastic.co/t/could-not-locate-that-index-pattern-id-filebeat/249447)

<div class="topic-metadata">

**Author:** [@Mobin](https://discuss.elastic.co/u/Mobin)\
**Replies:** 1\
**Last updated:** [September 22, 2020, 7:34am UTC](https://discuss.elastic.co/t/could-not-locate-that-index-pattern-id-filebeat/249447 "2020-09-22T07:34:56Z")

</div>

Dear Team, I am new to Elastic stack and recently I created a elastic stack setup using file beat. My intention is to monitor the Linux server logs, So I installed Elasticsearch, Logstash,filebeat, and Kibana on server …

---

## [Indicies turn yellow from specific date - only 1% of Data is shown in Kibana](https://discuss.elastic.co/t/indicies-turn-yellow-from-specific-date-only-1-of-data-is-shown-in-kibana/249364)

<div class="topic-metadata">

**Author:** [@Moritz\_Kiesewetter](https://discuss.elastic.co/u/Moritz_Kiesewetter)\
**Replies:** 3\
**Last updated:** [September 22, 2020, 7:21am UTC](https://discuss.elastic.co/t/indicies-turn-yellow-from-specific-date-only-1-of-data-is-shown-in-kibana/249364 "2020-09-22T07:21:31Z")

</div>

Hello Community first of all - some infos about the cluster i'm using: 3 Nodes - 1 Master - 2 Data Nodes (All of them running CentOS 7) Kibana Version 7.8 Elasticsearch Version 7.8 Logstash Version 7.8 Filebeat Vers…

---

## [Rollup Jobs extremly high CPU USage](https://discuss.elastic.co/t/rollup-jobs-extremly-high-cpu-usage/249359)

<div class="topic-metadata">

**Author:** [@michaelpietzsch](https://discuss.elastic.co/u/michaelpietzsch)\
**Replies:** 2\
**Last updated:** [September 22, 2020, 7:20am UTC](https://discuss.elastic.co/t/rollup-jobs-extremly-high-cpu-usage/249359 "2020-09-22T07:20:35Z")

</div>

Hi Guys and Gals, i've got a rollup job running on my cluster. Once its active CPU Spikes extremely. The cluster consists of 6 Dedicated data nodes. How can this happen? Regards Michael

---

## [Sending logs to elsatic-stack from another eks application cluster via filebeat](https://discuss.elastic.co/t/sending-logs-to-elsatic-stack-from-another-eks-application-cluster-via-filebeat/248520)

<div class="topic-metadata">

**Author:** [@Raman\_Sawhney](https://discuss.elastic.co/u/Raman_Sawhney)\
**Replies:** 2\
**Last updated:** [September 22, 2020, 7:03am UTC](https://discuss.elastic.co/t/sending-logs-to-elsatic-stack-from-another-eks-application-cluster-via-filebeat/248520 "2020-09-22T07:03:24Z")

</div>

Hello Team, just wanted to check on one thing may be it sound silly but i am asking. Here is the scenerio that we have one eks cluster where we have installed elastic-stack all the pods and everything. If i want to sen…

---

## [Records more than 10,000 with pagination](https://discuss.elastic.co/t/records-more-than-10-000-with-pagination/249398)

<div class="topic-metadata">

**Author:** [@Pankaj\_Jadhav](https://discuss.elastic.co/u/Pankaj_Jadhav)\
**Replies:** 4\
**Last updated:** [September 22, 2020, 6:58am UTC](https://discuss.elastic.co/t/records-more-than-10-000-with-pagination/249398 "2020-09-22T06:58:10Z")

</div>

Hi Team, Am having more than 10,000 + records under elastic. Now my requirement is i've to show records to user with pagination. Am able to show records upto 10,000 with back end logic like elastic query { "from" : …

---

## [Filebeat custom module pipeline failed](https://discuss.elastic.co/t/filebeat-custom-module-pipeline-failed/249297)

<div class="topic-metadata">

**Author:** [@icaruswu](https://discuss.elastic.co/u/icaruswu)\
**Replies:** 4\
**Last updated:** [September 22, 2020, 6:51am UTC](https://discuss.elastic.co/t/filebeat-custom-module-pipeline-failed/249297 "2020-09-22T06:51:07Z")

</div>

I build my own filebeat and I created a 'pipeline.yml' in the ingest directory. And I'm surely changed the ingest\_pipeline PATH in the mainfest.yml. But when I executed the filebeat but the pipeline processors not worke…

---

## [Performance for small index](https://discuss.elastic.co/t/performance-for-small-index/249329)

<div class="topic-metadata">

**Author:** [@Mathmarc](https://discuss.elastic.co/u/Mathmarc)\
**Replies:** 6\
**Last updated:** [September 22, 2020, 5:54am UTC](https://discuss.elastic.co/t/performance-for-small-index/249329 "2020-09-22T05:54:55Z")

</div>

Hi everyone, I have multiple question about the optimization of a cluster with: running on c5.xlarge (4cpu 8GB ram) huge read req/s and small write req/s. small index 20GB to 30GB. experimenting shard between 1GB to …

---

## [Kibana-7.8.1-1. Csv separator doesn't work in the Discovery -\> Share -\> CSV Reports](https://discuss.elastic.co/t/kibana-7-8-1-1-csv-separator-doesnt-work-in-the-discovery-share-csv-reports/248996)

<div class="topic-metadata">

**Author:** [@dsv](https://discuss.elastic.co/u/dsv)\
**Replies:** 1\
**Last updated:** [September 22, 2020, 6:30am UTC](https://discuss.elastic.co/t/kibana-7-8-1-1-csv-separator-doesnt-work-in-the-discovery-share-csv-reports/248996 "2020-09-22T06:30:33Z")

</div>

In Advanced settings the "CSV separator" is set to "backquote". And it works in the Visualize -\> "Export: Formatted". When i trying to export search results in the Discovery -\> Share -\> CSV Reports the format of the…

---

## [Logstash Events Latency using Stats API](https://discuss.elastic.co/t/logstash-events-latency-using-stats-api/249444)

<div class="topic-metadata">

**Author:** [@8wlgns](https://discuss.elastic.co/u/8wlgns)\
**Replies:** 0\
**Last updated:** [September 22, 2020, 5:14am UTC](https://discuss.elastic.co/t/logstash-events-latency-using-stats-api/249444 "2020-09-22T05:14:48Z")

</div>

I want to calculate Event duration per millisecond using logstash events stats api. Could I use events.out / events.duration\_in\_millis ?

---

## [Regarding NanoSecond Timestamps](https://discuss.elastic.co/t/regarding-nanosecond-timestamps/249320)

<div class="topic-metadata">

**Author:** [@dawiro](https://discuss.elastic.co/u/dawiro)\
**Replies:** 1\
**Last updated:** [September 22, 2020, 6:17am UTC](https://discuss.elastic.co/t/regarding-nanosecond-timestamps/249320 "2020-09-22T06:17:37Z")

</div>

Hi, We have environments running elasticsearch/kibana 7.2.x. We have a need to enable nanosecond timestamps. What will be the effect on kibana of that change as it doesn't seem to be a supported type until 7.3.0? Thx D …

[Previous page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1791)

[Next page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1793)
