# Elastic Stack

**URL:** https://discuss.elastic.co/c/elastic-stack/81.md?page=1938

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1939

---

## [Transfering data from elasticsearch to mongodb](https://discuss.elastic.co/t/transfering-data-from-elasticsearch-to-mongodb/240689)

<div class="topic-metadata">

**Author:** [@sandeepsingh](https://discuss.elastic.co/u/sandeepsingh)\
**Replies:** 1\
**Last updated:** [July 10, 2020, 4:55pm UTC](https://discuss.elastic.co/t/transfering-data-from-elasticsearch-to-mongodb/240689 "2020-07-10T16:55:17Z")

</div>

Hi, I am trying to extract data from elasticsearch to mongodb. I am using the inbuilt elasticsearch input plugin and 3.1.5 mongodb output plugin. I have multiple indexes in elasticsearch whose data needs to be extracted…

---

## [Large Clusters - 35 nodes - ILM Issues](https://discuss.elastic.co/t/large-clusters-35-nodes-ilm-issues/240615)

<div class="topic-metadata">

**Author:** [@fvegaucr](https://discuss.elastic.co/u/fvegaucr)\
**Replies:** 2\
**Last updated:** [July 10, 2020, 4:15pm UTC](https://discuss.elastic.co/t/large-clusters-35-nodes-ilm-issues/240615 "2020-07-10T16:15:33Z")

</div>

Hi Im struggling a little bit with elastic ILM configuration. Version 7.4.2 I have a total of 35nodes 3 - master 2- coordinator 8 - hot nodes 20 - warm nodes 2 - cold nodes Warm Nodes have: 8 x 1.8TB of storage …

---

## [Export dashboard & visualization cli in kibana without know the kibana id](https://discuss.elastic.co/t/export-dashboard-visualization-cli-in-kibana-without-know-the-kibana-id/240482)

<div class="topic-metadata">

**Author:** [@anggara88](https://discuss.elastic.co/u/anggara88)\
**Replies:** 3\
**Last updated:** [July 10, 2020, 4:10pm UTC](https://discuss.elastic.co/t/export-dashboard-visualization-cli-in-kibana-without-know-the-kibana-id/240482 "2020-07-10T16:10:23Z")

</div>

how to export dashboard & visualization in kibana with cli without know the kibana id because of unaccessible kibana

---

## [Backup dashboard in Kibana](https://discuss.elastic.co/t/backup-dashboard-in-kibana/240580)

<div class="topic-metadata">

**Author:** [@liron\_gofberg](https://discuss.elastic.co/u/liron_gofberg)\
**Replies:** 3\
**Last updated:** [July 10, 2020, 3:57pm UTC](https://discuss.elastic.co/t/backup-dashboard-in-kibana/240580 "2020-07-10T15:57:21Z")

</div>

Hi, I created a dashboard and it was beautiful and impressive Something goes wrong with my index and because of that I found myself delete the index and recreate it to fix the problem but then I have found that there …

---

## [No errors but nothing gets indexed when using the Bulk API](https://discuss.elastic.co/t/no-errors-but-nothing-gets-indexed-when-using-the-bulk-api/240200)

<div class="topic-metadata">

**Author:** [@Rosho](https://discuss.elastic.co/u/Rosho)\
**Replies:** 13\
**Last updated:** [July 10, 2020, 3:48pm UTC](https://discuss.elastic.co/t/no-errors-but-nothing-gets-indexed-when-using-the-bulk-api/240200 "2020-07-10T15:48:23Z")

</div>

Hi I have written a script to read a list ("dummy") and index it into Elasticsearch. I converted the list into a list of dictionaries and used the "Bulk" API to index it into Elasticsearch. There are no errors but noth…

---

## [Correlated Queries for Aggregation](https://discuss.elastic.co/t/correlated-queries-for-aggregation/240192)

<div class="topic-metadata">

**Author:** [@amrit.khatri](https://discuss.elastic.co/u/amrit.khatri)\
**Replies:** 4\
**Last updated:** [July 10, 2020, 3:00pm UTC](https://discuss.elastic.co/t/correlated-queries-for-aggregation/240192 "2020-07-10T15:00:19Z")

</div>

Hi, I have a use case for writing an aggregation which if written in SQL can be achieved using correlated queries. I have a index called listings where the properties/columns are ListDate, ListPrice, SoldDate, SoldPric…

---

## [\[nested\] failed to find nested object under path \[orders\]](https://discuss.elastic.co/t/nested-failed-to-find-nested-object-under-path-orders/237603)

<div class="topic-metadata">

**Author:** [@ravivarmakola](https://discuss.elastic.co/u/ravivarmakola)\
**Replies:** 1\
**Last updated:** [July 10, 2020, 2:58pm UTC](https://discuss.elastic.co/t/nested-failed-to-find-nested-object-under-path-orders/237603 "2020-07-10T14:58:40Z")

</div>

I am getting "\[nested\] failed to find nested object under path" when searching on single index and field has "type": "nested" in mappings: PS: I am getting response, but exception is seen on elasticsearch console. If …

---

## [Beats reporting on Kibana as Standalone Cluster](https://discuss.elastic.co/t/beats-reporting-on-kibana-as-standalone-cluster/240711)

<div class="topic-metadata">

**Author:** [@vishakh](https://discuss.elastic.co/u/vishakh)\
**Replies:** 1\
**Last updated:** [July 10, 2020, 2:33pm UTC](https://discuss.elastic.co/t/beats-reporting-on-kibana-as-standalone-cluster/240711 "2020-07-10T14:33:38Z")

</div>

ELK-Stack: 7.8 Beats -\> Logstash -\> ES in my cluster: I'm ingesting both data logs and monitoring stats to same cluster. Installed and configured Filebeat 7.8 on a linux server with the below configuration. Once star…

---

## [Filebeat 7.3.2 using high CPU (50~60%)](https://discuss.elastic.co/t/filebeat-7-3-2-using-high-cpu-50-60/240251)

<div class="topic-metadata">

**Author:** [@tandav](https://discuss.elastic.co/u/tandav)\
**Replies:** 1\
**Last updated:** [July 10, 2020, 2:28pm UTC](https://discuss.elastic.co/t/filebeat-7-3-2-using-high-cpu-50-60/240251 "2020-07-10T14:28:55Z")

</div>

Hello community. I've been tweaking the filebeat.yml for several hours now, and cannot get filebeat to use less CPU than 50~60%. I have tried various combinations of: filebeat.inputs: - type: log enab…

---

## [Pass AWS tags to resources created by Functionbeat](https://discuss.elastic.co/t/pass-aws-tags-to-resources-created-by-functionbeat/240575)

<div class="topic-metadata">

**Author:** [@svenky](https://discuss.elastic.co/u/svenky)\
**Replies:** 1\
**Last updated:** [July 10, 2020, 2:14pm UTC](https://discuss.elastic.co/t/pass-aws-tags-to-resources-created-by-functionbeat/240575 "2020-07-10T14:14:48Z")

</div>

I am using Functionbeat 7.6.2 and I wanted to inject a few tags to all the AWS resources that get created as part of functionbeat deploy cloudwatch . Is there a way to do this today? I do not see documentation or exampl…

---

## [Kibana + ubuntu 20 - RaspberryPi](https://discuss.elastic.co/t/kibana-ubuntu-20-raspberrypi/239859)

<div class="topic-metadata">

**Author:** [@carmezsa](https://discuss.elastic.co/u/carmezsa)\
**Replies:** 2\
**Last updated:** [July 10, 2020, 1:58pm UTC](https://discuss.elastic.co/t/kibana-ubuntu-20-raspberrypi/239859 "2020-07-10T13:58:24Z")

</div>

Hi, I am trying to install Kibana on my Raspberry Pi 4GB with Ubuntu 20 OS and I have an issue. I install .DEB sudo dpkg -i --force-all kibana-7.8.0-amd64.deb ---code--- root@elk:/home/ubuntu# cat /var/log/syslog | …

---

## [Kibana iFrame seems to ignore numeric format precision of Dashboard Panel](https://discuss.elastic.co/t/kibana-iframe-seems-to-ignore-numeric-format-precision-of-dashboard-panel/240363)

<div class="topic-metadata">

**Author:** [@sanjaysubramanian](https://discuss.elastic.co/u/sanjaysubramanian)\
**Replies:** 3\
**Last updated:** [July 10, 2020, 1:39pm UTC](https://discuss.elastic.co/t/kibana-iframe-seems-to-ignore-numeric-format-precision-of-dashboard-panel/240363 "2020-07-10T13:39:50Z")

</div>

Hi all I have a "vertical bar visualization" embedded in my Dashboard. The precision shows up correctly as specified. However when I extract an iFrame (Share embedded link) from this Dashboard this "vertical bar visual…

---

## [Calendar filter in Kibana](https://discuss.elastic.co/t/calendar-filter-in-kibana/240468)

<div class="topic-metadata">

**Author:** [@PRACHI\_GUPTA](https://discuss.elastic.co/u/PRACHI_GUPTA)\
**Replies:** 8\
**Last updated:** [July 10, 2020, 1:38pm UTC](https://discuss.elastic.co/t/calendar-filter-in-kibana/240468 "2020-07-10T13:38:28Z")

</div>

Hi, Is there any way to add date picker filter in kibana? Thanks!!

---

## [Logstash 7.8.0 Pipeline Authentication on MongoDB 4 Failure](https://discuss.elastic.co/t/logstash-7-8-0-pipeline-authentication-on-mongodb-4-failure/240706)

<div class="topic-metadata">

**Author:** [@leoper](https://discuss.elastic.co/u/leoper)\
**Replies:** 0\
**Last updated:** [July 10, 2020, 1:36pm UTC](https://discuss.elastic.co/t/logstash-7-8-0-pipeline-authentication-on-mongodb-4-failure/240706 "2020-07-10T13:36:10Z")

</div>

Hi everyone. I'm trying to read a collection on MongoDB 4 (installed on an AWS machine) via the Logstash 7.8.0 pipeline (installed on a GCP machine). In the pipeline configuration file I tried both to specify the authe…

---

## [Elasticsearch Ingest Pipeline to Logstash](https://discuss.elastic.co/t/elasticsearch-ingest-pipeline-to-logstash/240700)

<div class="topic-metadata">

**Author:** [@BenB196](https://discuss.elastic.co/u/BenB196)\
**Replies:** 2\
**Last updated:** [July 10, 2020, 12:59pm UTC](https://discuss.elastic.co/t/elasticsearch-ingest-pipeline-to-logstash/240700 "2020-07-10T12:59:43Z")

</div>

Hi All, I have kind of a weird question. Does anyone know if it is possible to go from an Elasticsearch Ingest Pipeline to Logstash? The use case for this is that I want to use some of the pre-built Filebeat modules tha…

---

## [Elasticsearch does not score all matched docs?](https://discuss.elastic.co/t/elasticsearch-does-not-score-all-matched-docs/240281)

<div class="topic-metadata">

**Author:** [@kamils468](https://discuss.elastic.co/u/kamils468)\
**Replies:** 3\
**Last updated:** [July 10, 2020, 12:17pm UTC](https://discuss.elastic.co/t/elasticsearch-does-not-score-all-matched-docs/240281 "2020-07-10T12:17:48Z")

</div>

I have 500k docs in the index. The query I run is (with profile set to true): { "query": { "bool": { "should": \[ { "match" : { "name" : "Foo Bar" …

---

## [Root mapping definition has unsupported parameters when creating custom index](https://discuss.elastic.co/t/root-mapping-definition-has-unsupported-parameters-when-creating-custom-index/240690)

<div class="topic-metadata">

**Author:** [@vinci](https://discuss.elastic.co/u/vinci)\
**Replies:** 1\
**Last updated:** [July 10, 2020, 12:09pm UTC](https://discuss.elastic.co/t/root-mapping-definition-has-unsupported-parameters-when-creating-custom-index/240690 "2020-07-10T12:09:02Z")

</div>

Hello, I'm following an elasticsearch course on linux academy where the instruction creates a custom index in the dev tools of kibana. He's using version 6, but I'm using version 7, so I'm not sure if the problem is re…

---

## [Unable to connect to AWS Elastic-Search Instance through AWS Spark EMR](https://discuss.elastic.co/t/unable-to-connect-to-aws-elastic-search-instance-through-aws-spark-emr/240483)

<div class="topic-metadata">

**Author:** [@dillibabu.mekala](https://discuss.elastic.co/u/dillibabu.mekala)\
**Replies:** 3\
**Last updated:** [July 10, 2020, 12:00pm UTC](https://discuss.elastic.co/t/unable-to-connect-to-aws-elastic-search-instance-through-aws-spark-emr/240483 "2020-07-10T12:00:01Z")

</div>

Hi Team, We have requirement where, we need to load the parquet file from S3 bucket and ingest this data in to the AWS Elastic-Search using Spark (Scala) Job. To Achieve this i have tried in my local system by installi…

---

## [Simultaneously executing multiple queries on Scroll API to fetch Large Data](https://discuss.elastic.co/t/simultaneously-executing-multiple-queries-on-scroll-api-to-fetch-large-data/240649)

<div class="topic-metadata">

**Author:** [@N220](https://discuss.elastic.co/u/N220)\
**Replies:** 16\
**Last updated:** [July 10, 2020, 12:01pm UTC](https://discuss.elastic.co/t/simultaneously-executing-multiple-queries-on-scroll-api-to-fetch-large-data/240649 "2020-07-10T12:01:01Z")

</div>

How to fetch large data in parallel from elastic search? Using Scroll API I am able to fetch complete data from elasticsearch. But it is too slow. Takes around 40 seconds to fetch 500000 records. I am trying to use mul…

---

## [Filebeat Reverse DNS](https://discuss.elastic.co/t/filebeat-reverse-dns/240552)

<div class="topic-metadata">

**Author:** [@francescouk](https://discuss.elastic.co/u/francescouk)\
**Replies:** 2\
**Last updated:** [July 10, 2020, 11:40am UTC](https://discuss.elastic.co/t/filebeat-reverse-dns/240552 "2020-07-10T11:40:40Z")

</div>

Hi there, Can anyone tell what I´m doing wrong with this configuration? processors: - dns: type: reverse action: replace fields: source.ip: source.ip destination.ip: destination.ip Keep receivi…

---

## [Can I apply filtering in specific buckets and not in the whole visualization in Kibana?](https://discuss.elastic.co/t/can-i-apply-filtering-in-specific-buckets-and-not-in-the-whole-visualization-in-kibana/240201)

<div class="topic-metadata">

**Author:** [@sfenman](https://discuss.elastic.co/u/sfenman)\
**Replies:** 1\
**Last updated:** [July 10, 2020, 11:16am UTC](https://discuss.elastic.co/t/can-i-apply-filtering-in-specific-buckets-and-not-in-the-whole-visualization-in-kibana/240201 "2020-07-10T11:16:33Z")

</div>

I have some documents with the fields client.ip and http.response.status.code among other fields. I have also some documents with the fields client.ip and company.name. What I want to is to create a visualization with a…

---

## [How can we get records from elasticsearch with wildcard queries having two keywords?](https://discuss.elastic.co/t/how-can-we-get-records-from-elasticsearch-with-wildcard-queries-having-two-keywords/240641)

<div class="topic-metadata">

**Author:** [@navdeepk](https://discuss.elastic.co/u/navdeepk)\
**Replies:** 2\
**Last updated:** [July 10, 2020, 11:14am UTC](https://discuss.elastic.co/t/how-can-we-get-records-from-elasticsearch-with-wildcard-queries-having-two-keywords/240641 "2020-07-10T11:14:25Z")

</div>

using this { "query": { "bool": { "must": \[ { "wildcard": { "url.original":{ "value" : "\*version?" } } } \], "must\_not": , "should": } } …

---

## [Using kibana's datetime picker value with script field type is available](https://discuss.elastic.co/t/using-kibanas-datetime-picker-value-with-script-field-type-is-available/240451)

<div class="topic-metadata">

**Author:** [@Young\_Kim](https://discuss.elastic.co/u/Young_Kim)\
**Replies:** 1\
**Last updated:** [July 10, 2020, 11:10am UTC](https://discuss.elastic.co/t/using-kibanas-datetime-picker-value-with-script-field-type-is-available/240451 "2020-07-10T11:10:46Z")

</div>

we are by using elk stack , using datetime-picker value from kibana date range is available with the script field type ? It was not available your last version (https://discuss.elastic.co/t/use-timepicker-value-for-…

---

## [Syntax error while starting Kibana 7.8.0](https://discuss.elastic.co/t/syntax-error-while-starting-kibana-7-8-0/240473)

<div class="topic-metadata">

**Author:** [@vishal5364](https://discuss.elastic.co/u/vishal5364)\
**Replies:** 1\
**Last updated:** [July 10, 2020, 11:09am UTC](https://discuss.elastic.co/t/syntax-error-while-starting-kibana-7-8-0/240473 "2020-07-10T11:09:54Z")

</div>

I have downloaded and copied the kibana-7.8.0-linux-x86\_64 to my Solaris server but on starting the service I am getting the below error ./kibana: syntax error at line 6: \`ls=$' unexpected Please let me know how to res…

---

## [How to set kibana auto start when system reboot](https://discuss.elastic.co/t/how-to-set-kibana-auto-start-when-system-reboot/240502)

<div class="topic-metadata">

**Author:** [@Jyotheeswar\_P](https://discuss.elastic.co/u/Jyotheeswar_P)\
**Replies:** 1\
**Last updated:** [July 10, 2020, 11:06am UTC](https://discuss.elastic.co/t/how-to-set-kibana-auto-start-when-system-reboot/240502 "2020-07-10T11:06:40Z")

</div>

Hi, How to set kibana auto start when system reboot. we have installed .tar file and i am getting below message. I am using version 7.3 sudo /bin/systemctl enable elasticsearch.service Failed to execute operation: N…

---

## [PDF export not enabled in Kibana v.7.7](https://discuss.elastic.co/t/pdf-export-not-enabled-in-kibana-v-7-7/240494)

<div class="topic-metadata">

**Author:** [@rschirin](https://discuss.elastic.co/u/rschirin)\
**Replies:** 1\
**Last updated:** [July 10, 2020, 11:02am UTC](https://discuss.elastic.co/t/pdf-export-not-enabled-in-kibana-v-7-7/240494 "2020-07-10T11:02:51Z")

</div>

Hi everybody, I read docs about PDF export but I'm not able to make it work. I am using full-stack v7.7.1 and native realm. I tried to save a test dashboard but I cannot create PDF report since I cannot see that featu…

---

## [Update Mapping after changing parser](https://discuss.elastic.co/t/update-mapping-after-changing-parser/240675)

<div class="topic-metadata">

**Author:** [@shubhamblackstratus](https://discuss.elastic.co/u/shubhamblackstratus)\
**Replies:** 3\
**Last updated:** [July 10, 2020, 10:50am UTC](https://discuss.elastic.co/t/update-mapping-after-changing-parser/240675 "2020-07-10T10:50:07Z")

</div>

Hi Guys, I am using custom app parser to get all error logs from my application to Elasticsearch. Due to great number of fields my elasticsearch index burst out with more than 4000 fields. Due to this, kibana also thro…

---

## [How to save elasticsearch date type in spring data?](https://discuss.elastic.co/t/how-to-save-elasticsearch-date-type-in-spring-data/240249)

<div class="topic-metadata">

**Author:** [@kase](https://discuss.elastic.co/u/kase)\
**Replies:** 4\
**Last updated:** [July 10, 2020, 10:30am UTC](https://discuss.elastic.co/t/how-to-save-elasticsearch-date-type-in-spring-data/240249 "2020-07-10T10:30:54Z")

</div>

Hi there, I want to use spring data to get elasticsearch documents, but encountered some problems with get data. Here is my code. Entity: @Id private String id; @Field(name = "@timestamp", type = FieldTy…

---

## [Are there any performance impact of using source filtering in elasticsearch or spring data elasticsearch?](https://discuss.elastic.co/t/are-there-any-performance-impact-of-using-source-filtering-in-elasticsearch-or-spring-data-elasticsearch/240671)

<div class="topic-metadata">

**Author:** [@mohsin](https://discuss.elastic.co/u/mohsin)\
**Replies:** 0\
**Last updated:** [July 10, 2020, 9:55am UTC](https://discuss.elastic.co/t/are-there-any-performance-impact-of-using-source-filtering-in-elasticsearch-or-spring-data-elasticsearch/240671 "2020-07-10T09:55:25Z")

</div>

We have documents in the range 50k-100k. We are using the ElasticsearchOperations interface of spring-data-elasticsearch and using NativeSearchQueryBuilder()s withSourceFilter(new FetchSourceFilter(includeFields, exclude…

---

## [Question About ELK stack](https://discuss.elastic.co/t/question-about-elk-stack/239771)

<div class="topic-metadata">

**Author:** [@vic22](https://discuss.elastic.co/u/vic22)\
**Replies:** 3\
**Last updated:** [July 10, 2020, 9:39am UTC](https://discuss.elastic.co/t/question-about-elk-stack/239771 "2020-07-10T09:39:55Z")

</div>

Hello Everybody ! I would like to know the difference between the X-PACK offered by Elastic Stack (with extra charges) and the application SIEM that can be installed in Kibana ?

[Previous page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1937)

[Next page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1939)
