# Elastic Stack **URL:** https://discuss.elastic.co/c/elastic-stack/81.md?page=1821 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1822 --- ## [Elasticsearch Index shards per nodes](https://discuss.elastic.co/t/elasticsearch-index-shards-per-nodes/247445)
**Author:** [@Sergio\_Bortsov](https://discuss.elastic.co/u/Sergio_Bortsov)\ **Replies:** 12\ **Last updated:** [September 7, 2020, 12:44pm UTC](https://discuss.elastic.co/t/elasticsearch-index-shards-per-nodes/247445 "2020-09-07T12:44:32Z")
Hi! I have the cluster with 3 masters and 10 data nodes. Settings per index include 5 shards and 2 replicas. From what I see the data nodes are loaded unevenly. I can see that shards for the same nodes are not located o… --- ## [Conditional update to the document](https://discuss.elastic.co/t/conditional-update-to-the-document/64964)
**Author:** [@animageofmine](https://discuss.elastic.co/u/animageofmine)\ **Replies:** 22\ **Last updated:** [September 7, 2020, 11:56am UTC](https://discuss.elastic.co/t/conditional-update-to-the-document/64964 "2020-09-07T11:56:25Z")
Hello, If I wanted to update an existing document completely (not partially), if it satisfies the condition. See an example below: Index: Twitter Type: tweet Add tweet and lastupdated fields to document 1 as below.… --- ## [Jdbc input plugin](https://discuss.elastic.co/t/jdbc-input-plugin/247757)
**Author:** [@Milan\_Suthar](https://discuss.elastic.co/u/Milan_Suthar)\ **Replies:** 0\ **Last updated:** [September 7, 2020, 10:21am UTC](https://discuss.elastic.co/t/jdbc-input-plugin/247757 "2020-09-07T10:21:57Z")
hello, i want mongodb as input to ES index as output i have used logstash jdbc input plugin but its not working it shows "no-suitable-driver-found-for-jdbcmongo " i have tried many examples but didt work for me , i'v… --- ## [Logstash JDBC Input not working, no error or output](https://discuss.elastic.co/t/logstash-jdbc-input-not-working-no-error-or-output/247154)
**Author:** [@netscape](https://discuss.elastic.co/u/netscape)\ **Replies:** 5\ **Last updated:** [September 7, 2020, 10:19am UTC](https://discuss.elastic.co/t/logstash-jdbc-input-not-working-no-error-or-output/247154 "2020-09-07T10:19:57Z")
Hi, I have some problem with JDBC input plugin. Database connection seem to work (no error), but I don´t get any output. In the Logstash logfile I only get the SQL Statement, but no error or output. The logstash log: … --- ## [Logstash not updating last run metadata file](https://discuss.elastic.co/t/logstash-not-updating-last-run-metadata-file/247730)
**Author:** [@RiadhBH](https://discuss.elastic.co/u/RiadhBH)\ **Replies:** 0\ **Last updated:** [September 7, 2020, 8:42am UTC](https://discuss.elastic.co/t/logstash-not-updating-last-run-metadata-file/247730 "2020-09-07T08:42:55Z")
In my Logstash I want to download from a huge database table. To avoid overload, I tried to get data of each day separately (since 20 years) and copied it to elasticsearch. I used :sql\_last\_value as follow, but it does n… --- ## [Tags:\_grokparsefailure](https://discuss.elastic.co/t/tags-grokparsefailure/247754)
**Author:** [@Bashir\_Mihyar](https://discuss.elastic.co/u/Bashir_Mihyar)\ **Replies:** 0\ **Last updated:** [September 7, 2020, 10:07am UTC](https://discuss.elastic.co/t/tags-grokparsefailure/247754 "2020-09-07T10:07:30Z")
Hello, I am new to this stack, and i am looking for an answer for the below: When i am in kibana discover tab, i see records with tags: \_grokparsefailure, while i expect to see host: logs.myserver.me Details: my ng… --- ## [Bucket Script Aggregation - Filter Ratio with STDEV](https://discuss.elastic.co/t/bucket-script-aggregation-filter-ratio-with-stdev/247746)
**Author:** [@shiko](https://discuss.elastic.co/u/shiko)\ **Replies:** 0\ **Last updated:** [September 7, 2020, 9:44am UTC](https://discuss.elastic.co/t/bucket-script-aggregation-filter-ratio-with-stdev/247746 "2020-09-07T09:44:39Z")
Hello, I'm kind of new to ES. I'm searching for the possibilities to do some high level aggregation with ES. I want to know if I could do this on ES : AVG ( Bucket X ) - AVG ( Bucket Y) … --- ## [Bucket Script Aggregation - parsing\_exception](https://discuss.elastic.co/t/bucket-script-aggregation-parsing-exception/246421)
**Author:** [@shiko](https://discuss.elastic.co/u/shiko)\ **Replies:** 3\ **Last updated:** [September 7, 2020, 9:32am UTC](https://discuss.elastic.co/t/bucket-script-aggregation-parsing-exception/246421 "2020-09-07T09:32:02Z")
I'm kind of a new user for ES and Kibana. I have a question about the Bucket Script Aggregation I'm trying to do some calculations with ES, the division of 2 queries ( the ratio). when I send the queries , it's worki… --- ## [Kibana\_stats not collected when disabling telemetry](https://discuss.elastic.co/t/kibana-stats-not-collected-when-disabling-telemetry/247582)
**Author:** [@Harm](https://discuss.elastic.co/u/Harm)\ **Replies:** 3\ **Last updated:** [September 7, 2020, 9:31am UTC](https://discuss.elastic.co/t/kibana-stats-not-collected-when-disabling-telemetry/247582 "2020-09-07T09:31:53Z")
Hi, Today I noticed something strange in the data collection from Kibana. I'm currently using version 7.8.1 and have monitoring and collection enabled via: monitoring.enabled: true monitoring.kibana.collection.enabled:… --- ## [Trying to understand \`max\_clause\_count\`](https://discuss.elastic.co/t/trying-to-understand-max-clause-count/247742)
**Author:** [@mekanix](https://discuss.elastic.co/u/mekanix)\ **Replies:** 0\ **Last updated:** [September 7, 2020, 9:30am UTC](https://discuss.elastic.co/t/trying-to-understand-max-clause-count/247742 "2020-09-07T09:30:00Z")
We are getting hit by occasional "too\_many\_clauses" and I believe the issue is caused by our extensive use of synonyms expansions, where some words are expanded into quite a few others. But I don't quite understand the … --- ## [How to recieve response header in logstash 7.4?](https://discuss.elastic.co/t/how-to-recieve-response-header-in-logstash-7-4/247741)
**Author:** [@talbehat](https://discuss.elastic.co/u/talbehat)\ **Replies:** 0\ **Last updated:** [September 7, 2020, 9:25am UTC](https://discuss.elastic.co/t/how-to-recieve-response-header-in-logstash-7-4/247741 "2020-09-07T09:25:52Z")
i am sending key and value in request header at making connection from elasticsearch, but i am not getting respoanse header which was added in elasticsearch. how to get response header please let me know. --- ## [IO / Disc intensive load testing](https://discuss.elastic.co/t/io-disc-intensive-load-testing/247722)
**Author:** [@Oleg\_Ruchovets](https://discuss.elastic.co/u/Oleg_Ruchovets)\ **Replies:** 6\ **Last updated:** [September 7, 2020, 9:17am UTC](https://discuss.elastic.co/t/io-disc-intensive-load-testing/247722 "2020-09-07T09:17:29Z")
Hello, My task is to make an elastic search disk/io "hard life" :-). To not reinventing the wheel - is there a tool for simulation high disk load on elastic? what type of query is the most disk/io intensive? I saw ma… --- ## [Logstash jdbc-input taking long time to load data from Oracle DataBase](https://discuss.elastic.co/t/logstash-jdbc-input-taking-long-time-to-load-data-from-oracle-database/246646)
**Author:** [@amitgupta](https://discuss.elastic.co/u/amitgupta)\ **Replies:** 21\ **Last updated:** [September 7, 2020, 8:55am UTC](https://discuss.elastic.co/t/logstash-jdbc-input-taking-long-time-to-load-data-from-oracle-database/246646 "2020-09-07T08:55:37Z")
I am using ELK stack. I have to load Oracle data to ElasticSearch. There are around 5 million data to load at initial. Problem: The logstash is very very slow to load data, it loads around 50k in 30 mins. this speed is … --- ## [Are there limits on no. of documents ingested per request through curl?](https://discuss.elastic.co/t/are-there-limits-on-no-of-documents-ingested-per-request-through-curl/247713)
**Author:** [@rvenkat123](https://discuss.elastic.co/u/rvenkat123)\ **Replies:** 2\ **Last updated:** [September 7, 2020, 8:50am UTC](https://discuss.elastic.co/t/are-there-limits-on-no-of-documents-ingested-per-request-through-curl/247713 "2020-09-07T08:50:07Z")
I have 6374 json documents that I would like to ingest. I used the curl command as follows: curl -H 'Content-Type: application/x-ndjson' -XPOST 'localhost:9200/projects/\_bulk?pretty' --data-binary @projects.json I f… --- ## [Can not create Machine learning job in Kibana](https://discuss.elastic.co/t/can-not-create-machine-learning-job-in-kibana/247622)
**Author:** [@le\_ba\_nam](https://discuss.elastic.co/u/le_ba_nam)\ **Replies:** 1\ **Last updated:** [September 7, 2020, 8:46am UTC](https://discuss.elastic.co/t/can-not-create-machine-learning-job-in-kibana/247622 "2020-09-07T08:46:35Z")
I tried to create machine learning job in Kibana, but I got an error when start datafeed, so I can start any job. What is problem? I met this error in both two disperate server. I wonder whether I miss something which s… --- ## [How to Integerate the kibana in laravel application](https://discuss.elastic.co/t/how-to-integerate-the-kibana-in-laravel-application/247655)
**Author:** [@gaurav\_sharma1](https://discuss.elastic.co/u/gaurav_sharma1)\ **Replies:** 1\ **Last updated:** [September 7, 2020, 8:45am UTC](https://discuss.elastic.co/t/how-to-integerate-the-kibana-in-laravel-application/247655 "2020-09-07T08:45:37Z")
I have a doubt i want to integrate the kibana onto my web application i don't know how it can do that basically i want to pass data to kibana and in the result i want to report for that perticular data and the report is … --- ## [Minimum Privilege Required for Logstash Account](https://discuss.elastic.co/t/minimum-privilege-required-for-logstash-account/247731)
**Author:** [@hpicass0](https://discuss.elastic.co/u/hpicass0)\ **Replies:** 0\ **Last updated:** [September 7, 2020, 8:42am UTC](https://discuss.elastic.co/t/minimum-privilege-required-for-logstash-account/247731 "2020-09-07T08:42:58Z")
Hi, Given than I need to set the API key or username/password pair in Logstash config (and they might get exposed). I need to set the privilege to the absolute minimum for the relevant account I've went over the roles … --- ## [Sum aggregation in kibana data table visualization for "other" bucket is always 0](https://discuss.elastic.co/t/sum-aggregation-in-kibana-data-table-visualization-for-other-bucket-is-always-0/241430)
**Author:** [@webstruck](https://discuss.elastic.co/u/webstruck)\ **Replies:** 6\ **Last updated:** [September 7, 2020, 8:38am UTC](https://discuss.elastic.co/t/sum-aggregation-in-kibana-data-table-visualization-for-other-bucket-is-always-0/241430 "2020-09-07T08:38:22Z")
I'm trying to create a data table visualization in ELK 7.8. I have a Terms aggregation with size 5 and checked "Group other values in separate bucket". So it shows Other bucket as row in the table with Count metric. I al… --- ## [Can we replace No data found message with in-progress while pushing data into elasticsearch](https://discuss.elastic.co/t/can-we-replace-no-data-found-message-with-in-progress-while-pushing-data-into-elasticsearch/247235)
**Author:** [@singhmac](https://discuss.elastic.co/u/singhmac)\ **Replies:** 4\ **Last updated:** [September 7, 2020, 8:36am UTC](https://discuss.elastic.co/t/can-we-replace-no-data-found-message-with-in-progress-while-pushing-data-into-elasticsearch/247235 "2020-09-07T08:36:13Z")
Hi, Can we change the "no data found" or "no data result" to "some\_other\_message" I am pushing data into elasticsearch via script. As script takes some time to finish, in that period if we refresh graph it shows messag… --- ## [How to Compare Data from 2 indices in same visualization?](https://discuss.elastic.co/t/how-to-compare-data-from-2-indices-in-same-visualization/247665)
**Author:** [@vishesh1](https://discuss.elastic.co/u/vishesh1)\ **Replies:** 3\ **Last updated:** [September 7, 2020, 8:27am UTC](https://discuss.elastic.co/t/how-to-compare-data-from-2-indices-in-same-visualization/247665 "2020-09-07T08:27:46Z")
Hi, I am new to elastic stack, so please excuse the incorrect terminologies if any. I am indexing some data from a csv file to elasticsearch using one index "build1", which contains some performance data for my softwar… --- ## [Kibana Geo Maps using Array of Lat Lon in index](https://discuss.elastic.co/t/kibana-geo-maps-using-array-of-lat-lon-in-index/247218)
**Author:** [@Kaushal\_Kishore](https://discuss.elastic.co/u/Kaushal_Kishore)\ **Replies:** 6\ **Last updated:** [September 7, 2020, 8:25am UTC](https://discuss.elastic.co/t/kibana-geo-maps-using-array-of-lat-lon-in-index/247218 "2020-09-07T08:25:14Z")
Hello Team, I mapped es index geo point with array in lat and lon as below I am not able to plot Maps using this "location". Can you help me where i am missing. Thanks in Advance !! --- ## [Extract CPU user pct along with its time using Query DSL](https://discuss.elastic.co/t/extract-cpu-user-pct-along-with-its-time-using-query-dsl/247727)
**Author:** [@shiv97](https://discuss.elastic.co/u/shiv97)\ **Replies:** 0\ **Last updated:** [September 7, 2020, 8:09am UTC](https://discuss.elastic.co/t/extract-cpu-user-pct-along-with-its-time-using-query-dsl/247727 "2020-09-07T08:09:06Z")
Hi Every one I am having metricbeat data I need to extract system.cpu.user.pct along with time using query DSL. I have checked and got how to extract the CPU user pct but now I want the time for each CPU user pct value… --- ## [ElasticSearch Sink with Structured Streaming](https://discuss.elastic.co/t/elasticsearch-sink-with-structured-streaming/247723)
**Author:** [@jainshasha](https://discuss.elastic.co/u/jainshasha)\ **Replies:** 0\ **Last updated:** [September 7, 2020, 7:50am UTC](https://discuss.elastic.co/t/elasticsearch-sink-with-structured-streaming/247723 "2020-09-07T07:50:59Z")
Hi, I am using this MR https://github.com/elastic/elasticsearch-hadoop/pull/1498 for ElasticSearch sink with Structured Streaming but in that i am having issue in seeing some metrics like "numOutputRows" which always sh… --- ## [Error : port 5601 is already in use.Another instance of kibana may be running](https://discuss.elastic.co/t/error-port-5601-is-already-in-use-another-instance-of-kibana-may-be-running/247001)
**Author:** [@Rahul0711](https://discuss.elastic.co/u/Rahul0711)\ **Replies:** 7\ **Last updated:** [September 7, 2020, 7:52am UTC](https://discuss.elastic.co/t/error-port-5601-is-already-in-use-another-instance-of-kibana-may-be-running/247001 "2020-09-07T07:52:18Z")
Hello Team I have installed the Kibana on the Win 10. while running the Kibana it gives the below error FATAL Error : port 5601 is already in use.Another instance of Kibana may be running. I tried checking if this po… --- ## [How to check what all objects are created in Elasticsearch](https://discuss.elastic.co/t/how-to-check-what-all-objects-are-created-in-elasticsearch/247719)
**Author:** [@tusharnemade](https://discuss.elastic.co/u/tusharnemade)\ **Replies:** 3\ **Last updated:** [September 7, 2020, 7:39am UTC](https://discuss.elastic.co/t/how-to-check-what-all-objects-are-created-in-elasticsearch/247719 "2020-09-07T07:39:53Z")
Hi I am new joinee in one of the project which uses Elasticsearch cluster. Could you please help me to find out the way via which i could find and say what all objects are created in Elasticsearch Cluster. These objec… --- ## [Exception while openig kibana filebeat dashboard](https://discuss.elastic.co/t/exception-while-openig-kibana-filebeat-dashboard/247630)
**Author:** [@shikran](https://discuss.elastic.co/u/shikran)\ **Replies:** 5\ **Last updated:** [September 7, 2020, 7:06am UTC](https://discuss.elastic.co/t/exception-while-openig-kibana-filebeat-dashboard/247630 "2020-09-07T07:06:24Z")
i and newbie to Elasticsearh and have configured elasticsearch + kibana on a windows server and it was perfectly working fine for last few days. Today when i tried to open kibana dashboard for winlogbeat and filebeat, … --- ## [How to fully utilize the resources of Elasticsearch node](https://discuss.elastic.co/t/how-to-fully-utilize-the-resources-of-elasticsearch-node/247652)
**Author:** [@iammanmale](https://discuss.elastic.co/u/iammanmale)\ **Replies:** 3\ **Last updated:** [September 7, 2020, 6:45am UTC](https://discuss.elastic.co/t/how-to-fully-utilize-the-resources-of-elasticsearch-node/247652 "2020-09-07T06:45:32Z")
I have 5 nodes in my ELK cluster. I want to boost the indexing speed. I find out most of the nodes cpu $idle from command iostat are more than 50%, some of them are even more than 80% which mean the cpu are not fully ut… --- ## [Logstash - not able to insert date in this format 'YYYY-MM-DD hh:mm:ss'](https://discuss.elastic.co/t/logstash-not-able-to-insert-date-in-this-format-yyyy-mm-dd-hhss/247405)
**Author:** [@SwatiD](https://discuss.elastic.co/u/SwatiD)\ **Replies:** 8\ **Last updated:** [September 7, 2020, 6:37am UTC](https://discuss.elastic.co/t/logstash-not-able-to-insert-date-in-this-format-yyyy-mm-dd-hhss/247405 "2020-09-07T06:37:10Z")
My date format is YYYY-MM-DD hh:mm:ss but logstash is changing this to something like 2020-09-03T05:03:00.000Z . I have use this filter in logstash config file filter { date { match =\> \[ "endDate", "YYYY-MM-DD hh:mm:… --- ## [Elasticsearch update by query](https://discuss.elastic.co/t/elasticsearch-update-by-query/247709)
**Author:** [@Mohammad\_Mousavi](https://discuss.elastic.co/u/Mohammad_Mousavi)\ **Replies:** 0\ **Last updated:** [September 7, 2020, 6:23am UTC](https://discuss.elastic.co/t/elasticsearch-update-by-query/247709 "2020-09-07T06:23:43Z")
Hi, This is my code: POST /logstash-myapp-\*/\_update\_by\_query { "query": { "term" : { "tags.keyword" : "myapp-stream" }, "bool": { "filter": \[ { "match": { "response": "200" … --- ## [Source Filtering does not return empty Array if no nested properties are found](https://discuss.elastic.co/t/source-filtering-does-not-return-empty-array-if-no-nested-properties-are-found/247707)
**Author:** [@Somdev\_Mehta](https://discuss.elastic.co/u/Somdev_Mehta)\ **Replies:** 0\ **Last updated:** [September 7, 2020, 6:07am UTC](https://discuss.elastic.co/t/source-filtering-does-not-return-empty-array-if-no-nested-properties-are-found/247707 "2020-09-07T06:07:18Z")
Hi All, I am a user of Elasticsearch version 1.7 and i realize that its high time to upgrade :stuck\_out\_tongue: (better late than never :smile: ). However, Elasticsearch 5.X on-wards i noticed a breaking change which i… [Previous page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1820) [Next page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1822)