# Elasticsearch **URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1558 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1559 --- ## [ELK-Stack Requirements](https://discuss.elastic.co/t/elk-stack-requirements/147427)
**Author:** [@atom](https://discuss.elastic.co/u/atom)\ **Replies:** 0\ **Last updated:** [September 5, 2018, 2:45pm UTC](https://discuss.elastic.co/t/elk-stack-requirements/147427 "2018-09-05T14:45:01Z")
Hi, i am running a single elasticsearch host with nearly 1 billion documents (apache logs) in it :slight\_smile: All documents are stored in different indices that are rotated daily: a\_log-YEAR.MONTH.DAY I do close all… --- ## [Shards failed message in Kibana - (5 of 28 Shards failed)](https://discuss.elastic.co/t/shards-failed-message-in-kibana-5-of-28-shards-failed/147279)
**Author:** [@sachinvy](https://discuss.elastic.co/u/sachinvy)\ **Replies:** 1\ **Last updated:** [September 5, 2018, 2:13pm UTC](https://discuss.elastic.co/t/shards-failed-message-in-kibana-5-of-28-shards-failed/147279 "2018-09-05T14:13:38Z")
Can someone please provide me more details and guidance about how I deal with this issue? We have dedicated ES cluster with following Nodes: 11 Indices: 57 Memory: 37.9 GB / 118.7 GB Total Shards: 319 Unassigne… --- ## [Logstash upsert not working](https://discuss.elastic.co/t/logstash-upsert-not-working/147423)
**Author:** [@salcan](https://discuss.elastic.co/u/salcan)\ **Replies:** 0\ **Last updated:** [September 5, 2018, 2:11pm UTC](https://discuss.elastic.co/t/logstash-upsert-not-working/147423 "2018-09-05T14:11:58Z")
Hy all, I've some problem with the upsert . Example: if I have two index like logstash-2018.06.20 logstash-2018.06.21 and I use in Logstash's output section: action =\> "update" doc\_as\_upsert =\> "t… --- ## [Activate/Deactivate Watchers through Jenikins](https://discuss.elastic.co/t/activate-deactivate-watchers-through-jenikins/146531)
**Author:** [@TheCodingKnight](https://discuss.elastic.co/u/TheCodingKnight)\ **Replies:** 4\ **Last updated:** [September 5, 2018, 1:32pm UTC](https://discuss.elastic.co/t/activate-deactivate-watchers-through-jenikins/146531 "2018-09-05T13:32:54Z")
I have a number of watchers configured in Elastic which I would like to activate/deactivate in one go. I'm planning to create a Jenkins job and use the below APIs. PUT \_xpack/watcher/watch/watcherid/\_deactivate PUT \_xp… --- ## [Elastic CAT pipeline API](https://discuss.elastic.co/t/elastic-cat-pipeline-api/147413)
**Author:** [@willemdh](https://discuss.elastic.co/u/willemdh)\ **Replies:** 0\ **Last updated:** [September 5, 2018, 1:17pm UTC](https://discuss.elastic.co/t/elastic-cat-pipeline-api/147413 "2018-09-05T13:17:11Z")
There seems to be no way to simply cat or list all the pipelines? GET \_ingest/pipeline/\* lists all the pipelines, but also shows the complete pipeline configuration. Or am I missing something? GET \_cat/pipelines?v&pr… --- ## [Spark with elasticsearch](https://discuss.elastic.co/t/spark-with-elasticsearch/147400)
**Author:** [@cool\_arun](https://discuss.elastic.co/u/cool_arun)\ **Replies:** 1\ **Last updated:** [September 5, 2018, 12:23pm UTC](https://discuss.elastic.co/t/spark-with-elasticsearch/147400 "2018-09-05T12:23:47Z")
What is the best way to integrate elasticsearch with spark? --- ## [Felix maven-bundle-plugin ServiceConfigurationError Completion50PostingsFormat does not exist](https://discuss.elastic.co/t/felix-maven-bundle-plugin-serviceconfigurationerror-completion50postingsformat-does-not-exist/147385)
**Author:** [@abhiroyg](https://discuss.elastic.co/u/abhiroyg)\ **Replies:** 0\ **Last updated:** [September 5, 2018, 11:22am UTC](https://discuss.elastic.co/t/felix-maven-bundle-plugin-serviceconfigurationerror-completion50postingsformat-does-not-exist/147385 "2018-09-05T11:22:44Z")
Hi, I am facing the following exception with the following pom.xml, with commented portion in maven-bundle-plugin (with or without lucene dependency) \ \org.elasticsearch\ \ **Author:** [@gmarziou](https://discuss.elastic.co/u/gmarziou)\ **Replies:** 2\ **Last updated:** [September 5, 2018, 11:50am UTC](https://discuss.elastic.co/t/curator-cant-shrink-on-single-node-due-to-cluster-health-yellow/147358 "2018-09-05T11:50:39Z") Hello, I try to shrink an index with Curator on a single node cluster but it fails due to cluster health being yellow which is expected when you have only one node. Exception: Unable to proceed with shrink action. Clu… --- ## [How to control content of accounting requests circuit breaker](https://discuss.elastic.co/t/how-to-control-content-of-accounting-requests-circuit-breaker/147359)
**Author:** [@DmitriV](https://discuss.elastic.co/u/DmitriV)\ **Replies:** 6\ **Last updated:** [September 5, 2018, 11:38am UTC](https://discuss.elastic.co/t/how-to-control-content-of-accounting-requests-circuit-breaker/147359 "2018-09-05T11:38:45Z")
Hi, I am running into issues with circuit breakers during indexing-heavy operations: it seems the accounting circuit breaker is filling up and not getting cleaned quickly enough. \[2018-09-04T12:19:05,954\]\[WARN \]\[r.supp… --- ## [Elasticsearch cluster Maintenance and Email Notifications](https://discuss.elastic.co/t/elasticsearch-cluster-maintenance-and-email-notifications/147378)
**Author:** [@bronzik](https://discuss.elastic.co/u/bronzik)\ **Replies:** 1\ **Last updated:** [September 5, 2018, 11:37am UTC](https://discuss.elastic.co/t/elasticsearch-cluster-maintenance-and-email-notifications/147378 "2018-09-05T11:37:09Z")
Hi fellows There is an article https://www.elastic.co/blog/how-many-shards-should-i-have-in-my-elasticsearch-cluster which recommends on the questions: “How many shards should I have?” and “How large should my shards be… --- ## [Elasticsearch upsert is happening at slow rate](https://discuss.elastic.co/t/elasticsearch-upsert-is-happening-at-slow-rate/147351)
**Author:** [@aditya7](https://discuss.elastic.co/u/aditya7)\ **Replies:** 5\ **Last updated:** [September 5, 2018, 11:30am UTC](https://discuss.elastic.co/t/elasticsearch-upsert-is-happening-at-slow-rate/147351 "2018-09-05T11:30:17Z")
I am doing upsert to elasticsearch-5.0.2 in bulk having batch size of 5000. When I start this upsert, ES response time is normal. But after few seconds, ES response time increases 20-30times. Logs for this: Processing … --- ## [Elastic search 6.4.0 test case execution failed - Could not dispatch a message to the daemon](https://discuss.elastic.co/t/elastic-search-6-4-0-test-case-execution-failed-could-not-dispatch-a-message-to-the-daemon/146615)
**Author:** [@chakravarthy\_G](https://discuss.elastic.co/u/chakravarthy_G)\ **Replies:** 0\ **Last updated:** [August 30, 2018, 4:42am UTC](https://discuss.elastic.co/t/elastic-search-6-4-0-test-case-execution-failed-could-not-dispatch-a-message-to-the-daemon/146615 "2018-08-30T04:42:53Z")
Elasticsearch version ( bin/elasticsearch --version ): v6.4.0 JVM version ( java -version ): openjdk version "10.0.2-adoptopenjdk" OS version ( uname -a if on a Unix-like system): Linux ubuntu 4.4.0-21-generic #37-… --- ## [Copying index from ES 1.1 to ES 6.2.x](https://discuss.elastic.co/t/copying-index-from-es-1-1-to-es-6-2-x/147364)
**Author:** [@rkparkar](https://discuss.elastic.co/u/rkparkar)\ **Replies:** 2\ **Last updated:** [September 5, 2018, 10:46am UTC](https://discuss.elastic.co/t/copying-index-from-es-1-1-to-es-6-2-x/147364 "2018-09-05T10:46:11Z")
I wanted to copy data from ES 1.1 to ES 6.2 . In order to work on ES 6.2. was wondering what is the best way to bring in the data into ES 6.2 from ES 1.1 ? suggestions please. --- ## [Using ES to index a local instance of dynamoDb on Windows](https://discuss.elastic.co/t/using-es-to-index-a-local-instance-of-dynamodb-on-windows/147069)
**Author:** [@kalimist123](https://discuss.elastic.co/u/kalimist123)\ **Replies:** 2\ **Last updated:** [September 5, 2018, 10:14am UTC](https://discuss.elastic.co/t/using-es-to-index-a-local-instance-of-dynamodb-on-windows/147069 "2018-09-05T10:14:46Z")
Folks, I want to get familiar with the full-text indexing abilities of ES against dynamoDB using a local dynamoDb instance. Is it possible to point ES at a local dynamoDB instance in this way? --- ## [Search Guard with Elastic Search](https://discuss.elastic.co/t/search-guard-with-elastic-search/147356)
**Author:** [@raghuramfoss](https://discuss.elastic.co/u/raghuramfoss)\ **Replies:** 0\ **Last updated:** [September 5, 2018, 9:36am UTC](https://discuss.elastic.co/t/search-guard-with-elastic-search/147356 "2018-09-05T09:36:13Z")
Could you help us on the below scenario? We have configured Elastic Search/Kibana 6.2.4 and enabled Search Guard with our own TLS, the whole setup works as is however, while using a C# code to POST we got an error with … --- ## [Elastic\[5.x\] Is it possible to validate the query having filters on meta data](https://discuss.elastic.co/t/elastic-5-x-is-it-possible-to-validate-the-query-having-filters-on-meta-data/147337)
**Author:** [@Vinay\_Kumar](https://discuss.elastic.co/u/Vinay_Kumar)\ **Replies:** 0\ **Last updated:** [September 5, 2018, 8:23am UTC](https://discuss.elastic.co/t/elastic-5-x-is-it-possible-to-validate-the-query-having-filters-on-meta-data/147337 "2018-09-05T08:23:28Z")
Currently, I've been using the validate API of elasticsearch in order to validate my query. the URL that I am hitting is as follows: curl -X GET -H 'Content-Type: application/json' --data @query.json 'http:// /\_validat… --- ## [Nested fields upsert with Spark not working](https://discuss.elastic.co/t/nested-fields-upsert-with-spark-not-working/146633)
**Author:** [@cluengo](https://discuss.elastic.co/u/cluengo)\ **Replies:** 3\ **Last updated:** [September 5, 2018, 8:11am UTC](https://discuss.elastic.co/t/nested-fields-upsert-with-spark-not-working/146633 "2018-09-05T08:11:33Z")
Hi, I already asked this a few months ago, but since the answer was that it would be fixed in a following release, I wanted to know whether I'm doing something wrong, or if it's still not fixed. I'm trying to update a … --- ## [Could not find or load main class org.elasticsearch.tools.java\_version\_checker.JavaVersionChecker](https://discuss.elastic.co/t/could-not-find-or-load-main-class-org-elasticsearch-tools-java-version-checker-javaversionchecker/147327)
**Author:** [@MuiruriPyrax](https://discuss.elastic.co/u/MuiruriPyrax)\ **Replies:** 0\ **Last updated:** [September 5, 2018, 7:48am UTC](https://discuss.elastic.co/t/could-not-find-or-load-main-class-org-elasticsearch-tools-java-version-checker-javaversionchecker/147327 "2018-09-05T07:48:52Z")
i get this error whenever i run ./bin/elasticsearch Error: Could not find or load main class org.elasticsearch.tools.java\_version\_checker.JavaVersionChecker Caused by: java.lang.ClassNotFoundException: org.elasticsearc… --- ## [ScanError: scroll only succeeded on X out of X shards (python)](https://discuss.elastic.co/t/scanerror-scroll-only-succeeded-on-x-out-of-x-shards-python/147321)
**Author:** [@mariskaas](https://discuss.elastic.co/u/mariskaas)\ **Replies:** 0\ **Last updated:** [September 5, 2018, 7:10am UTC](https://discuss.elastic.co/t/scanerror-scroll-only-succeeded-on-x-out-of-x-shards-python/147321 "2018-09-05T07:10:18Z")
Hi there, I'm trying to get a whole bunch of data out of elastic and into python to do some stuff with it. It was going fine with the normal search api but it is limited to 10.000 and I need a lot more. I am using the… --- ## [Need help running Ansible Playbook to install Elastic Search](https://discuss.elastic.co/t/need-help-running-ansible-playbook-to-install-elastic-search/146238)
**Author:** [@Shahzeb\_Siddiqui](https://discuss.elastic.co/u/Shahzeb_Siddiqui)\ **Replies:** 2\ **Last updated:** [September 5, 2018, 7:09am UTC](https://discuss.elastic.co/t/need-help-running-ansible-playbook-to-install-elastic-search/146238 "2018-09-05T07:09:35Z")
Looking at https://github.com/elastic/ansible-elasticsearch I am trying to install elastic search. I have run command ansible-galaxy install elastic.elasticsearch Now I have the following file, I added the two paramet… --- ## [Alternative to curator](https://discuss.elastic.co/t/alternative-to-curator/146942)
**Author:** [@laurent\_telle](https://discuss.elastic.co/u/laurent_telle)\ **Replies:** 2\ **Last updated:** [September 5, 2018, 6:22am UTC](https://discuss.elastic.co/t/alternative-to-curator/146942 "2018-09-05T06:22:42Z")
Hi guys, any plan to integrate curator to kibana ui ? means where we can manage automatically remove of index after certain period of time in kabana ? Tx Laurent --- ## [Unable to download plugin](https://discuss.elastic.co/t/unable-to-download-plugin/147306)
**Author:** [@kranthi\_851](https://discuss.elastic.co/u/kranthi_851)\ **Replies:** 0\ **Last updated:** [September 5, 2018, 5:23am UTC](https://discuss.elastic.co/t/unable-to-download-plugin/147306 "2018-09-05T05:23:50Z")
While downloading ingestgeoip plugin, i am getting this exception: Terminal window will be open. -\> Downloading ingest-geoip from elastic \[\> \] 3% Exception in thread "m… --- ## [Automatic Index creation vs "apriori" Creation](https://discuss.elastic.co/t/automatic-index-creation-vs-apriori-creation/147300)
**Author:** [@ecarmona](https://discuss.elastic.co/u/ecarmona)\ **Replies:** 2\ **Last updated:** [September 5, 2018, 4:45am UTC](https://discuss.elastic.co/t/automatic-index-creation-vs-apriori-creation/147300 "2018-09-05T04:45:22Z")
Hi There, I hope all is going well in the elastic world. Today I was asked what is the advantage between creating indexes upfront and automatic index creation when these indexes are referred to a timestamp. For instan… --- ## [Elasticsearch Watcher Stops processing after recovering from full disk](https://discuss.elastic.co/t/elasticsearch-watcher-stops-processing-after-recovering-from-full-disk/147298)
**Author:** [@planetvortex](https://discuss.elastic.co/u/planetvortex)\ **Replies:** 1\ **Last updated:** [September 5, 2018, 4:35am UTC](https://discuss.elastic.co/t/elasticsearch-watcher-stops-processing-after-recovering-from-full-disk/147298 "2018-09-05T04:35:24Z")
3 times now I've managed to fill up my disks and after recovering the watcher service fails to work reliably. I end up having to restart each data node then it works fine. This isn't just my watches, but the system wat… --- ## [How to delete a cluster](https://discuss.elastic.co/t/how-to-delete-a-cluster/147295)
**Author:** [@prabhin](https://discuss.elastic.co/u/prabhin)\ **Replies:** 3\ **Last updated:** [September 5, 2018, 4:31am UTC](https://discuss.elastic.co/t/how-to-delete-a-cluster/147295 "2018-09-05T04:31:04Z")
how to delete a cluster? --- ## [Connect to Elastic Cloud via PreBuiltXPackTransportClient](https://discuss.elastic.co/t/connect-to-elastic-cloud-via-prebuiltxpacktransportclient/146839)
**Author:** [@occurred](https://discuss.elastic.co/u/occurred)\ **Replies:** 1\ **Last updated:** [September 5, 2018, 4:18am UTC](https://discuss.elastic.co/t/connect-to-elastic-cloud-via-prebuiltxpacktransportclient/146839 "2018-09-05T04:18:20Z")
I was following the instructions from here: https://www.elastic.co/guide/en/x-pack/current/java-clients.html and just for my initial tests I've used the following example: import org.elasticsearch.xpack.client.PreBuil… --- ## [Histogram Aggregation Filter Nested Dates Array Per Interval](https://discuss.elastic.co/t/histogram-aggregation-filter-nested-dates-array-per-interval/145457)
**Author:** [@kigonya](https://discuss.elastic.co/u/kigonya)\ **Replies:** 7\ **Last updated:** [September 5, 2018, 3:59am UTC](https://discuss.elastic.co/t/histogram-aggregation-filter-nested-dates-array-per-interval/145457 "2018-09-05T03:59:21Z")
I have met a challenge that has made me review these forums and sign up :). My work is related to cancer trials. We are currently on ES 5.5. We are trying to track numbers of trials that enter into different status over… --- ## [ELK Stack for postgresql DB server](https://discuss.elastic.co/t/elk-stack-for-postgresql-db-server/147282)
**Author:** [@kaushalshriyan](https://discuss.elastic.co/u/kaushalshriyan)\ **Replies:** 1\ **Last updated:** [September 5, 2018, 1:42am UTC](https://discuss.elastic.co/t/elk-stack-for-postgresql-db-server/147282 "2018-09-05T01:42:15Z")
Hi, I am evaluating ELK Stack for DB related select queries. Currently i am trying to push postgresql DB analytics data to ELK Stack. Can someone please pitch in for my post about various approach to query sql data from… --- ## [Custom query parser performance?](https://discuss.elastic.co/t/custom-query-parser-performance/147002)
**Author:** [@panthersquirrel](https://discuss.elastic.co/u/panthersquirrel)\ **Replies:** 2\ **Last updated:** [September 5, 2018, 1:08am UTC](https://discuss.elastic.co/t/custom-query-parser-performance/147002 "2018-09-05T01:08:43Z")
I'm writing a high level query parser to go from something like a AND (b OR c) to a DSL object. My implementation would flatten a AND (b OR c) to (a AND b) OR (a and c). From here, the translation to query DSL would be f… --- ## [Moving Snaps to another disk](https://discuss.elastic.co/t/moving-snaps-to-another-disk/147275)
**Author:** [@jeffharper](https://discuss.elastic.co/u/jeffharper)\ **Replies:** 0\ **Last updated:** [September 4, 2018, 9:16pm UTC](https://discuss.elastic.co/t/moving-snaps-to-another-disk/147275 "2018-09-04T21:16:44Z")
I'm trying to move our snapshots to a new larger drive. I've mounted both drives, and I stopped the curator job that creates new snapshots. I'm using "rsync -av /oldmount/logstash\_snaps /newmount" to copy the files, an… [Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1557) [Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1559)