# Elasticsearch **URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=816 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 817 --- ## [Trying to understand \`max\_clause\_count\`](https://discuss.elastic.co/t/trying-to-understand-max-clause-count/247742)
**Author:** [@mekanix](https://discuss.elastic.co/u/mekanix)\ **Replies:** 0\ **Last updated:** [September 7, 2020, 9:30am UTC](https://discuss.elastic.co/t/trying-to-understand-max-clause-count/247742 "2020-09-07T09:30:00Z")
We are getting hit by occasional "too\_many\_clauses" and I believe the issue is caused by our extensive use of synonyms expansions, where some words are expanded into quite a few others. But I don't quite understand the … --- ## [IO / Disc intensive load testing](https://discuss.elastic.co/t/io-disc-intensive-load-testing/247722)
**Author:** [@Oleg\_Ruchovets](https://discuss.elastic.co/u/Oleg_Ruchovets)\ **Replies:** 6\ **Last updated:** [September 7, 2020, 9:17am UTC](https://discuss.elastic.co/t/io-disc-intensive-load-testing/247722 "2020-09-07T09:17:29Z")
Hello, My task is to make an elastic search disk/io "hard life" :-). To not reinventing the wheel - is there a tool for simulation high disk load on elastic? what type of query is the most disk/io intensive? I saw ma… --- ## [Are there limits on no. of documents ingested per request through curl?](https://discuss.elastic.co/t/are-there-limits-on-no-of-documents-ingested-per-request-through-curl/247713)
**Author:** [@rvenkat123](https://discuss.elastic.co/u/rvenkat123)\ **Replies:** 2\ **Last updated:** [September 7, 2020, 8:50am UTC](https://discuss.elastic.co/t/are-there-limits-on-no-of-documents-ingested-per-request-through-curl/247713 "2020-09-07T08:50:07Z")
I have 6374 json documents that I would like to ingest. I used the curl command as follows: curl -H 'Content-Type: application/x-ndjson' -XPOST 'localhost:9200/projects/\_bulk?pretty' --data-binary @projects.json I f… --- ## [Extract CPU user pct along with its time using Query DSL](https://discuss.elastic.co/t/extract-cpu-user-pct-along-with-its-time-using-query-dsl/247727)
**Author:** [@shiv97](https://discuss.elastic.co/u/shiv97)\ **Replies:** 0\ **Last updated:** [September 7, 2020, 8:09am UTC](https://discuss.elastic.co/t/extract-cpu-user-pct-along-with-its-time-using-query-dsl/247727 "2020-09-07T08:09:06Z")
Hi Every one I am having metricbeat data I need to extract system.cpu.user.pct along with time using query DSL. I have checked and got how to extract the CPU user pct but now I want the time for each CPU user pct value… --- ## [ElasticSearch Sink with Structured Streaming](https://discuss.elastic.co/t/elasticsearch-sink-with-structured-streaming/247723)
**Author:** [@jainshasha](https://discuss.elastic.co/u/jainshasha)\ **Replies:** 0\ **Last updated:** [September 7, 2020, 7:50am UTC](https://discuss.elastic.co/t/elasticsearch-sink-with-structured-streaming/247723 "2020-09-07T07:50:59Z")
Hi, I am using this MR https://github.com/elastic/elasticsearch-hadoop/pull/1498 for ElasticSearch sink with Structured Streaming but in that i am having issue in seeing some metrics like "numOutputRows" which always sh… --- ## [How to check what all objects are created in Elasticsearch](https://discuss.elastic.co/t/how-to-check-what-all-objects-are-created-in-elasticsearch/247719)
**Author:** [@tusharnemade](https://discuss.elastic.co/u/tusharnemade)\ **Replies:** 3\ **Last updated:** [September 7, 2020, 7:39am UTC](https://discuss.elastic.co/t/how-to-check-what-all-objects-are-created-in-elasticsearch/247719 "2020-09-07T07:39:53Z")
Hi I am new joinee in one of the project which uses Elasticsearch cluster. Could you please help me to find out the way via which i could find and say what all objects are created in Elasticsearch Cluster. These objec… --- ## [How to fully utilize the resources of Elasticsearch node](https://discuss.elastic.co/t/how-to-fully-utilize-the-resources-of-elasticsearch-node/247652)
**Author:** [@iammanmale](https://discuss.elastic.co/u/iammanmale)\ **Replies:** 3\ **Last updated:** [September 7, 2020, 6:45am UTC](https://discuss.elastic.co/t/how-to-fully-utilize-the-resources-of-elasticsearch-node/247652 "2020-09-07T06:45:32Z")
I have 5 nodes in my ELK cluster. I want to boost the indexing speed. I find out most of the nodes cpu $idle from command iostat are more than 50%, some of them are even more than 80% which mean the cpu are not fully ut… --- ## [Elasticsearch update by query](https://discuss.elastic.co/t/elasticsearch-update-by-query/247709)
**Author:** [@Mohammad\_Mousavi](https://discuss.elastic.co/u/Mohammad_Mousavi)\ **Replies:** 0\ **Last updated:** [September 7, 2020, 6:23am UTC](https://discuss.elastic.co/t/elasticsearch-update-by-query/247709 "2020-09-07T06:23:43Z")
Hi, This is my code: POST /logstash-myapp-\*/\_update\_by\_query { "query": { "term" : { "tags.keyword" : "myapp-stream" }, "bool": { "filter": \[ { "match": { "response": "200" … --- ## [Source Filtering does not return empty Array if no nested properties are found](https://discuss.elastic.co/t/source-filtering-does-not-return-empty-array-if-no-nested-properties-are-found/247707)
**Author:** [@Somdev\_Mehta](https://discuss.elastic.co/u/Somdev_Mehta)\ **Replies:** 0\ **Last updated:** [September 7, 2020, 6:07am UTC](https://discuss.elastic.co/t/source-filtering-does-not-return-empty-array-if-no-nested-properties-are-found/247707 "2020-09-07T06:07:18Z")
Hi All, I am a user of Elasticsearch version 1.7 and i realize that its high time to upgrade :stuck\_out\_tongue: (better late than never :smile: ). However, Elasticsearch 5.X on-wards i noticed a breaking change which i… --- ## [Can you help me on this ..., I am facing little issues while doing this for the elastic operator](https://discuss.elastic.co/t/can-you-help-me-on-this-i-am-facing-little-issues-while-doing-this-for-the-elastic-operator/247212)
**Author:** [@Vineeth\_varma](https://discuss.elastic.co/u/Vineeth_varma)\ **Replies:** 1\ **Last updated:** [September 7, 2020, 5:09am UTC](https://discuss.elastic.co/t/can-you-help-me-on-this-i-am-facing-little-issues-while-doing-this-for-the-elastic-operator/247212 "2020-09-07T05:09:32Z")
Continuing the discussion from ELK Stack integration with Keycloak: --- ## [Hot-Warm-Cold Log Transistion](https://discuss.elastic.co/t/hot-warm-cold-log-transistion/247688)
**Author:** [@vishakh](https://discuss.elastic.co/u/vishakh)\ **Replies:** 4\ **Last updated:** [September 7, 2020, 5:06am UTC](https://discuss.elastic.co/t/hot-warm-cold-log-transistion/247688 "2020-09-07T05:06:50Z")
Objective: Implement Hot-Warm-Cold Architecture At first when ingested from beats, data should be only be ingested and spread across only on Hot nodes. After 30-days logs moved to warm and then after 60 days to cold (E… --- ## [Should Elasticsearch plugin includes jackson-databind jars?](https://discuss.elastic.co/t/should-elasticsearch-plugin-includes-jackson-databind-jars/247689)
**Author:** [@Trevor\_Lee](https://discuss.elastic.co/u/Trevor_Lee)\ **Replies:** 0\ **Last updated:** [September 7, 2020, 1:51am UTC](https://discuss.elastic.co/t/should-elasticsearch-plugin-includes-jackson-databind-jars/247689 "2020-09-07T01:51:10Z")
if jackson-databind jars included, will end up "jar hell" if jackson-databind jars not inclued, will run into the situation: java.lang.NoClassDefFoundError: Could not initialize class com.fasterxml.jackson.databind.Obje… --- ## [Unable to find elasticsearch-keystore Data](https://discuss.elastic.co/t/unable-to-find-elasticsearch-keystore-data/247490)
**Author:** [@Ayush\_Agrahari](https://discuss.elastic.co/u/Ayush_Agrahari)\ **Replies:** 1\ **Last updated:** [September 7, 2020, 12:27am UTC](https://discuss.elastic.co/t/unable-to-find-elasticsearch-keystore-data/247490 "2020-09-07T00:27:23Z")
I want to setup JIRA configuration with ELK so I have configured few data in elasticsearch-keystore in Docker. Docker file data is below RUN elasticsearch-keystore create RUN echo "\*\*\*\*" | elasticsearch-keystor… --- ## [Does the time logged in slow logs include the time it spent in the search queue on the node?](https://discuss.elastic.co/t/does-the-time-logged-in-slow-logs-include-the-time-it-spent-in-the-search-queue-on-the-node/247424)
**Author:** [@Priyanka\_Raju](https://discuss.elastic.co/u/Priyanka_Raju)\ **Replies:** 5\ **Last updated:** [September 7, 2020, 12:17am UTC](https://discuss.elastic.co/t/does-the-time-logged-in-slow-logs-include-the-time-it-spent-in-the-search-queue-on-the-node/247424 "2020-09-07T00:17:59Z")
Hi, We are observing that there are a few nodes in our cluster seem to have a spike in search queue items (correlated with a spike in latency). We are relying on slow logs for some part of debugging and I wasn't sure if… --- ## [Kibana not showing correct logs](https://discuss.elastic.co/t/kibana-not-showing-correct-logs/247547)
**Author:** [@samra1810](https://discuss.elastic.co/u/samra1810)\ **Replies:** 1\ **Last updated:** [September 6, 2020, 9:41pm UTC](https://discuss.elastic.co/t/kibana-not-showing-correct-logs/247547 "2020-09-06T21:41:27Z")
EFK (Elasticsearch+Fluentd-(td-agent)+Kibana): Kibana not showing correct logs I have installed EFK on redhat linux system(version 7.6). Stable distribution of fluentd, that is td-agent is used instead of fluentd. Path… --- ## [Converting ES binary to single valued binary](https://discuss.elastic.co/t/converting-es-binary-to-single-valued-binary/247668)
**Author:** [@mehekek](https://discuss.elastic.co/u/mehekek)\ **Replies:** 0\ **Last updated:** [September 6, 2020, 10:30am UTC](https://discuss.elastic.co/t/converting-es-binary-to-single-valued-binary/247668 "2020-09-06T10:30:21Z")
Hi there :slight\_smile: To my knowledge, Unlike Lucene, Elasticsearch supports multi-valued byte arrays hence it embeds byte arrays by prefixing it with the number of byte arrays embedded and number of bytes remaining… --- ## [Docker Elasticsearch failing](https://discuss.elastic.co/t/docker-elasticsearch-failing/247686)
**Author:** [@tamilarasanbravo](https://discuss.elastic.co/u/tamilarasanbravo)\ **Replies:** 1\ **Last updated:** [September 6, 2020, 8:39pm UTC](https://discuss.elastic.co/t/docker-elasticsearch-failing/247686 "2020-09-06T20:39:15Z")
Hi Team, I have created a 3 node elasticsearch setup. One of my docker container fails with the below error lasticsearch/config/roles.yml\]" } {"type": "server", "timestamp": "2020-09-06T20:23:28,362Z", "level": "INFO",… --- ## [Remote Cluster Enterprise feature?](https://discuss.elastic.co/t/remote-cluster-enterprise-feature/247514)
**Author:** [@antex](https://discuss.elastic.co/u/antex)\ **Replies:** 1\ **Last updated:** [September 6, 2020, 6:02pm UTC](https://discuss.elastic.co/t/remote-cluster-enterprise-feature/247514 "2020-09-06T18:02:48Z")
Hi, I want to setup cross-cluster search in my self-managed cluster on Kubernetes using ECK. According to https://www.elastic.co/subscriptions this should be possible with the OpenSource license. But when I try to setup… --- ## [Need help on arithmetic operators usage in ingestion / scripted fields](https://discuss.elastic.co/t/need-help-on-arithmetic-operators-usage-in-ingestion-scripted-fields/247660)
**Author:** [@prabhakar\_talari](https://discuss.elastic.co/u/prabhakar_talari)\ **Replies:** 2\ **Last updated:** [September 6, 2020, 1:29pm UTC](https://discuss.elastic.co/t/need-help-on-arithmetic-operators-usage-in-ingestion-scripted-fields/247660 "2020-09-06T13:29:10Z")
Hi All, I have a field called duration which is number ( in seconds ). I would like to write ingestion pipeline OR scripted field add new field called duration\_hr by dividing the duration with 3600. my ES version is 7.6… --- ## [Recreation of ES data node failed](https://discuss.elastic.co/t/recreation-of-es-data-node-failed/247669)
**Author:** [@KOTOXJle6](https://discuss.elastic.co/u/KOTOXJle6)\ **Replies:** 8\ **Last updated:** [September 6, 2020, 12:47pm UTC](https://discuss.elastic.co/t/recreation-of-es-data-node-failed/247669 "2020-09-06T12:47:09Z")
Good afternoon. There was an elasticsearch cluster consisting of three data nodes and one coordinator with Kibana. It happened that one server died and was re-created. The ES version is the same, Java is the same, and t… --- ## [Shut down master-data node](https://discuss.elastic.co/t/shut-down-master-data-node/247556)
**Author:** [@elastic\_user1](https://discuss.elastic.co/u/elastic_user1)\ **Replies:** 2\ **Last updated:** [September 6, 2020, 12:43pm UTC](https://discuss.elastic.co/t/shut-down-master-data-node/247556 "2020-09-06T12:43:30Z")
I have shut down one node with both data and master roles. How can I remove this node from cluster? I have seen that the node have disappeared from my cluster and its replica shard became primary. --- ## [Separate index for every aggs bucket](https://discuss.elastic.co/t/separate-index-for-every-aggs-bucket/247661)
**Author:** [@bornatalebi](https://discuss.elastic.co/u/bornatalebi)\ **Replies:** 4\ **Last updated:** [September 6, 2020, 10:45am UTC](https://discuss.elastic.co/t/separate-index-for-every-aggs-bucket/247661 "2020-09-06T10:45:47Z")
Hi, I want to create a separate index for every aggs buckets. here is my watcher. I know I have to use "foreach" for my problem but can't figure out what value should I give it. thanks. --- ## [DataType Changes after rollover of Index](https://discuss.elastic.co/t/datatype-changes-after-rollover-of-index/247619)
**Author:** [@tusharnemade](https://discuss.elastic.co/u/tusharnemade)\ **Replies:** 9\ **Last updated:** [September 6, 2020, 9:19am UTC](https://discuss.elastic.co/t/datatype-changes-after-rollover-of-index/247619 "2020-09-06T09:19:56Z")
Hi Team I am using Elasticsearch Version 7.5.2. I have one index with grows in size and documents. Once it has reached 1000 documents , we are performing rollover. Command : curl -XPOST '10.10.10.1:9200/myevents/\_rol… --- ## [Faster to index raw data or load a static data dump](https://discuss.elastic.co/t/faster-to-index-raw-data-or-load-a-static-data-dump/247581)
**Author:** [@fallenreaper](https://discuss.elastic.co/u/fallenreaper)\ **Replies:** 8\ **Last updated:** [September 6, 2020, 7:02am UTC](https://discuss.elastic.co/t/faster-to-index-raw-data-or-load-a-static-data-dump/247581 "2020-09-06T07:02:51Z")
I want to leverage ES for analysis of static data. I was using a subset and it worked as planned. I would be able to query, build graphs in kibana etc. It is quite useful. That being said, since the data is static, S… --- ## [Best way to manage daily index](https://discuss.elastic.co/t/best-way-to-manage-daily-index/247647)
**Author:** [@smalljimmy](https://discuss.elastic.co/u/smalljimmy)\ **Replies:** 1\ **Last updated:** [September 6, 2020, 4:05am UTC](https://discuss.elastic.co/t/best-way-to-manage-daily-index/247647 "2020-09-06T04:05:27Z")
Hi guys We have a requirement as following: Ingest safety item list into ES daily. The source data is written to S3 to folder with path bucket/{date}/part\*.json from a batch job and are the continuously ingested to ES… --- ## [System requirements for Elasticsearch?](https://discuss.elastic.co/t/system-requirements-for-elasticsearch/247608)
**Author:** [@Ashish1101](https://discuss.elastic.co/u/Ashish1101)\ **Replies:** 3\ **Last updated:** [September 5, 2020, 6:49pm UTC](https://discuss.elastic.co/t/system-requirements-for-elasticsearch/247608 "2020-09-05T18:49:53Z")
We are planning to use ELK stack for logging. If we are installing Elasticsearch in a server, then how do I decide how much RAM and disk space will be required as Elasticsearch stores and indexes the logs. Answers and … --- ## [Problem with Mapping Templates](https://discuss.elastic.co/t/problem-with-mapping-templates/247370)
**Author:** [@ashu1](https://discuss.elastic.co/u/ashu1)\ **Replies:** 2\ **Last updated:** [September 5, 2020, 4:08pm UTC](https://discuss.elastic.co/t/problem-with-mapping-templates/247370 "2020-09-05T16:08:37Z")
I created a field mapping for keyword only field and ingested the data to ES,but I could still see field.keyword in my index. In my case field name is AB.Field1 Is it due to .(dot) in my field Name or any other issue? … --- ## [Not able to retrieve nested document in native java expert\_scripts for nested function\_score query](https://discuss.elastic.co/t/not-able-to-retrieve-nested-document-in-native-java-expert-scripts-for-nested-function-score-query/247621)
**Author:** [@Amity79](https://discuss.elastic.co/u/Amity79)\ **Replies:** 0\ **Last updated:** [September 5, 2020, 8:37am UTC](https://discuss.elastic.co/t/not-able-to-retrieve-nested-document-in-native-java-expert-scripts-for-nested-function-score-query/247621 "2020-09-05T08:37:54Z")
Hey! I am using 7.8.1 version of elasticsearch and using script-engine to score the document. When i use function\_score query, i am able to read the documet in ScriptEngine. Once I do nested function\_score query then i … --- ## [Java Rest client builder method throwing error for using HttpClientConfigCallback() method](https://discuss.elastic.co/t/java-rest-client-builder-method-throwing-error-for-using-httpclientconfigcallback-method/247558)
**Author:** [@soumrock123](https://discuss.elastic.co/u/soumrock123)\ **Replies:** 9\ **Last updated:** [September 5, 2020, 1:11pm UTC](https://discuss.elastic.co/t/java-rest-client-builder-method-throwing-error-for-using-httpclientconfigcallback-method/247558 "2020-09-05T13:11:14Z")
I am trying to set up an Elasticsearch high level rest client to connect with an already set up ES cluster via Http Host setup and regular credential authentication. I am setting this up to ingest data from my local syst… --- ## [Pipeline/output.go:121 Failed to publish events: temporary bulk send failure](https://discuss.elastic.co/t/pipeline-output-go-121-failed-to-publish-events-temporary-bulk-send-failure/246321)
**Author:** [@icirco](https://discuss.elastic.co/u/icirco)\ **Replies:** 1\ **Last updated:** [September 5, 2020, 5:46am UTC](https://discuss.elastic.co/t/pipeline-output-go-121-failed-to-publish-events-temporary-bulk-send-failure/246321 "2020-09-05T05:46:00Z")
hi, I have my filebeat agent (7.4) is still running but it stop to fill index. In my log, I see the message : pipeline/output.go:121 Failed to publish events: temporary bulk send failure I try to change the bulk\_max… [Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=815) [Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=817)