# Elasticsearch **URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1943 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1944 --- ## [Indexing speed slowdown](https://discuss.elastic.co/t/indexing-speed-slowdown/101288)
**Author:** [@philv](https://discuss.elastic.co/u/philv)\ **Replies:** 11\ **Last updated:** [September 21, 2017, 3:24pm UTC](https://discuss.elastic.co/t/indexing-speed-slowdown/101288 "2017-09-21T15:24:42Z")
I've noticed a slowdown in indexing speed going from esv 2.3 to 5.5.0. It's early days, I have no precise figures and there are a tonne of other things that may differ, but my first thought was that it may be a change I… --- ## [Custom realm authentication with request/query params and not custom headers](https://discuss.elastic.co/t/custom-realm-authentication-with-request-query-params-and-not-custom-headers/99264)
**Author:** [@sumit\_monga](https://discuss.elastic.co/u/sumit_monga)\ **Replies:** 1\ **Last updated:** [September 21, 2017, 2:37pm UTC](https://discuss.elastic.co/t/custom-realm-authentication-with-request-query-params-and-not-custom-headers/99264 "2017-09-21T14:37:34Z")
Hi All, I have a webapp in Java which supports OAuth authentication and authorization. I want to use the same authentication mechanism in Elasticsearch. To achieve this, I used some custom headers such as Tenant and Acc… --- ## [How to bypass vm.max\_map\_count check upon start?](https://discuss.elastic.co/t/how-to-bypass-vm-max-map-count-check-upon-start/101354)
**Author:** [@WoJ](https://discuss.elastic.co/u/WoJ)\ **Replies:** 0\ **Last updated:** [September 21, 2017, 2:32pm UTC](https://discuss.elastic.co/t/how-to-bypass-vm-max-map-count-check-upon-start/101354 "2017-09-21T14:32:51Z")
Hello I use Elasticsearch 5 in a container (systemd-nspawn) and when I attempt to start it, I get the error max virtual memory areas vm.max\_map\_count \[65530\] is too low, increase to at least \[262144\] As mentionned in … --- ## [2.2.0: put-mapping errors](https://discuss.elastic.co/t/2-2-0-put-mapping-errors/101349)
**Author:** [@dawiro](https://discuss.elastic.co/u/dawiro)\ **Replies:** 0\ **Last updated:** [September 21, 2017, 1:59pm UTC](https://discuss.elastic.co/t/2-2-0-put-mapping-errors/101349 "2017-09-21T13:59:05Z")
Hi, I'm seeing the following errors despite there being no issues with shard errors etc: ProcessClusterEventTimeoutException\[failed to process cluster event (put-mapping \[app-logs\]) within 30s\] at org.elasticse… --- ## [Cluster Elastics 5.5 exception caught on transport layer](https://discuss.elastic.co/t/cluster-elastics-5-5-exception-caught-on-transport-layer/101337)
**Author:** [@19831d72452f0be1a755](https://discuss.elastic.co/u/19831d72452f0be1a755)\ **Replies:** 0\ **Last updated:** [September 21, 2017, 1:20pm UTC](https://discuss.elastic.co/t/cluster-elastics-5-5-exception-caught-on-transport-layer/101337 "2017-09-21T13:20:19Z")
Hello. I use: X-Pack 5.5.1; Elastic 5.5.1; Kibana 5.5; Logstash 5.5 Configurations: master: xpack.monitoring.enabled: true xpack.ssl.key: /etc/elasticsearch/logstashtest.key xpack.ssl.certificate: /etc/elasticsea… --- ## [Linear regression to forecast demand](https://discuss.elastic.co/t/linear-regression-to-forecast-demand/101324)
**Author:** [@clandestino\_bgd\_2](https://discuss.elastic.co/u/clandestino_bgd_2)\ **Replies:** 0\ **Last updated:** [September 21, 2017, 11:56am UTC](https://discuss.elastic.co/t/linear-regression-to-forecast-demand/101324 "2017-09-21T11:56:15Z")
Hello, I am trying to come up with optimal way to forecast the purchase time for Product P and User U. We currently index these events in ES (pushed by e-commerce system) orderId,user,product,quantity,time,days "orde… --- ## [Elasticsearch memory usage interpret](https://discuss.elastic.co/t/elasticsearch-memory-usage-interpret/101330)
**Author:** [@no\_jihun](https://discuss.elastic.co/u/no_jihun)\ **Replies:** 0\ **Last updated:** [September 21, 2017, 12:44pm UTC](https://discuss.elastic.co/t/elasticsearch-memory-usage-interpret/101330 "2017-09-21T12:44:08Z")
This is a advanced node state screenshot of one node. \[image\] One node have 32GB of memory and 15.8GB of heap used at the screenshot time. Graphs says lucene total is 2.7GB and elasticsearch taken up 1.4GB. Now I can… --- ## [TermsLookup Error too\_many\_clauses: maxClauseCount is set to 1024](https://discuss.elastic.co/t/termslookup-error-too-many-clauses-maxclausecount-is-set-to-1024/101309)
**Author:** [@sarala.muralikrishna](https://discuss.elastic.co/u/sarala.muralikrishna)\ **Replies:** 0\ **Last updated:** [September 21, 2017, 10:18am UTC](https://discuss.elastic.co/t/termslookup-error-too-many-clauses-maxclausecount-is-set-to-1024/101309 "2017-09-21T10:18:04Z")
We are using Elastic cloud services and currently facing issue with too\_many\_clauses: maxClauseCount is set to 1024 when using termslookup functionality. below is the query we are using. { "from": 0, "size": 10, "sor… --- ## [How to APPEND new data in index against id using spark scala](https://discuss.elastic.co/t/how-to-append-new-data-in-index-against-id-using-spark-scala/101308)
**Author:** [@Akshay\_60](https://discuss.elastic.co/u/Akshay_60)\ **Replies:** 0\ **Last updated:** [September 21, 2017, 10:15am UTC](https://discuss.elastic.co/t/how-to-append-new-data-in-index-against-id-using-spark-scala/101308 "2017-09-21T10:15:14Z")
Hi , I am working on spark for processing and after processing I am ingesting data into ES.But issue is that whenever I am running that code it is updating that but I want every time data should be appended. I have use… --- ## [Unable to set index.merge.scheduler.max\_thread\_count](https://discuss.elastic.co/t/unable-to-set-index-merge-scheduler-max-thread-count/101161)
**Author:** [@itplayer](https://discuss.elastic.co/u/itplayer)\ **Replies:** 2\ **Last updated:** [September 21, 2017, 9:43am UTC](https://discuss.elastic.co/t/unable-to-set-index-merge-scheduler-max-thread-count/101161 "2017-09-21T09:43:38Z")
According to official document said, if we unfortunately still use spin disk, we should set this value to 1. I used to be set this in elasticsearch.yml but not luck in v5.4 I know this setting has been move to index le… --- ## [Stored logs and compression](https://discuss.elastic.co/t/stored-logs-and-compression/101294)
**Author:** [@sbampa](https://discuss.elastic.co/u/sbampa)\ **Replies:** 2\ **Last updated:** [September 21, 2017, 9:30am UTC](https://discuss.elastic.co/t/stored-logs-and-compression/101294 "2017-09-21T09:30:26Z")
Hi all, can someone help me with compression data in ES? I'm storing around 100 GB per day, with a retention of 90 days. I need to compress the data. Already set index.codec: best\_compression Some tips ?? --- ## [Shrink (merge?) performance optimization](https://discuss.elastic.co/t/shrink-merge-performance-optimization/101157)
**Author:** [@gerilya](https://discuss.elastic.co/u/gerilya)\ **Replies:** 2\ **Last updated:** [September 21, 2017, 8:51am UTC](https://discuss.elastic.co/t/shrink-merge-performance-optimization/101157 "2017-09-21T08:51:40Z")
Hello, We have Elasticsearch cluster with 30 data nodes (i3.2xlarge AWS instances). They are storing approx 37TB of data spread between 335 indicies (1 index per day per app service). The largest indecies reach almost… --- ## [How to disable Zen discovery in Elastic-search 5.5?](https://discuss.elastic.co/t/how-to-disable-zen-discovery-in-elastic-search-5-5/100994)
**Author:** [@patil-akshay](https://discuss.elastic.co/u/patil-akshay)\ **Replies:** 5\ **Last updated:** [September 21, 2017, 7:47am UTC](https://discuss.elastic.co/t/how-to-disable-zen-discovery-in-elastic-search-5-5/100994 "2017-09-21T07:47:42Z")
As I am running multiple instances of elastic-search on the same server with different versions elasticsearch is trying to form a cluster for which it is searching for different nodes I Don't want that thing to happen so… --- ## [Delete Blocked](https://discuss.elastic.co/t/delete-blocked/101269)
**Author:** [@pengleiyfw](https://discuss.elastic.co/u/pengleiyfw)\ **Replies:** 1\ **Last updated:** [September 21, 2017, 7:41am UTC](https://discuss.elastic.co/t/delete-blocked/101269 "2017-09-21T07:41:05Z")
Hi all: I meet this question ,I don't know how to slove this problem.This problem lead to high cpu and load average! Here is a jstack file。 elasticsearch\[data-1237\]\[bulk\]\[T#195\]" daemon prio=10 tid=0x00007f02580b5800 n… --- ## [How to push large excel data to elasticsearch using bulk API](https://discuss.elastic.co/t/how-to-push-large-excel-data-to-elasticsearch-using-bulk-api/101266)
**Author:** [@ajit](https://discuss.elastic.co/u/ajit)\ **Replies:** 1\ **Last updated:** [September 21, 2017, 7:16am UTC](https://discuss.elastic.co/t/how-to-push-large-excel-data-to-elasticsearch-using-bulk-api/101266 "2017-09-21T07:16:50Z")
I am reading excel sheet using java and aspose and I am using bulk API to push data to elasticsearch but it is taking more time to create index in elasticsearch and pushing data to ES. My Excel file contains 50000 record… --- ## [RollingFileAppender Error while starting elasticsearch](https://discuss.elastic.co/t/rollingfileappender-error-while-starting-elasticsearch/100630)
**Author:** [@ssasporta](https://discuss.elastic.co/u/ssasporta)\ **Replies:** 2\ **Last updated:** [September 21, 2017, 7:06am UTC](https://discuss.elastic.co/t/rollingfileappender-error-while-starting-elasticsearch/100630 "2017-09-21T07:06:00Z")
I am getting the following error while starting Elasticsearch. Sep 15 10:46:35 cbtbilevtmtr01 elasticsearch: 2017-09-15 10:46:35,367 main ERROR Unable to invoke factory method in class class org.apache.logging.log4j.co… --- ## [Elasticsearch search unlimited](https://discuss.elastic.co/t/elasticsearch-search-unlimited/101274)
**Author:** [@vasanth1](https://discuss.elastic.co/u/vasanth1)\ **Replies:** 1\ **Last updated:** [September 21, 2017, 7:05am UTC](https://discuss.elastic.co/t/elasticsearch-search-unlimited/101274 "2017-09-21T07:05:38Z")
Hi i am new to elastic. im using elastic search with chewy gem in ruby on rails.and how to increase the search limit into unlimited?now im getting only 10 results. --- ## [Elasticsearch : Unknown key for a VALUE\_STRING in \[scroll\]](https://discuss.elastic.co/t/elasticsearch-unknown-key-for-a-value-string-in-scroll/101264)
**Author:** [@Saurab\_Dahal](https://discuss.elastic.co/u/Saurab_Dahal)\ **Replies:** 2\ **Last updated:** [September 21, 2017, 6:27am UTC](https://discuss.elastic.co/t/elasticsearch-unknown-key-for-a-value-string-in-scroll/101264 "2017-09-21T06:27:01Z")
Elasticsearch scroll api gives me this error { "error": { "root\_cause": \[ { "type": "parsing\_exception", "reason": "Unknown key for a VALUE\_STRING in \[scroll\].", "li… --- ## [How to increase thread pool](https://discuss.elastic.co/t/how-to-increase-thread-pool/101142)
**Author:** [@Chu\_Jun](https://discuss.elastic.co/u/Chu_Jun)\ **Replies:** 5\ **Last updated:** [September 21, 2017, 5:16am UTC](https://discuss.elastic.co/t/how-to-increase-thread-pool/101142 "2017-09-21T05:16:11Z")
Hi, I am having an error while I got 4 client.bulk program run at the same time: Error: Request to Elasticsearch failed: "\[es\_rejected\_execution\_exception\] rejected execution of org.elasticsearch.transport.TransportSe… --- ## [Elasticsearch multisearch API](https://discuss.elastic.co/t/elasticsearch-multisearch-api/101257)
**Author:** [@higee](https://discuss.elastic.co/u/higee)\ **Replies:** 1\ **Last updated:** [September 21, 2017, 3:43am UTC](https://discuss.elastic.co/t/elasticsearch-multisearch-api/101257 "2017-09-21T03:43:01Z")
Hi, I'm stuck with elasticsearch multisearch. Based on document, I'm supposed to get an array of each response. The problem is that I'm getting only one response. I'm not sure what I've done wrong. In my example, it's … --- ## [Netflow issue](https://discuss.elastic.co/t/netflow-issue/101165)
**Author:** [@Adam\_Schappell](https://discuss.elastic.co/u/Adam_Schappell)\ **Replies:** 1\ **Last updated:** [September 21, 2017, 12:49am UTC](https://discuss.elastic.co/t/netflow-issue/101165 "2017-09-21T00:49:01Z")
Hey all i cannot get Netflow to come in. This is my error in logstash.log {:timestamp=\>"2017-09-20T12:14:58.043000-0400", :message=\>"Unsupported field", :type=\>244, :length=\>1, :level=\>:warn} {:timestamp=\>"2017-09-20T1… --- ## [Can't change replica count for '.security' index](https://discuss.elastic.co/t/cant-change-replica-count-for-security-index/101196)
**Author:** [@frasdav](https://discuss.elastic.co/u/frasdav)\ **Replies:** 0\ **Last updated:** [September 20, 2017, 2:48pm UTC](https://discuss.elastic.co/t/cant-change-replica-count-for-security-index/101196 "2017-09-20T14:48:56Z")
We're running 9 instances of Elasticsearch 2.4.0 across 3 hosts (yes, 3 instances per host - don't ask), and we've got Shield installed. When Shield was installed, (I assume) it created a '.security' index for native au… --- ## [JVM Heap Size](https://discuss.elastic.co/t/jvm-heap-size/101184)
**Author:** [@ericbarnes](https://discuss.elastic.co/u/ericbarnes)\ **Replies:** 4\ **Last updated:** [September 21, 2017, 12:29am UTC](https://discuss.elastic.co/t/jvm-heap-size/101184 "2017-09-21T00:29:29Z")
We have a pretty new Elasticsearch set up. We seem to be hitting a memory error that we can not overcome. I've increased the values to one half of the installed memory. Any times on adjusting the JVM? \[2017-09-20T09:4… --- ## [Deleteme](https://discuss.elastic.co/t/deleteme/101149)
**Author:** [@kenneth\_l\_stewart](https://discuss.elastic.co/u/kenneth_l_stewart)\ **Replies:** 5\ **Last updated:** [September 20, 2017, 9:28pm UTC](https://discuss.elastic.co/t/deleteme/101149 "2017-09-20T21:28:14Z")
DELETEME DELETEME --- ## [Fastest way to delete a lot of individual documents](https://discuss.elastic.co/t/fastest-way-to-delete-a-lot-of-individual-documents/101201)
**Author:** [@jeroen1](https://discuss.elastic.co/u/jeroen1)\ **Replies:** 5\ **Last updated:** [September 20, 2017, 8:30pm UTC](https://discuss.elastic.co/t/fastest-way-to-delete-a-lot-of-individual-documents/101201 "2017-09-20T20:30:19Z")
I've got a index with billions of documents. Once in a while I push an update. The update contains new documents and documents that replace older documents. I'd like to delete the document that are replaced, typically a … --- ## [Painless compare string dates](https://discuss.elastic.co/t/painless-compare-string-dates/101230)
**Author:** [@Alex\_Vaisberg](https://discuss.elastic.co/u/Alex_Vaisberg)\ **Replies:** 0\ **Last updated:** [September 20, 2017, 8:17pm UTC](https://discuss.elastic.co/t/painless-compare-string-dates/101230 "2017-09-20T20:17:36Z")
Hi, I need compare two dates in painless script inline to update documents. I try in Kibana Console: GET indexName/Type/1111/\_update { "script":{ "lang": "painless", "inline": "ctx.\_source.accounts.removeIf(i… --- ## [Is it possible to provide conditional "highlighting"?](https://discuss.elastic.co/t/is-it-possible-to-provide-conditional-highlighting/100935)
**Author:** [@Jaspreet\_Singh](https://discuss.elastic.co/u/Jaspreet_Singh)\ **Replies:** 1\ **Last updated:** [September 20, 2017, 7:38pm UTC](https://discuss.elastic.co/t/is-it-possible-to-provide-conditional-highlighting/100935 "2017-09-20T19:38:56Z")
Some search results that we send back are confidential, hence we need to block highlighting of search terms. So based based on a field "type", a result should either have a highlight or not. What is the best way to impl… --- ## [Problem with function\_score and bool query including range](https://discuss.elastic.co/t/problem-with-function-score-and-bool-query-including-range/100701)
**Author:** [@Badger](https://discuss.elastic.co/u/Badger)\ **Replies:** 1\ **Last updated:** [September 15, 2017, 4:11pm UTC](https://discuss.elastic.co/t/problem-with-function-score-and-bool-query-including-range/100701 "2017-09-15T16:11:57Z")
I am trying to randomly pick documents from an index. This query successfully returns one document. GET logstash-2017.09.10/\_search { "size": 1, "query": { "function\_score": { "query": { "bool": {… --- ## [After insert document\_id at logstash, elastic stops receiveing data](https://discuss.elastic.co/t/after-insert-document-id-at-logstash-elastic-stops-receiveing-data/101223)
**Author:** [@paulo\_bruck](https://discuss.elastic.co/u/paulo_bruck)\ **Replies:** 4\ **Last updated:** [September 20, 2017, 6:30pm UTC](https://discuss.elastic.co/t/after-insert-document-id-at-logstash-elastic-stops-receiveing-data/101223 "2017-09-20T18:30:11Z")
HI guys Using debian + logstash+kibana+logstash version 5.6.0 If I insert document\_id at output elastic , I do not receive any new input at elasticsearch. Part of logstash file: input { file { path =\> "/var/log/fir… --- ## [C# NEST: Expression required for "field" specification in FieldValueFactor?](https://discuss.elastic.co/t/c-nest-expression-required-for-field-specification-in-fieldvaluefactor/100803)
**Author:** [@Thomas\_Doman](https://discuss.elastic.co/u/Thomas_Doman)\ **Replies:** 4\ **Last updated:** [September 20, 2017, 5:33pm UTC](https://discuss.elastic.co/t/c-nest-expression-required-for-field-specification-in-fieldvaluefactor/100803 "2017-09-20T17:33:28Z")
I'm using NEST and Elasticsearch.Net versions 1.9.2. I'm trying to create a FieldValueFactor scoring function which all seems to work properly except I can't figure out how to specify the field I want to use. .Function… [Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1942) [Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1944)