# Elasticsearch **URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1996 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1997 --- ## [Bulk Processor doesn't auto flush after flushInterval duration](https://discuss.elastic.co/t/bulk-processor-doesnt-auto-flush-after-flushinterval-duration/95030)
**Author:** [@hugo53](https://discuss.elastic.co/u/hugo53)\ **Replies:** 2\ **Last updated:** [July 29, 2017, 2:34pm UTC](https://discuss.elastic.co/t/bulk-processor-doesnt-auto-flush-after-flushinterval-duration/95030 "2017-07-29T14:34:57Z")
Hi there, I have a problem with bulk indexing using Bulk Processor. I setup like this: .setBulkActions(5000) .setBulkSize(new ByteSizeValue(50, ByteSizeUnit.MB)) .setFlushInterval(TimeValue.timeValueSeconds(5)) .set… --- ## [Writing custom plugin for CEP with Esper - advice](https://discuss.elastic.co/t/writing-custom-plugin-for-cep-with-esper-advice/95038)
**Author:** [@tigertiger](https://discuss.elastic.co/u/tigertiger)\ **Replies:** 0\ **Last updated:** [July 29, 2017, 10:55am UTC](https://discuss.elastic.co/t/writing-custom-plugin-for-cep-with-esper-advice/95038 "2017-07-29T10:55:37Z")
Hello, I am preparing to write an ES plugin for Complex Event Processing using Esper (http://www.espertech.com). I’ve searched for resources regarding writing plugins but found only basic tutorials. I have some doubts … --- ## [Hyperlinks in Kibana dashboard](https://discuss.elastic.co/t/hyperlinks-in-kibana-dashboard/92311)
**Author:** [@ICG](https://discuss.elastic.co/u/ICG)\ **Replies:** 0\ **Last updated:** [July 7, 2017, 6:16pm UTC](https://discuss.elastic.co/t/hyperlinks-in-kibana-dashboard/92311 "2017-07-07T18:16:01Z")
How can I add hyperlinks? --- ## [How to take backup and restore of specific date indices](https://discuss.elastic.co/t/how-to-take-backup-and-restore-of-specific-date-indices/95032)
**Author:** [@purvang](https://discuss.elastic.co/u/purvang)\ **Replies:** 4\ **Last updated:** [July 29, 2017, 7:31am UTC](https://discuss.elastic.co/t/how-to-take-backup-and-restore-of-specific-date-indices/95032 "2017-07-29T07:31:32Z")
Hi Team, I have gone through the concept of snapshot for backup and restore. command for backup : PUT/\_snapshot / …/…?wait\_for\_completion=true command for restore : POST /\_snapshot/…/…/\_restore Can you please sugge… --- ## [How can i apply filter or another query on the value calculated in es query](https://discuss.elastic.co/t/how-can-i-apply-filter-or-another-query-on-the-value-calculated-in-es-query/95034)
**Author:** [@vaibhav\_goel](https://discuss.elastic.co/u/vaibhav_goel)\ **Replies:** 0\ **Last updated:** [July 29, 2017, 6:54am UTC](https://discuss.elastic.co/t/how-can-i-apply-filter-or-another-query-on-the-value-calculated-in-es-query/95034 "2017-07-29T06:54:49Z")
GET urza/user/\_search { “script\_fields”: { “my\_score”: { “script”: “doc\[‘total\_revenue\_i’\].value / doc\[‘purchased\_i’\].value” } },“query”: { “range”: { “total\_revenue\_i”: { “gt”:0 } } } } how can i apply fil… --- ## [Dynamic Templates - verify what template was used](https://discuss.elastic.co/t/dynamic-templates-verify-what-template-was-used/95033)
**Author:** [@earl.lapus](https://discuss.elastic.co/u/earl.lapus)\ **Replies:** 0\ **Last updated:** [July 29, 2017, 6:45am UTC](https://discuss.elastic.co/t/dynamic-templates-verify-what-template-was-used/95033 "2017-07-29T06:45:46Z")
Is there a way to check which dynamic mapping templates were used for a document when it was POSTed? --- ## [Adding more data nodes decreased primary indexing rate](https://discuss.elastic.co/t/adding-more-data-nodes-decreased-primary-indexing-rate/94692)
**Author:** [@ELK\_GB](https://discuss.elastic.co/u/ELK_GB)\ **Replies:** 7\ **Last updated:** [July 29, 2017, 6:15am UTC](https://discuss.elastic.co/t/adding-more-data-nodes-decreased-primary-indexing-rate/94692 "2017-07-29T06:15:20Z")
Hi There, I have been running different capacity and performance test scenarios on our ELK cluster and today I have noticed something that didn't make sense to me. I had 4 data nodes and 2 coordinating nodes that I s… --- ## [Warning Message : \[o.e.m.j.JvmGcMonitorService\]](https://discuss.elastic.co/t/warning-message-o-e-m-j-jvmgcmonitorservice/94976)
**Author:** [@gugansankar](https://discuss.elastic.co/u/gugansankar)\ **Replies:** 3\ **Last updated:** [July 29, 2017, 5:48am UTC](https://discuss.elastic.co/t/warning-message-o-e-m-j-jvmgcmonitorservice/94976 "2017-07-29T05:48:21Z")
All of sudden, I started to see this message on Elasticsearch log file and also unable to view the logs on Kibana frequent timedout error. \[2017-07-28T10:31:07,902\]\[WARN \]\[o.e.m.j.JvmGcMonitorService\] \[itels1\] \[gc\]\[2449… --- ## [Fetching position of keyword in matched document](https://discuss.elastic.co/t/fetching-position-of-keyword-in-matched-document/94291)
**Author:** [@hugo53](https://discuss.elastic.co/u/hugo53)\ **Replies:** 5\ **Last updated:** [July 29, 2017, 3:52am UTC](https://discuss.elastic.co/t/fetching-position-of-keyword-in-matched-document/94291 "2017-07-29T03:52:45Z")
Hello there, I'm trying to highlight searched keyword in matched document with some custom works. Therefore, I need to know position (or offset) of that keyword in document. However, I found no documentation showing cl… --- ## [Search within PDF files](https://discuss.elastic.co/t/search-within-pdf-files/94489)
**Author:** [@liavch](https://discuss.elastic.co/u/liavch)\ **Replies:** 8\ **Last updated:** [July 29, 2017, 2:24am UTC](https://discuss.elastic.co/t/search-within-pdf-files/94489 "2017-07-29T02:24:58Z")
Hi, we're using Elastic's API to search document repository we created for our users (about 6,000 documents). Most of the documents are PDF files and we're having difficulty to offer our customers with true value by help… --- ## [Is it necessary to use putMapping() each time index() is called for a different type?](https://discuss.elastic.co/t/is-it-necessary-to-use-putmapping-each-time-index-is-called-for-a-different-type/95026)
**Author:** [@full\_vlad](https://discuss.elastic.co/u/full_vlad)\ **Replies:** 1\ **Last updated:** [July 29, 2017, 1:10am UTC](https://discuss.elastic.co/t/is-it-necessary-to-use-putmapping-each-time-index-is-called-for-a-different-type/95026 "2017-07-29T01:10:58Z")
I am using the elasticsearch 5.2 node.js module. I know that elasticsearch.index() creates the index if it's not already created. The problem, though, is that I am using a special mapping on one of the fields. For exam… --- ## [Elasticsearch client for Elixir](https://discuss.elastic.co/t/elasticsearch-client-for-elixir/95020)
**Author:** [@Roopa\_Chandrasekarai](https://discuss.elastic.co/u/Roopa_Chandrasekarai)\ **Replies:** 0\ **Last updated:** [July 28, 2017, 11:13pm UTC](https://discuss.elastic.co/t/elasticsearch-client-for-elixir/95020 "2017-07-28T23:13:35Z")
Can anyone suggest me a good elasticsearch client for the language Elixir? I came across elastix (https://github.com/werbitzky/elastix) and tirexs(https://github.com/Zatvobor/tirexs). But they do not seem to show any exa… --- ## [When will Elasticsearch SQL be released?](https://discuss.elastic.co/t/when-will-elasticsearch-sql-be-released/93928)
**Author:** [@christophe\_spielmann](https://discuss.elastic.co/u/christophe_spielmann)\ **Replies:** 4\ **Last updated:** [July 28, 2017, 10:55pm UTC](https://discuss.elastic.co/t/when-will-elasticsearch-sql-be-released/93928 "2017-07-28T22:55:18Z")
I am looking for the Elasticsearch SQL that was introduced during last Elastic{ON}17. Is it already available ? It has been a while since the show demo. I see that there are community alternatives but what I am looking f… --- ## [Search query to return data from multiple types of same index](https://discuss.elastic.co/t/search-query-to-return-data-from-multiple-types-of-same-index/94826)
**Author:** [@Marine321](https://discuss.elastic.co/u/Marine321)\ **Replies:** 1\ **Last updated:** [July 28, 2017, 10:30pm UTC](https://discuss.elastic.co/t/search-query-to-return-data-from-multiple-types-of-same-index/94826 "2017-07-28T22:30:48Z")
I have data in three different types of same index. Say type data1 has { "city" : "BELCHERTOWN", "city" : "BLANDFORD", "city" : "BRIMFIELD" } data2 has { "city" : "BELCHERTOWN", "city" : "BLANDFORD", "city" : "BR… --- ## [How to configure log in elasticsearch 5.4?](https://discuss.elastic.co/t/how-to-configure-log-in-elasticsearch-5-4/95012)
**Author:** [@MountainMoon](https://discuss.elastic.co/u/MountainMoon)\ **Replies:** 0\ **Last updated:** [July 28, 2017, 8:51pm UTC](https://discuss.elastic.co/t/how-to-configure-log-in-elasticsearch-5-4/95012 "2017-07-28T20:51:34Z")
Hi All: After installing the elasticsearch 5.4 I got an issue with logs, logs are too large (over 30 GB a day). I looked into the log4j2.properties configuration file and found some of the log level are set to "info", s… --- ## [No node available : Elasticsearch Transport Client can't connect to Docker container](https://discuss.elastic.co/t/no-node-available-elasticsearch-transport-client-cant-connect-to-docker-container/94883)
**Author:** [@Jessec](https://discuss.elastic.co/u/Jessec)\ **Replies:** 8\ **Last updated:** [July 28, 2017, 8:46pm UTC](https://discuss.elastic.co/t/no-node-available-elasticsearch-transport-client-cant-connect-to-docker-container/94883 "2017-07-28T20:46:06Z")
Hi , I have issue connecting to elasticsearch in Docker container using Elasticsearch Transport Client. If I curl to elasticsearch from terminal, it seems fine: $ curl -XGET http://elasticsearch:9200/\_nodes/http?pretty… --- ## [How to compare 2 array entries in nested doc when value doesn't matter](https://discuss.elastic.co/t/how-to-compare-2-array-entries-in-nested-doc-when-value-doesnt-matter/95004)
**Author:** [@vkueffel](https://discuss.elastic.co/u/vkueffel)\ **Replies:** 0\ **Last updated:** [July 28, 2017, 6:48pm UTC](https://discuss.elastic.co/t/how-to-compare-2-array-entries-in-nested-doc-when-value-doesnt-matter/95004 "2017-07-28T18:48:20Z")
I’m trying to compare 2 entries in an array of nested documents in ElasticSearch. Imagine this document structure: { "\_source": { "id": "something", "content": \[{ "field1": "value1", "text": "The quick brown… --- ## [Arriving at the number of servers required for Elastic Search implementation](https://discuss.elastic.co/t/arriving-at-the-number-of-servers-required-for-elastic-search-implementation/94995)
**Author:** [@victor\_frank](https://discuss.elastic.co/u/victor_frank)\ **Replies:** 1\ **Last updated:** [July 28, 2017, 5:33pm UTC](https://discuss.elastic.co/t/arriving-at-the-number-of-servers-required-for-elastic-search-implementation/94995 "2017-07-28T17:33:15Z")
Is there any way to arrive at the number of servers that we require to implement our Elastic Search? Our application is a content rich application. we are planning to implement Elastic Search. We have been doing our ana… --- ## [Mapper parsing exception for date type](https://discuss.elastic.co/t/mapper-parsing-exception-for-date-type/94992)
**Author:** [@matthkang](https://discuss.elastic.co/u/matthkang)\ **Replies:** 0\ **Last updated:** [July 28, 2017, 5:10pm UTC](https://discuss.elastic.co/t/mapper-parsing-exception-for-date-type/94992 "2017-07-28T17:10:45Z")
I am trying to send a log with a date value of “yyyy-MM-dd’T’HH:mm:ss.SSSZ” results in an error of MapperParsingException. Full error message: Failed to index \[1\] messages. Please check the index error log in your web … --- ## [Search in all paths in a nested query](https://discuss.elastic.co/t/search-in-all-paths-in-a-nested-query/94989)
**Author:** [@hanisaf](https://discuss.elastic.co/u/hanisaf)\ **Replies:** 0\ **Last updated:** [July 28, 2017, 4:51pm UTC](https://discuss.elastic.co/t/search-in-all-paths-in-a-nested-query/94989 "2017-07-28T16:51:53Z")
I have a document that contains multiple nested fields. I want to write a generic query to match a keyword in all nested fields and return inner hits. Is there a way to use \_all in path and/or fields. i.e to write someth… --- ## [Spring Boot - Global Custom Exception Handling Mechanism using RestControllerAdvice](https://discuss.elastic.co/t/spring-boot-global-custom-exception-handling-mechanism-using-restcontrolleradvice/94938)
**Author:** [@halogeek](https://discuss.elastic.co/u/halogeek)\ **Replies:** 0\ **Last updated:** [July 28, 2017, 10:48am UTC](https://discuss.elastic.co/t/spring-boot-global-custom-exception-handling-mechanism-using-restcontrolleradvice/94938 "2017-07-28T10:48:48Z")
Am using Spring Boot for Restful Web Services. Trying to setup a global custom exception handling mechanism which relies on @RestControllerAdvice which can handle exceptions that are known but also not known. pom.xml \<… --- ## [How to Increase Elasticsearch node configuration without Enterprise Cloud](https://discuss.elastic.co/t/how-to-increase-elasticsearch-node-configuration-without-enterprise-cloud/94890)
**Author:** [@Kranthi\_Dharani](https://discuss.elastic.co/u/Kranthi_Dharani)\ **Replies:** 4\ **Last updated:** [July 28, 2017, 3:55pm UTC](https://discuss.elastic.co/t/how-to-increase-elasticsearch-node-configuration-without-enterprise-cloud/94890 "2017-07-28T15:55:36Z")
Is there a way I can increase elasticsearch nodes using AWS CLI or using the ElasticSearch Rest endpoint by using a Rest Client ?. I can think of only with 2 options using AWS CLI or Rest Endpoint. I have 2 master node… --- ## [ES In Prod periodically jumping to constant high CPU and super slow queries](https://discuss.elastic.co/t/es-in-prod-periodically-jumping-to-constant-high-cpu-and-super-slow-queries/92846)
**Author:** [@hifitodd](https://discuss.elastic.co/u/hifitodd)\ **Replies:** 2\ **Last updated:** [July 28, 2017, 3:24pm UTC](https://discuss.elastic.co/t/es-in-prod-periodically-jumping-to-constant-high-cpu-and-super-slow-queries/92846 "2017-07-28T15:24:27Z")
Hi, I run ES on my production site, and every ~2weeks or so of running it, all of a sudden it will jump to 106% CPU utilization and stay there until I bounce the service. I saw this before and did a bit of research, … --- ## [Basic Authentication of ES without X-Pack](https://discuss.elastic.co/t/basic-authentication-of-es-without-x-pack/94840)
**Author:** [@smlbiobot](https://discuss.elastic.co/u/smlbiobot)\ **Replies:** 4\ **Last updated:** [July 28, 2017, 3:20pm UTC](https://discuss.elastic.co/t/basic-authentication-of-es-without-x-pack/94840 "2017-07-28T15:20:54Z")
I was told that it is possible to do basic authentication of ElasticSearch without installing X-Pack, but I don’t see an option for it. Can you let me know how I can set it up with a simple u/p combo? Thanks! --- ## [Mmapfs vs. niofs](https://discuss.elastic.co/t/mmapfs-vs-niofs/94984)
**Author:** [@anks](https://discuss.elastic.co/u/anks)\ **Replies:** 0\ **Last updated:** [July 28, 2017, 3:05pm UTC](https://discuss.elastic.co/t/mmapfs-vs-niofs/94984 "2017-07-28T15:05:55Z")
Hi I am running on ES 5.x. Running some match queries. I found fetching 1000 search results taking a lot more time (5x) when using mmapfs compared to niofs. Do know what can be the possible reason for this strange beh… --- ## [Watchers cause master node load spike](https://discuss.elastic.co/t/watchers-cause-master-node-load-spike/94980)
**Author:** [@amercado](https://discuss.elastic.co/u/amercado)\ **Replies:** 0\ **Last updated:** [July 28, 2017, 3:01pm UTC](https://discuss.elastic.co/t/watchers-cause-master-node-load-spike/94980 "2017-07-28T15:01:26Z")
Notice the monitoring graph. There is a spike in load every 10 minutes which coincides with the interval time of our watchers (3 of them). Why are these causing such high load on the master? Since the data node in our … --- ## [Elasticsearch is using most of the memory](https://discuss.elastic.co/t/elasticsearch-is-using-most-of-the-memory/94975)
**Author:** [@mtoussaint](https://discuss.elastic.co/u/mtoussaint)\ **Replies:** 0\ **Last updated:** [July 28, 2017, 2:41pm UTC](https://discuss.elastic.co/t/elasticsearch-is-using-most-of-the-memory/94975 "2017-07-28T14:41:47Z")
Hi guys, We are using Elasticsearch for a few months now, but lately our server’s memory went nuts. Indeed, this last one was constantly above 90% and after reading Heap: Sizing and Swapping, I simply limited the initia… --- ## [Config/Tuning advice :)](https://discuss.elastic.co/t/config-tuning-advice/93945)
**Author:** [@PaulieMac](https://discuss.elastic.co/u/PaulieMac)\ **Replies:** 4\ **Last updated:** [July 28, 2017, 2:34pm UTC](https://discuss.elastic.co/t/config-tuning-advice/93945 "2017-07-28T14:34:57Z")
Hi All, I have an analytic app in development, and I was hoping to get a little advice around configuring elastic for query performance... Here is the scenario: In all, there are around 42 million docs, in a single i… --- ## [Unusually high load in node, never high load on master. 2 node setup](https://discuss.elastic.co/t/unusually-high-load-in-node-never-high-load-on-master-2-node-setup/91667)
**Author:** [@amercado](https://discuss.elastic.co/u/amercado)\ **Replies:** 2\ **Last updated:** [July 28, 2017, 2:32pm UTC](https://discuss.elastic.co/t/unusually-high-load-in-node-never-high-load-on-master-2-node-setup/91667 "2017-07-28T14:32:19Z")
I have a 2 node setup with a master and a node both running in docker containers which volume mount the config and data directories. As far as the docker specific configuration, I have a ulimit set on both master and … --- ## [What is a Valid Geometry in ES?](https://discuss.elastic.co/t/what-is-a-valid-geometry-in-es/94465)
**Author:** [@cabane77](https://discuss.elastic.co/u/cabane77)\ **Replies:** 15\ **Last updated:** [July 28, 2017, 2:29pm UTC](https://discuss.elastic.co/t/what-is-a-valid-geometry-in-es/94465 "2017-07-28T14:29:15Z")
My question is a repeat of the below, but since there was no response, I had to ask again. This is really causing us a lot of problems as we simply can't import the spatial data in ES - although we have validated those … [Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1995) [Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1997)