# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1933

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1934

---

## [Queries related to BulkProcessor](https://discuss.elastic.co/t/queries-related-to-bulkprocessor/101944)

<div class="topic-metadata">

**Author:** [@Sambit\_Kabi](https://discuss.elastic.co/u/Sambit_Kabi)\
**Replies:** 0\
**Last updated:** [September 27, 2017, 7:55am UTC](https://discuss.elastic.co/t/queries-related-to-bulkprocessor/101944 "2017-09-27T07:55:58Z")

</div>

Hello, I have a few queries related to BulkProcessor: If there are multiple threads associated with Bulk processor there is no guarantee when the index requests will be executed as it is asynchronous. Is there a way …

---

## [REST API or Logstash for add/update/delete records in Elastic Index?](https://discuss.elastic.co/t/rest-api-or-logstash-for-add-update-delete-records-in-elastic-index/102396)

<div class="topic-metadata">

**Author:** [@west415](https://discuss.elastic.co/u/west415)\
**Replies:** 2\
**Last updated:** [October 3, 2017, 6:32am UTC](https://discuss.elastic.co/t/rest-api-or-logstash-for-add-update-delete-records-in-elastic-index/102396 "2017-10-03T06:32:40Z")

</div>

We have a MySQL database and are using Elastic 5.4 and wanted to know out of the below two options of getting data from MySQL into our ES index which is preferred and why (if possible) As records are added, updated, a…

---

## [FSCrawler won't crawl new files](https://discuss.elastic.co/t/fscrawler-wont-crawl-new-files/102491)

<div class="topic-metadata">

**Author:** [@Quix0r](https://discuss.elastic.co/u/Quix0r)\
**Replies:** 3\
**Last updated:** [October 3, 2017, 6:01am UTC](https://discuss.elastic.co/t/fscrawler-wont-crawl-new-files/102491 "2017-10-03T06:01:55Z")

</div>

The crawler seem not to add any new files. So I investigated and found below warning message on all profiles: Can't find stored field name to check existing filenames in path \[/some/path\]. Please set store: true on fiel…

---

## [Master Node gradually moves to Out Of Memory Exception](https://discuss.elastic.co/t/master-node-gradually-moves-to-out-of-memory-exception/102344)

<div class="topic-metadata">

**Author:** [@corona](https://discuss.elastic.co/u/corona)\
**Replies:** 5\
**Last updated:** [October 3, 2017, 5:26am UTC](https://discuss.elastic.co/t/master-node-gradually-moves-to-out-of-memory-exception/102344 "2017-10-03T05:26:23Z")

</div>

Hello, We are currently running version 2.4.0, with 20 nodes in the cluster containing ~49,000 shards with ~17TB of data. I'm consistently seeing an issue where it seems like the master node gradually runs out of heap …

---

## [Does fault detection process work sequentially?](https://discuss.elastic.co/t/does-fault-detection-process-work-sequentially/99662)

<div class="topic-metadata">

**Author:** [@YuWatanabe](https://discuss.elastic.co/u/YuWatanabe)\
**Replies:** 2\
**Last updated:** [October 3, 2017, 4:43am UTC](https://discuss.elastic.co/t/does-fault-detection-process-work-sequentially/99662 "2017-10-03T04:43:02Z")

</div>

Hi. I was reading the document and was bit unclear with the fault detection process. Are the zen ping sent sequentially each time? Or , is it asynchronously regardless of response time of each ping?

---

## [What plugins are enabled with "Development Subscription"](https://discuss.elastic.co/t/what-plugins-are-enabled-with-development-subscription/102501)

<div class="topic-metadata">

**Author:** [@m-kiuchi](https://discuss.elastic.co/u/m-kiuchi)\
**Replies:** 2\
**Last updated:** [October 3, 2017, 2:17am UTC](https://discuss.elastic.co/t/what-plugins-are-enabled-with-development-subscription/102501 "2017-10-03T02:17:43Z")

</div>

Recently we've purchased "Development Subscription", but there is no information which X-Pack plugin are enabled with it. I'm happy with your comment.

---

## [Trouble accessing Lucene \_source values](https://discuss.elastic.co/t/trouble-accessing-lucene-source-values/102493)

<div class="topic-metadata">

**Author:** [@taylorgaw](https://discuss.elastic.co/u/taylorgaw)\
**Replies:** 0\
**Last updated:** [October 2, 2017, 11:19pm UTC](https://discuss.elastic.co/t/trouble-accessing-lucene-source-values/102493 "2017-10-02T23:19:04Z")

</div>

I'm building out integration tests for my ES5.5 plugin that I wrote which pulls values from a document and generates a score based on those values. Here's what I have to build out my test cluster: public void prepESClsu…

---

## [Deployment, Development, and Version Control](https://discuss.elastic.co/t/deployment-development-and-version-control/102122)

<div class="topic-metadata">

**Author:** [@guardhunt](https://discuss.elastic.co/u/guardhunt)\
**Replies:** 3\
**Last updated:** [October 2, 2017, 9:52pm UTC](https://discuss.elastic.co/t/deployment-development-and-version-control/102122 "2017-10-02T21:52:17Z")

</div>

I am relatively new to elastic and am looking for some input on choosing a deployment, ongoing development, and version control strategy for my Elsatic Stack. I am close to building a production version of elastic am loo…

---

## [ElasticSearch - fscrawler missing documents in Index](https://discuss.elastic.co/t/elasticsearch-fscrawler-missing-documents-in-index/100449)

<div class="topic-metadata">

**Author:** [@Suresh\_Nataraj](https://discuss.elastic.co/u/Suresh_Nataraj)\
**Replies:** 7\
**Last updated:** [October 2, 2017, 9:29pm UTC](https://discuss.elastic.co/t/elasticsearch-fscrawler-missing-documents-in-index/100449 "2017-10-02T21:29:25Z")

</div>

Hi All, I am using fscrawler for indexing a file system into ES . After the sucessful run of crawler the status shows below : { "name" : "test\_crawler\_1", "lastrun" : "2017-09-14T00:24:03.808", "indexed" : 13256…

---

## [Elasticsearch 5.2.2 cluster runs OutOfMemory when it gets query with many words](https://discuss.elastic.co/t/elasticsearch-5-2-2-cluster-runs-outofmemory-when-it-gets-query-with-many-words/102481)

<div class="topic-metadata">

**Author:** [@Srinivasan\_Ramaswamy](https://discuss.elastic.co/u/Srinivasan_Ramaswamy)\
**Replies:** 0\
**Last updated:** [October 2, 2017, 8:06pm UTC](https://discuss.elastic.co/t/elasticsearch-5-2-2-cluster-runs-outofmemory-when-it-gets-query-with-many-words/102481 "2017-10-02T20:06:25Z")

</div>

I have a 3 node elasticsearch cluster with version 5.2.2 and when i send a query that has \>70 words, the cluster runs out of memory and crashes. Interestingly, when the number of words is 30+ I get an error message "too\_…

---

## [Possible bug?!](https://discuss.elastic.co/t/possible-bug/102476)

<div class="topic-metadata">

**Author:** [@tjh](https://discuss.elastic.co/u/tjh)\
**Replies:** 0\
**Last updated:** [October 2, 2017, 7:38pm UTC](https://discuss.elastic.co/t/possible-bug/102476 "2017-10-02T19:38:23Z")

</div>

POST seekandsolve3/thread/\_update\_by\_query { "query": { "match\_all": {} }, "script": { "inline": "String foo = ctx.\_source.question.tags; if(foo.length()\>0){ctx.\_source.question.tags\_completion = /\\s/.split(foo)}" …

---

## [Failed to parse mapping \[\_default\_\]: A dynamic template must be defined with a name Logstash](https://discuss.elastic.co/t/failed-to-parse-mapping-default-a-dynamic-template-must-be-defined-with-a-name-logstash/102462)

<div class="topic-metadata">

**Author:** [@Alexander\_Gerasimenk](https://discuss.elastic.co/u/Alexander_Gerasimenk)\
**Replies:** 0\
**Last updated:** [October 2, 2017, 6:17pm UTC](https://discuss.elastic.co/t/failed-to-parse-mapping-default-a-dynamic-template-must-be-defined-with-a-name-logstash/102462 "2017-10-02T18:17:34Z")

</div>

Hello, I’m trying to make logstash store suricata data to a specific elasticsearch index. When I delete template and elasticsearch index and then restart logstash - it works fine, but when logstash creates new daily ela…

---

## [Master is not joiing cluster](https://discuss.elastic.co/t/master-is-not-joiing-cluster/102387)

<div class="topic-metadata">

**Author:** [@ghanshyam](https://discuss.elastic.co/u/ghanshyam)\
**Replies:** 8\
**Last updated:** [October 2, 2017, 4:53pm UTC](https://discuss.elastic.co/t/master-is-not-joiing-cluster/102387 "2017-10-02T16:53:19Z")

</div>

I have 3 master, 2 is up and but third one is not joining. Node1: c810wem.int.thomsonreuters.com node.name: ${HOSTNAME}-master-${ES\_HTTP\_PORT} http.cors.enabled: true tr.security.transport.ipfilter: "+n:c628agv.int.t…

---

## [Painless using comparing to a float](https://discuss.elastic.co/t/painless-using-comparing-to-a-float/102013)

<div class="topic-metadata">

**Author:** [@jspeer](https://discuss.elastic.co/u/jspeer)\
**Replies:** 5\
**Last updated:** [October 2, 2017, 4:47pm UTC](https://discuss.elastic.co/t/painless-using-comparing-to-a-float/102013 "2017-10-02T16:47:32Z")

</div>

I'm trying to divide 2 buckets, and check against a float to see if the value has decreased This works "condition": { "script": { "inline": "return ((ctx.payload.aggregations.today.buckets.latest60.doc\_count)/(ctx.pa…

---

## [Easier way to add data to an Index](https://discuss.elastic.co/t/easier-way-to-add-data-to-an-index/102448)

<div class="topic-metadata">

**Author:** [@Brendinho](https://discuss.elastic.co/u/Brendinho)\
**Replies:** 3\
**Last updated:** [October 2, 2017, 4:28pm UTC](https://discuss.elastic.co/t/easier-way-to-add-data-to-an-index/102448 "2017-10-02T16:28:43Z")

</div>

I have a group of tables that I'm looking to put into ES. I have them in .csv format and I also have them in JSON files. What is the best way to accomplish this? Obviously the end goal is to then sort through them in Kib…

---

## [Similar result set for singular and plural query](https://discuss.elastic.co/t/similar-result-set-for-singular-and-plural-query/102454)

<div class="topic-metadata">

**Author:** [@ParitoshBh](https://discuss.elastic.co/u/ParitoshBh)\
**Replies:** 0\
**Last updated:** [October 2, 2017, 4:25pm UTC](https://discuss.elastic.co/t/similar-result-set-for-singular-and-plural-query/102454 "2017-10-02T16:25:34Z")

</div>

Here's the problem, for search terms 'cats' and 'cat', I am trying to get similar results i.e. 'cats' should search for 'cat' internally. To solve this minimal\_english seems like a good choice, and am using that as part …

---

## [Terms Query - Return matched term with hit?](https://discuss.elastic.co/t/terms-query-return-matched-term-with-hit/102345)

<div class="topic-metadata">

**Author:** [@DefensiveDepth](https://discuss.elastic.co/u/DefensiveDepth)\
**Replies:** 2\
**Last updated:** [October 2, 2017, 3:59pm UTC](https://discuss.elastic.co/t/terms-query-return-matched-term-with-hit/102345 "2017-10-02T15:59:03Z")

</div>

I am using the Terms query with a document lookup to load the Terms. Is there a way to return the specific term that was found with each hit? Right now, all I get back is a list of hits, but I don't know which terms wer…

---

## [Watcher Hits in Script Params](https://discuss.elastic.co/t/watcher-hits-in-script-params/101533)

<div class="topic-metadata">

**Author:** [@luke.snyder](https://discuss.elastic.co/u/luke.snyder)\
**Replies:** 2\
**Last updated:** [October 2, 2017, 3:44pm UTC](https://discuss.elastic.co/t/watcher-hits-in-script-params/101533 "2017-10-02T15:44:13Z")

</div>

I am attempting to pass some fields from the hits generated by a watch to a painless script so I can index a subset of the fields. Ultimately I would like to be able to pass n number of parameters to the script and have …

---

## [Elasticseach v5.x - Configuration rolling log files with log4j2](https://discuss.elastic.co/t/elasticseach-v5-x-configuration-rolling-log-files-with-log4j2/102443)

<div class="topic-metadata">

**Author:** [@Jiri\_Petak](https://discuss.elastic.co/u/Jiri_Petak)\
**Replies:** 0\
**Last updated:** [October 2, 2017, 2:33pm UTC](https://discuss.elastic.co/t/elasticseach-v5-x-configuration-rolling-log-files-with-log4j2/102443 "2017-10-02T14:33:13Z")

</div>

Hi, i am trying to configure log4j2.properties file for setting up rolling log files. Using configuration from official elastic pages: status = error # log action execution errors for easier debugging logger.action.na…

---

## ["scaled\_float" datatype doesn't make much sense](https://discuss.elastic.co/t/scaled-float-datatype-doesnt-make-much-sense/102441)

<div class="topic-metadata">

**Author:** [@cdbfoster](https://discuss.elastic.co/u/cdbfoster)\
**Replies:** 0\
**Last updated:** [October 2, 2017, 2:19pm UTC](https://discuss.elastic.co/t/scaled-float-datatype-doesnt-make-much-sense/102441 "2017-10-02T14:19:12Z")

</div>

Listed here: "A floating point that is backed by a long and a fixed scaling factor." This is literally fixed-point. It's not floating-point, because the point doesn't "float".

---

## [Not able to perform remote reindex with X-Pack Elastic Search](https://discuss.elastic.co/t/not-able-to-perform-remote-reindex-with-x-pack-elastic-search/101477)

<div class="topic-metadata">

**Author:** [@SaurabhDhingra](https://discuss.elastic.co/u/SaurabhDhingra)\
**Replies:** 1\
**Last updated:** [October 2, 2017, 1:06pm UTC](https://discuss.elastic.co/t/not-able-to-perform-remote-reindex-with-x-pack-elastic-search/101477 "2017-10-02T13:06:13Z")

</div>

Facing issue when doing reindexing remotely with X-Pack enabled Eg: POST /\_reindex { "source": { "remote": { "host": "http://\<whitelist-ip\>" }, "index": "stage\_de" …

---

## [Help with dynamic filename in Watch URL](https://discuss.elastic.co/t/help-with-dynamic-filename-in-watch-url/100896)

<div class="topic-metadata">

**Author:** [@zen300](https://discuss.elastic.co/u/zen300)\
**Replies:** 3\
**Last updated:** [October 2, 2017, 1:05pm UTC](https://discuss.elastic.co/t/help-with-dynamic-filename-in-watch-url/100896 "2017-10-02T13:05:00Z")

</div>

I browsed a few topics but couldn't find a similar example. I basically want a Watch set up, searches for keyword and emails (as attachment) any files it finds with that keyword. It works if I hardcode the filename in th…

---

## [Scripted field use another scripted field](https://discuss.elastic.co/t/scripted-field-use-another-scripted-field/101187)

<div class="topic-metadata">

**Author:** [@RickT](https://discuss.elastic.co/u/RickT)\
**Replies:** 2\
**Last updated:** [October 2, 2017, 1:00pm UTC](https://discuss.elastic.co/t/scripted-field-use-another-scripted-field/101187 "2017-10-02T13:00:39Z")

</div>

Hello, I'm searching for the method to use scripted field in coding another scripted field. For beginning, is it possible ? i explain... i have a SF named lap1. The associed script is : (doc\['TimeTab2'\]…

---

## [Add a watcher to Elasticsearch to alert when any of the users in the Azure table logs into the website](https://discuss.elastic.co/t/add-a-watcher-to-elasticsearch-to-alert-when-any-of-the-users-in-the-azure-table-logs-into-the-website/102230)

<div class="topic-metadata">

**Author:** [@enkidev](https://discuss.elastic.co/u/enkidev)\
**Replies:** 1\
**Last updated:** [October 2, 2017, 12:58pm UTC](https://discuss.elastic.co/t/add-a-watcher-to-elasticsearch-to-alert-when-any-of-the-users-in-the-azure-table-logs-into-the-website/102230 "2017-10-02T12:58:35Z")

</div>

Hi, I'm completely new to Elasticsearch, any help would of great help. Using the complete ELK stack to monitor the users logged into the site. When a user logs into the website, the username is passed to elastic searc…

---

## [Sending SNMPTraps as an action (using watcher)?](https://discuss.elastic.co/t/sending-snmptraps-as-an-action-using-watcher/102239)

<div class="topic-metadata">

**Author:** [@cedric1](https://discuss.elastic.co/u/cedric1)\
**Replies:** 1\
**Last updated:** [October 2, 2017, 12:56pm UTC](https://discuss.elastic.co/t/sending-snmptraps-as-an-action-using-watcher/102239 "2017-10-02T12:56:39Z")

</div>

Hi, I would like to know if it is possible or what is the best way to send snmptraps from watcher ? I have seen an answer on this forum that says it is possible to send from watcher, an http request to logstash and th…

---

## [How to display a parameter that is appearing in the logs in an email?](https://discuss.elastic.co/t/how-to-display-a-parameter-that-is-appearing-in-the-logs-in-an-email/101929)

<div class="topic-metadata">

**Author:** [@Indiresh](https://discuss.elastic.co/u/Indiresh)\
**Replies:** 1\
**Last updated:** [October 2, 2017, 12:55pm UTC](https://discuss.elastic.co/t/how-to-display-a-parameter-that-is-appearing-in-the-logs-in-an-email/101929 "2017-10-02T12:55:53Z")

</div>

Hi there, I am currently working with Watcher on Kibana. Is there any way to access and display a parameter that's appearing in my server logs? For ex: In the logs, one of the parameters is "Hostname". I'd like to displ…

---

## [Watcher not able to post bulk data into elastic](https://discuss.elastic.co/t/watcher-not-able-to-post-bulk-data-into-elastic/100925)

<div class="topic-metadata">

**Author:** [@umeshbt](https://discuss.elastic.co/u/umeshbt)\
**Replies:** 1\
**Last updated:** [October 2, 2017, 12:53pm UTC](https://discuss.elastic.co/t/watcher-not-able-to-post-bulk-data-into-elastic/100925 "2017-10-02T12:53:25Z")

</div>

I am facing one issue watcher watcher, I have a query which returns list of “servername” and “datatype” {"Servername":"2","datatype":"AuditJobBacklog"} {"Servername":"3","datatype":"AuditJobBacklog"} I want to insert…

---

## [Patterns](https://discuss.elastic.co/t/patterns/102435)

<div class="topic-metadata">

**Author:** [@mbvelo](https://discuss.elastic.co/u/mbvelo)\
**Replies:** 0\
**Last updated:** [October 2, 2017, 12:21pm UTC](https://discuss.elastic.co/t/patterns/102435 "2017-10-02T12:21:41Z")

</div>

Hi what is the json structure to get Thread \>\> Message \>\> Loglevel

---

## [How to do a range query to match all greater than X](https://discuss.elastic.co/t/how-to-do-a-range-query-to-match-all-greater-than-x/102434)

<div class="topic-metadata">

**Author:** [@tomer](https://discuss.elastic.co/u/tomer)\
**Replies:** 1\
**Last updated:** [October 2, 2017, 12:11pm UTC](https://discuss.elastic.co/t/how-to-do-a-range-query-to-match-all-greater-than-x/102434 "2017-10-02T12:11:24Z")

</div>

How to do a range query to match all greater than X? for an example all that the delay field has a value greater than 3 as in the following example: { "range": { "delay": { …

---

## [Java Transport Client Host Addresses](https://discuss.elastic.co/t/java-transport-client-host-addresses/102384)

<div class="topic-metadata">

**Author:** [@Gaurav\_Kumar1](https://discuss.elastic.co/u/Gaurav_Kumar1)\
**Replies:** 3\
**Last updated:** [October 2, 2017, 11:32am UTC](https://discuss.elastic.co/t/java-transport-client-host-addresses/102384 "2017-10-02T11:32:50Z")

</div>

Hi All, We are having 15 machines ElasticSearch cluster of version 5.6.0, out of which only 5 machines are defined as master eligible and all 15 machines are defined as data nodes. Now If we are using Java Transport Cl…

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1932)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1934)
