# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1966

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1967

---

## [Bulk index not returning source](https://discuss.elastic.co/t/bulk-index-not-returning-source/98353)

<div class="topic-metadata">

**Author:** [@dbrezoev](https://discuss.elastic.co/u/dbrezoev)\
**Replies:** 4\
**Last updated:** [August 28, 2017, 1:00pm UTC](https://discuss.elastic.co/t/bulk-index-not-returning-source/98353 "2017-08-28T13:00:41Z")

</div>

HI, is there a way to return the whole \_source object when using bulkIndex operation ? And how ? I am using the javascript api if that matters. Thanks

---

## [ElasticSearch node stopping with no visible error](https://discuss.elastic.co/t/elasticsearch-node-stopping-with-no-visible-error/98565)

<div class="topic-metadata">

**Author:** [@Daniel\_Braga](https://discuss.elastic.co/u/Daniel_Braga)\
**Replies:** 0\
**Last updated:** [August 28, 2017, 12:53pm UTC](https://discuss.elastic.co/t/elasticsearch-node-stopping-with-no-visible-error/98565 "2017-08-28T12:53:14Z")

</div>

Hi All, I have the following setup: -2 nodes running a elastisearch cluster (Linux 6.5) with elastic version 5.5.1 -1 of these nodes also running logstash 5.5.1 -I have also installed metricbeats in around 50 servers…

---

## [Installing/updating license](https://discuss.elastic.co/t/installing-updating-license/98477)

<div class="topic-metadata">

**Author:** [@yehosef](https://discuss.elastic.co/u/yehosef)\
**Replies:** 2\
**Last updated:** [August 28, 2017, 11:34am UTC](https://discuss.elastic.co/t/installing-updating-license/98477 "2017-08-28T11:34:51Z")

</div>

Is it on the roadmap to be able to update the license from the web interface instead of the instructions given at https://www.elastic.co/guide/en/x-pack/current/installing-license.html It feels backwards that something …

---

## [Count in C# NEST for ES 5.5](https://discuss.elastic.co/t/count-in-c-nest-for-es-5-5/98525)

<div class="topic-metadata">

**Author:** [@mwdoerner](https://discuss.elastic.co/u/mwdoerner)\
**Replies:** 1\
**Last updated:** [August 28, 2017, 11:31am UTC](https://discuss.elastic.co/t/count-in-c-nest-for-es-5-5/98525 "2017-08-28T11:31:21Z")

</div>

Hi, I’m writing a simple C# app that uses the NEST client for retrieving data from a local Elasticsearch instance. I have a small problem trying to get the number of all indexed (over all indices) documents. There is so…

---

## [Two systems using the same index](https://discuss.elastic.co/t/two-systems-using-the-same-index/98553)

<div class="topic-metadata">

**Author:** [@emilc](https://discuss.elastic.co/u/emilc)\
**Replies:** 1\
**Last updated:** [August 28, 2017, 11:08am UTC](https://discuss.elastic.co/t/two-systems-using-the-same-index/98553 "2017-08-28T11:08:46Z")

</div>

Hello, I’m interested in using Elasticsearch for two systems - but only with one Elasticsearch instance. 1. System: Webshop (Magento 2) 2. System: CMS (TYPO3) In both systems it should be possible so search in its ow…

---

## [Could not resolve all files for configuration ':benchmarks:classpath'](https://discuss.elastic.co/t/could-not-resolve-all-files-for-configuration-benchmarks-classpath/98368)

<div class="topic-metadata">

**Author:** [@saliormoon](https://discuss.elastic.co/u/saliormoon)\
**Replies:** 7\
**Last updated:** [August 28, 2017, 10:59am UTC](https://discuss.elastic.co/t/could-not-resolve-all-files-for-configuration-benchmarks-classpath/98368 "2017-08-28T10:59:50Z")

</div>

elasticsearch version: 5.5.2 OS: Windows When I compile elasticsearch source code with gradle, I encountered a problem, such as: What went wrong: A problem occurred configuring project ':benchmarks'. Could not re…

---

## [Retrieve more than 10 logs](https://discuss.elastic.co/t/retrieve-more-than-10-logs/98538)

<div class="topic-metadata">

**Author:** [@tomer](https://discuss.elastic.co/u/tomer)\
**Replies:** 3\
**Last updated:** [August 28, 2017, 10:58am UTC](https://discuss.elastic.co/t/retrieve-more-than-10-logs/98538 "2017-08-28T10:58:00Z")

</div>

Hi, I wrote a query that asks for all messages ever sent, in a certain time range. When looking at the data recieved there are only 10 logs in the output. How can I get all the logs from this time range. index: 'fileb…

---

## [Query duration too high for ~200G logs a day](https://discuss.elastic.co/t/query-duration-too-high-for-200g-logs-a-day/98117)

<div class="topic-metadata">

**Author:** [@Moshe\_Saada](https://discuss.elastic.co/u/Moshe_Saada)\
**Replies:** 6\
**Last updated:** [August 28, 2017, 10:46am UTC](https://discuss.elastic.co/t/query-duration-too-high-for-200g-logs-a-day/98117 "2017-08-28T10:46:03Z")

</div>

Hi, We're using ES cluster (version 5.4.1) with 4 data nodes, 3 master, one client node (kibana). The data nodes are r4.2xlarge aws instance (61g memory, 8vCPU) with 30G memory allocated for the ES JAVA. We have writi…

---

## [Partly downgrade 5.5.2 to 5.1.2 possible?](https://discuss.elastic.co/t/partly-downgrade-5-5-2-to-5-1-2-possible/98520)

<div class="topic-metadata">

**Author:** [@asp](https://discuss.elastic.co/u/asp)\
**Replies:** 6\
**Last updated:** [August 28, 2017, 10:18am UTC](https://discuss.elastic.co/t/partly-downgrade-5-5-2-to-5-1-2-possible/98520 "2017-08-28T10:18:16Z")

</div>

Hi, I am planing to upgrade the ELK stack from 5.1.2 to 5.5.2. We are using daily index rotating. Is anything happening with the old indices, which have been created with kibana 5.1.2 and where no new data has been ad…

---

## [Query for X Y or Z using match](https://discuss.elastic.co/t/query-for-x-y-or-z-using-match/98217)

<div class="topic-metadata">

**Author:** [@tomer](https://discuss.elastic.co/u/tomer)\
**Replies:** 2\
**Last updated:** [August 28, 2017, 9:20am UTC](https://discuss.elastic.co/t/query-for-x-y-or-z-using-match/98217 "2017-08-28T09:20:23Z")

</div>

Continuing the discussion from Query (must be X) and (must (Z or Y): Hi I built: GET filebeat-\*/log/\_search { "query": { "bool":{ "must": \[ "should" : \[ {"match" : {"clientId": "t…

---

## [Using Elastic Search to Crawl Web Pages with Query Parameters](https://discuss.elastic.co/t/using-elastic-search-to-crawl-web-pages-with-query-parameters/98512)

<div class="topic-metadata">

**Author:** [@vikram404](https://discuss.elastic.co/u/vikram404)\
**Replies:** 1\
**Last updated:** [August 28, 2017, 8:04am UTC](https://discuss.elastic.co/t/using-elastic-search-to-crawl-web-pages-with-query-parameters/98512 "2017-08-28T08:04:05Z")

</div>

Hi, I am new to Elastic Stack and we are planning to do a Proof of Concept with Elastic Stack to evaluate if it meets our Search Engine Needs. One of the key requirements we have is to be able to crawl websites that ha…

---

## [Elasticsearch php client setting parameters](https://discuss.elastic.co/t/elasticsearch-php-client-setting-parameters/97844)

<div class="topic-metadata">

**Author:** [@Akhil\_Prashar](https://discuss.elastic.co/u/Akhil_Prashar)\
**Replies:** 2\
**Last updated:** [August 28, 2017, 4:41am UTC](https://discuss.elastic.co/t/elasticsearch-php-client-setting-parameters/97844 "2017-08-28T04:41:24Z")

</div>

Can anyone tell me what’s wrong with this statement? $params\[‘body’\]\[‘query’\]\[‘bool’\]\[‘must’\]\[‘range’\]\[‘created\_at’\]\[‘gte’\] = $from\[‘lte’\] = $to\[‘should’\]\[ ‘match’\]\[’\_all’\]\[$datasourcefields\] = $keyword; Thanks, Akhil …

---

## [Problem due to number of fields limitation in ES 5.5.2](https://discuss.elastic.co/t/problem-due-to-number-of-fields-limitation-in-es-5-5-2/97508)

<div class="topic-metadata">

**Author:** [@karthiga\_sivaraman](https://discuss.elastic.co/u/karthiga_sivaraman)\
**Replies:** 4\
**Last updated:** [August 28, 2017, 4:08am UTC](https://discuss.elastic.co/t/problem-due-to-number-of-fields-limitation-in-es-5-5-2/97508 "2017-08-28T04:08:27Z")

</div>

Currently in production environment we are using ES-2.4.1 with our own dynamic mapping ( our data in ES is Graph JSON ) . The max document count in Index as-if now is 4,29,890 with n-number of fields. Now we are plannin…

---

## [Basic and proper start with NEST library](https://discuss.elastic.co/t/basic-and-proper-start-with-nest-library/98334)

<div class="topic-metadata">

**Author:** [@nmathur](https://discuss.elastic.co/u/nmathur)\
**Replies:** 1\
**Last updated:** [August 28, 2017, 3:36am UTC](https://discuss.elastic.co/t/basic-and-proper-start-with-nest-library/98334 "2017-08-28T03:36:16Z")

</div>

Hello, We are planning to use ElasticSearch NEST for our current project. Tried to prepare a small sample but stuck. Need help. Here is my query… we have very complex data structure … many tables are not linked through…

---

## [ES scripting help](https://discuss.elastic.co/t/es-scripting-help/97170)

<div class="topic-metadata">

**Author:** [@Ramon\_Zaro](https://discuss.elastic.co/u/Ramon_Zaro)\
**Replies:** 2\
**Last updated:** [August 28, 2017, 3:23am UTC](https://discuss.elastic.co/t/es-scripting-help/97170 "2017-08-28T03:23:22Z")

</div>

Hi all, I am developing a filesearch solution using fscrawler to push data into ES 5.5.0 the issue I am facing is a fields explosion (it’s crossing 1000 fields in no time) as fscrawler creates new fields dynamically, 9…

---

## [Elasticsearch not load balanced](https://discuss.elastic.co/t/elasticsearch-not-load-balanced/98499)

<div class="topic-metadata">

**Author:** [@zjzhiqian](https://discuss.elastic.co/u/zjzhiqian)\
**Replies:** 0\
**Last updated:** [August 28, 2017, 3:17am UTC](https://discuss.elastic.co/t/elasticsearch-not-load-balanced/98499 "2017-08-28T03:17:18Z")

</div>

there are 7 elasticsearch instance , node 4 and node6 are coordination node . I send rest http request to node 4 and node6 (data=false & master = false ), but i found the io-read in node1 heavily higher than other nodes…

---

## [Async Replication across Clusters in separate Data Center's](https://discuss.elastic.co/t/async-replication-across-clusters-in-separate-data-centers/98419)

<div class="topic-metadata">

**Author:** [@Sunny\_Goel](https://discuss.elastic.co/u/Sunny_Goel)\
**Replies:** 4\
**Last updated:** [August 27, 2017, 10:06pm UTC](https://discuss.elastic.co/t/async-replication-across-clusters-in-separate-data-centers/98419 "2017-08-27T22:06:35Z")

</div>

Hi, We are presently running ES v 2.4.1 so wanted to check, does that support Async replication across clusters or not ? Currently we’re loading data in all production clusters separately via. IIB. What’s the best sol…

---

## [Query with multiple nested filter on same path not working](https://discuss.elastic.co/t/query-with-multiple-nested-filter-on-same-path-not-working/98489)

<div class="topic-metadata">

**Author:** [@vishee](https://discuss.elastic.co/u/vishee)\
**Replies:** 0\
**Last updated:** [August 27, 2017, 9:21pm UTC](https://discuss.elastic.co/t/query-with-multiple-nested-filter-on-same-path-not-working/98489 "2017-08-27T21:21:23Z")

</div>

I have a query where there are 2 nested filters as follows (generated via Java API): GET pay/\_search { "size" : 1000, "query" : { "bool" : { "filter" : \[ { "bool" : { "must" :…

---

## [How to Add hash response in the params body of Elasticsearch PHP API](https://discuss.elastic.co/t/how-to-add-hash-response-in-the-params-body-of-elasticsearch-php-api/98484)

<div class="topic-metadata">

**Author:** [@rkhapre](https://discuss.elastic.co/u/rkhapre)\
**Replies:** 0\
**Last updated:** [August 27, 2017, 5:16pm UTC](https://discuss.elastic.co/t/how-to-add-hash-response-in-the-params-body-of-elasticsearch-php-api/98484 "2017-08-27T17:16:16Z")

</div>

Hi I have tweeter response , which i get using REST URL code. print\_r($tweets) ; This response is in hash key format like this stdClass Object ( \[statuses\] =\> Array ( \[0\] =\> stdClass Object ( \[created\_at\] =\> Sat Aug …

---

## [Elasticsearch 6 beta 1 - correct way to create a default template](https://discuss.elastic.co/t/elasticsearch-6-beta-1-correct-way-to-create-a-default-template/98483)

<div class="topic-metadata">

**Author:** [@randude](https://discuss.elastic.co/u/randude)\
**Replies:** 0\
**Last updated:** [August 27, 2017, 4:42pm UTC](https://discuss.elastic.co/t/elasticsearch-6-beta-1-correct-way-to-create-a-default-template/98483 "2017-08-27T16:42:34Z")

</div>

Hi, So in the new docs I see that the default (with underscores before and after) mapping is deprecated or at least it should be since there can be only one doc type anyways. However, when I done define a logstash temp…

---

## [Curator 5.1](https://discuss.elastic.co/t/curator-5-1/98019)

<div class="topic-metadata">

**Author:** [@mruthyu](https://discuss.elastic.co/u/mruthyu)\
**Replies:** 4\
**Last updated:** [August 27, 2017, 4:29pm UTC](https://discuss.elastic.co/t/curator-5-1/98019 "2017-08-27T16:29:35Z")

</div>

Whether Curator 5.1 can run on Python 2.7.5 version?

---

## [Curator log path setting](https://discuss.elastic.co/t/curator-log-path-setting/98203)

<div class="topic-metadata">

**Author:** [@mruthyu](https://discuss.elastic.co/u/mruthyu)\
**Replies:** 2\
**Last updated:** [August 27, 2017, 4:28pm UTC](https://discuss.elastic.co/t/curator-log-path-setting/98203 "2017-08-27T16:28:44Z")

</div>

Is there a way to set the daily rolling log file for the curator? logging: loglevel: INFO logfile:/tmp/curator.log logformat: default blacklist: \[‘elasticsearch’, ‘urllib3’\]

---

## [How to change the timeout about process published state default 30s](https://discuss.elastic.co/t/how-to-change-the-timeout-about-process-published-state-default-30s/98463)

<div class="topic-metadata">

**Author:** [@zqc0512](https://discuss.elastic.co/u/zqc0512)\
**Replies:** 1\
**Last updated:** [August 27, 2017, 2:50pm UTC](https://discuss.elastic.co/t/how-to-change-the-timeout-about-process-published-state-default-30s/98463 "2017-08-27T14:50:55Z")

</div>

timed out waiting for all nodes to process published state timed out waiting for all nodes to process published state \[43\] (timeout \[30s\], pending nodes:

---

## [Elasticsearch date format am pm](https://discuss.elastic.co/t/elasticsearch-date-format-am-pm/98470)

<div class="topic-metadata">

**Author:** [@svarup](https://discuss.elastic.co/u/svarup)\
**Replies:** 2\
**Last updated:** [August 27, 2017, 2:41pm UTC](https://discuss.elastic.co/t/elasticsearch-date-format-am-pm/98470 "2017-08-27T14:41:01Z")

</div>

In elasticsearch how to index a doc with date format 2017-08-27 01:34:15 PM

---

## [ElasticSearch 5.5 Variable is not defined on using doc\['fieldname\]](https://discuss.elastic.co/t/elasticsearch-5-5-variable-is-not-defined-on-using-doc-fieldname/98478)

<div class="topic-metadata">

**Author:** [@Faizan\_Sofi](https://discuss.elastic.co/u/Faizan_Sofi)\
**Replies:** 0\
**Last updated:** [August 27, 2017, 2:36pm UTC](https://discuss.elastic.co/t/elasticsearch-5-5-variable-is-not-defined-on-using-doc-fieldname/98478 "2017-08-27T14:36:59Z")

</div>

On using this agg query i get expected results curl -XPOST ‘localhost:9200/…/…/\_search?pretty’ -H ‘Content-Type: application/json’ -d’ { “aggregations”: { "IMPRESSIONS": { …

---

## [Is it safe to clear filesystem cache](https://discuss.elastic.co/t/is-it-safe-to-clear-filesystem-cache/97754)

<div class="topic-metadata">

**Author:** [@596375269](https://discuss.elastic.co/u/596375269)\
**Replies:** 1\
**Last updated:** [August 27, 2017, 10:22am UTC](https://discuss.elastic.co/t/is-it-safe-to-clear-filesystem-cache/97754 "2017-08-27T10:22:18Z")

</div>

hello everyone When I import millions of data in bulk, I encountered a problem. The memory usage of the cluster servers increased rapidly, from 50% to about 90%, and after finished importing ,the occupied memories come…

---

## [Range filters with query\_String and function score returning zero results](https://discuss.elastic.co/t/range-filters-with-query-string-and-function-score-returning-zero-results/98472)

<div class="topic-metadata">

**Author:** [@asvishen](https://discuss.elastic.co/u/asvishen)\
**Replies:** 0\
**Last updated:** [August 27, 2017, 10:13am UTC](https://discuss.elastic.co/t/range-filters-with-query-string-and-function-score-returning-zero-results/98472 "2017-08-27T10:13:48Z")

</div>

I have been trying to get the function score query to work with range filters and query\_string query. I am using the field\_value\_factor inside the function score as well as the range filters and query\_string. Using the q…

---

## [ElasticSearch for +500gb Audit Trail](https://discuss.elastic.co/t/elasticsearch-for-500gb-audit-trail/98399)

<div class="topic-metadata">

**Author:** [@ncarlini](https://discuss.elastic.co/u/ncarlini)\
**Replies:** 3\
**Last updated:** [August 26, 2017, 9:26pm UTC](https://discuss.elastic.co/t/elasticsearch-for-500gb-audit-trail/98399 "2017-08-26T21:26:14Z")

</div>

We are designing new applications and we are thinking of solutions for audit trail. We need to store 10 years of user transactions (clicks, changes, text they write, etc.). On our current SQL DB this is about 400 gb of i…

---

## [Using multiple analyzer in query](https://discuss.elastic.co/t/using-multiple-analyzer-in-query/98316)

<div class="topic-metadata">

**Author:** [@priyank](https://discuss.elastic.co/u/priyank)\
**Replies:** 1\
**Last updated:** [August 26, 2017, 7:45pm UTC](https://discuss.elastic.co/t/using-multiple-analyzer-in-query/98316 "2017-08-26T19:45:40Z")

</div>

I want to implement Synonym and Stopword Filters in my query. For that I created analayers and both are working fine individual. But I want to use them both how can I? GET my\_index/\_search/ { "query": { "mat…

---

## [Elasticsearch scripting engine](https://discuss.elastic.co/t/elasticsearch-scripting-engine/98424)

<div class="topic-metadata">

**Author:** [@prasperl](https://discuss.elastic.co/u/prasperl)\
**Replies:** 3\
**Last updated:** [August 26, 2017, 4:58pm UTC](https://discuss.elastic.co/t/elasticsearch-scripting-engine/98424 "2017-08-26T16:58:28Z")

</div>

I am using elasticsearch 5.5 and I am trying to implement my own scoring algorithm to calculate the edit distance and come up with a custom score. I found lot of good examples of native scripts to do this,but since nati…

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1965)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1967)
