# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1857

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1858

---

## [How can I get only products that have at least one trusted seller?](https://discuss.elastic.co/t/how-can-i-get-only-products-that-have-at-least-one-trusted-seller/111344)

<div class="topic-metadata">

**Author:** [@Claudio\_Ranieri](https://discuss.elastic.co/u/Claudio_Ranieri)\
**Replies:** 2\
**Last updated:** [December 12, 2017, 5:53pm UTC](https://discuss.elastic.co/t/how-can-i-get-only-products-that-have-at-least-one-trusted-seller/111344 "2017-12-12T17:53:19Z")

</div>

I have documents with nested seller as shown below: { name: Product A, sellers: \[ {id: 1011}, {id: 2020} \] }, { name: Product B, sellers: \[ {id: 1011}, {id: 6050} \] }, { name: Product C, sellers: \[ {id:…

---

## [Elasticsearch 5.0.1 virtual memory overflow](https://discuss.elastic.co/t/elasticsearch-5-0-1-virtual-memory-overflow/111023)

<div class="topic-metadata">

**Author:** [@Prateek\_Gupta](https://discuss.elastic.co/u/Prateek_Gupta)\
**Replies:** 1\
**Last updated:** [December 12, 2017, 5:36pm UTC](https://discuss.elastic.co/t/elasticsearch-5-0-1-virtual-memory-overflow/111023 "2017-12-12T17:36:05Z")

</div>

I am using ElasticSearch 5.0.1 with Xmx and Xms as 8GB on a Linux machine. The main memory usage is under control but the virtual memory usage is around 420GB for ElasticSearch process. Custom properties set under elasti…

---

## [Understanding depricated field type - Error: Rejecting mapping update to ... final mapping would have more than 1 type](https://discuss.elastic.co/t/understanding-depricated-field-type-error-rejecting-mapping-update-to-final-mapping-would-have-more-than-1-type/108674)

<div class="topic-metadata">

**Author:** [@asp](https://discuss.elastic.co/u/asp)\
**Replies:** 5\
**Last updated:** [December 12, 2017, 5:34pm UTC](https://discuss.elastic.co/t/understanding-depricated-field-type-error-rejecting-mapping-update-to-final-mapping-would-have-more-than-1-type/108674 "2017-12-12T17:34:59Z")

</div>

Hi, I've read that the type field in ES 6.0.0 is depricated and that it is planed to remove it in 7.0.0. Did I catch this correctly? If so, I've got a question about how to understand the new paradigm / the thoughts b…

---

## [Definition of index-templates for whole sub-structures needed?](https://discuss.elastic.co/t/definition-of-index-templates-for-whole-sub-structures-needed/110647)

<div class="topic-metadata">

**Author:** [@ppuschmann](https://discuss.elastic.co/u/ppuschmann)\
**Replies:** 2\
**Last updated:** [December 12, 2017, 5:31pm UTC](https://discuss.elastic.co/t/definition-of-index-templates-for-whole-sub-structures-needed/110647 "2017-12-12T17:31:25Z")

</div>

Hi, we're currently having an interesting issue with our field-definitions and type-detection. We have fields in our documents that sometimes contain integers, sometimes some strings. In the documentation we find some…

---

## [Elasticsearch data node fail to join the cluster](https://discuss.elastic.co/t/elasticsearch-data-node-fail-to-join-the-cluster/110710)

<div class="topic-metadata">

**Author:** [@zozo6015](https://discuss.elastic.co/u/zozo6015)\
**Replies:** 14\
**Last updated:** [December 12, 2017, 5:17pm UTC](https://discuss.elastic.co/t/elasticsearch-data-node-fail-to-join-the-cluster/110710 "2017-12-12T17:17:23Z")

</div>

Hello I have an elasticsearch 6.0.0 cluster running on GCE environment and I want to add a data node but this node is failing to join the cluster. I am getting the following in the logs: 2017-12-07T15:50:42,782\]\[WARN …

---

## [Not whitelisted in reindex.remote.whitelist](https://discuss.elastic.co/t/not-whitelisted-in-reindex-remote-whitelist/111070)

<div class="topic-metadata">

**Author:** [@michael\_gadaev](https://discuss.elastic.co/u/michael_gadaev)\
**Replies:** 7\
**Last updated:** [December 12, 2017, 5:13pm UTC](https://discuss.elastic.co/t/not-whitelisted-in-reindex-remote-whitelist/111070 "2017-12-12T17:13:52Z")

</div>

hi all .. please help me with my strange issue ; I want to reindex my old data from 2.3 cluster to 6.0 I tried 2 ways : with reindex.remote.whitelist :: I put my remote host in yaml : reindex.remote.whitelist: 'es…

---

## [Elasticsearch offset/time\_zone appears to have no impact over date\_histogram keys](https://discuss.elastic.co/t/elasticsearch-offset-time-zone-appears-to-have-no-impact-over-date-histogram-keys/111341)

<div class="topic-metadata">

**Author:** [@mjunaidmuzammil](https://discuss.elastic.co/u/mjunaidmuzammil)\
**Replies:** 1\
**Last updated:** [December 12, 2017, 5:12pm UTC](https://discuss.elastic.co/t/elasticsearch-offset-time-zone-appears-to-have-no-impact-over-date-histogram-keys/111341 "2017-12-12T17:12:58Z")

</div>

Hi, I am currently working over Elasticsearch version 5.6.5. I encountered a strange problem while working with date\_histogram aggregators. curl -XGET 'localhost:9200' { "name" : "8QffyF\_", "cluster\_name" : "elasti…

---

## [What does “column stride field” mean regarding “doc values ” in elasticsearch/lecune](https://discuss.elastic.co/t/what-does-column-stride-field-mean-regarding-doc-values-in-elasticsearch-lecune/111332)

<div class="topic-metadata">

**Author:** [@nadiGam](https://discuss.elastic.co/u/nadiGam)\
**Replies:** 3\
**Last updated:** [December 12, 2017, 4:56pm UTC](https://discuss.elastic.co/t/what-does-column-stride-field-mean-regarding-doc-values-in-elasticsearch-lecune/111332 "2017-12-12T16:56:04Z")

</div>

I post this question also in stackoverflow : I'm trying to understand specifically what does colum-stride mean ? and why is this so efficient for sorting/aggregation ? is it just the fact that there's a mapping fro…

---

## [Docker images with x-pack basic?](https://discuss.elastic.co/t/docker-images-with-x-pack-basic/111387)

<div class="topic-metadata">

**Author:** [@prophoto](https://discuss.elastic.co/u/prophoto)\
**Replies:** 1\
**Last updated:** [December 12, 2017, 4:49pm UTC](https://discuss.elastic.co/t/docker-images-with-x-pack-basic/111387 "2017-12-12T16:49:13Z")

</div>

I've been looking around but can't find docker images for v6 with x-pack basic, can someone point me in the right place?

---

## [Failed to Re-index before 5 -\> 6 Upgrade, now what?](https://discuss.elastic.co/t/failed-to-re-index-before-5-6-upgrade-now-what/111166)

<div class="topic-metadata">

**Author:** [@ben-10](https://discuss.elastic.co/u/ben-10)\
**Replies:** 2\
**Last updated:** [December 12, 2017, 4:28pm UTC](https://discuss.elastic.co/t/failed-to-re-index-before-5-6-upgrade-now-what/111166 "2017-12-12T16:28:13Z")

</div>

On one of my ES clusters, I failed the step to re-index before upgrading from 3.3 to 3.5.6 to 6.0.1 so naturally my data node fails to start citing errors about being unable to upgrade mappings for various indexes. Is t…

---

## [java.lang.IllegalArgumentException: Invalid format - date problem](https://discuss.elastic.co/t/java-lang-illegalargumentexception-invalid-format-date-problem/110833)

<div class="topic-metadata">

**Author:** [@rromanovic](https://discuss.elastic.co/u/rromanovic)\
**Replies:** 1\
**Last updated:** [December 12, 2017, 4:07pm UTC](https://discuss.elastic.co/t/java-lang-illegalargumentexception-invalid-format-date-problem/110833 "2017-12-12T16:07:09Z")

</div>

Hi, I'm having problems with storing date in "yyyy-MM-dd HH:mm:ss,SSS" format in index. The format I'm reading from log file is "yyyy-MM-dd HH:mm:ss.SSSS", for example "2017-10-31 05:00:00.4216". First, I'm creating f…

---

## [Elasticsearch Pipeline - Hash Message with sha1](https://discuss.elastic.co/t/elasticsearch-pipeline-hash-message-with-sha1/111378)

<div class="topic-metadata">

**Author:** [@Vladimir\_Herrlein](https://discuss.elastic.co/u/Vladimir_Herrlein)\
**Replies:** 0\
**Last updated:** [December 12, 2017, 3:57pm UTC](https://discuss.elastic.co/t/elasticsearch-pipeline-hash-message-with-sha1/111378 "2017-12-12T15:57:49Z")

</div>

Dear all, I would like share with you the way found to generate the document\_id during the ingest phase via a custom painless script by making the SHA1 hash based on the message field. The Pipeline test: POST \_ingest/…

---

## [ES Docker with Jenkins](https://discuss.elastic.co/t/es-docker-with-jenkins/111380)

<div class="topic-metadata">

**Author:** [@lask001](https://discuss.elastic.co/u/lask001)\
**Replies:** 0\
**Last updated:** [December 12, 2017, 4:03pm UTC](https://discuss.elastic.co/t/es-docker-with-jenkins/111380 "2017-12-12T16:03:32Z")

</div>

I'm running into a few issues with the ES maintained docker image and getting it to run within a Jenkins pipeline. If I run the container manually via the docker run command it works correctly; I am able to use docker ex…

---

## [Problem with \_cat/indices, \_cat/nodes, \_cat/allocation with Elasticsearch6.0.1](https://discuss.elastic.co/t/problem-with-cat-indices-cat-nodes-cat-allocation-with-elasticsearch6-0-1/111370)

<div class="topic-metadata">

**Author:** [@Louise](https://discuss.elastic.co/u/Louise)\
**Replies:** 2\
**Last updated:** [December 12, 2017, 3:47pm UTC](https://discuss.elastic.co/t/problem-with-cat-indices-cat-nodes-cat-allocation-with-elasticsearch6-0-1/111370 "2017-12-12T15:47:13Z")

</div>

Hello, I have just migrated to elasticsearch 6.0.1 (I was using 5.6.5 before). I have some problem with cat API as when I : GET /\_cat/allocation?v GET /\_cat/indices?v GET /\_cat/nodes I receive this message { "error"…

---

## ["main ERROR Null object" after update 5.6.1 =\> 6.0.1](https://discuss.elastic.co/t/main-error-null-object-after-update-5-6-1-6-0-1/111057)

<div class="topic-metadata">

**Author:** [@Jelen](https://discuss.elastic.co/u/Jelen)\
**Replies:** 5\
**Last updated:** [December 12, 2017, 3:41pm UTC](https://discuss.elastic.co/t/main-error-null-object-after-update-5-6-1-6-0-1/111057 "2017-12-12T15:41:55Z")

</div>

Hello, after updating elastic, I get this error: root@Lisa:~# service elasticsearch status ● elasticsearch.service - Elasticsearch Loaded: loaded (/usr/lib/systemd/system/elasticsearch.service; enabled; vendor prese…

---

## [Error running example track](https://discuss.elastic.co/t/error-running-example-track/110743)

<div class="topic-metadata">

**Author:** [@Ankit3](https://discuss.elastic.co/u/Ankit3)\
**Replies:** 8\
**Last updated:** [December 12, 2017, 3:06pm UTC](https://discuss.elastic.co/t/error-running-example-track/110743 "2017-12-12T15:06:42Z")

</div>

Hi , I am trying to follow rally track example mentioned at http://esrally.readthedocs.io/en/stable/adding\_tracks.html .I just copy -pasted track.json and faced one comma error at line 30 . After fixing that i am getti…

---

## [Creating a dashboard using two log files (foreign key in elasticsearch)](https://discuss.elastic.co/t/creating-a-dashboard-using-two-log-files-foreign-key-in-elasticsearch/109765)

<div class="topic-metadata">

**Author:** [@cilzzz](https://discuss.elastic.co/u/cilzzz)\
**Replies:** 2\
**Last updated:** [December 12, 2017, 1:46pm UTC](https://discuss.elastic.co/t/creating-a-dashboard-using-two-log-files-foreign-key-in-elasticsearch/109765 "2017-12-12T13:46:43Z")

</div>

\[cmdb\] \[tsm-server\] Hey everyone, i have two large csv file as showing below on for the database and one for a backup server. After filtering the cmdb file i need specify the name of the application (Parent\_Nom) which …

---

## [Linguistic analysis](https://discuss.elastic.co/t/linguistic-analysis/111297)

<div class="topic-metadata">

**Author:** [@pavuk](https://discuss.elastic.co/u/pavuk)\
**Replies:** 4\
**Last updated:** [December 12, 2017, 1:07pm UTC](https://discuss.elastic.co/t/linguistic-analysis/111297 "2017-12-12T13:07:15Z")

</div>

Hi Elasticsearch experts! I would like to ask a question concerning the possibility of linguistic analysis. Can I handle the incoming text stream with the help of Elastic stack so that I get an analysis of key phrases, …

---

## [Xpack Machine Learning Java api and Curl command](https://discuss.elastic.co/t/xpack-machine-learning-java-api-and-curl-command/111240)

<div class="topic-metadata">

**Author:** [@jiouser](https://discuss.elastic.co/u/jiouser)\
**Replies:** 3\
**Last updated:** [December 12, 2017, 12:19pm UTC](https://discuss.elastic.co/t/xpack-machine-learning-java-api-and-curl-command/111240 "2017-12-12T12:19:42Z")

</div>

We are trying out ML feature of XPack 6.0.1. From kibana following the tutorials we are able to make it work. However, I am trying to achieve the same using the JAVA library. I can only get the instance of XPack and ML…

---

## [Bug ES6 JAVA API: Elasticsearch returning all the indices while trying to get only those indices which are associated with specific alias](https://discuss.elastic.co/t/bug-es6-java-api-elasticsearch-returning-all-the-indices-while-trying-to-get-only-those-indices-which-are-associated-with-specific-alias/110914)

<div class="topic-metadata">

**Author:** [@antitech](https://discuss.elastic.co/u/antitech)\
**Replies:** 5\
**Last updated:** [December 12, 2017, 11:39am UTC](https://discuss.elastic.co/t/bug-es6-java-api-elasticsearch-returning-all-the-indices-while-trying-to-get-only-those-indices-which-are-associated-with-specific-alias/110914 "2017-12-12T11:39:19Z")

</div>

I have recently upgraded application from Elastic search 5.3.1 to 6.0. My requirement was to get all the indices which were associated with specific alias. I used below mentioned snippet to fetch all indices associated…

---

## [More about recovery process detail](https://discuss.elastic.co/t/more-about-recovery-process-detail/110533)

<div class="topic-metadata">

**Author:** [@ginger](https://discuss.elastic.co/u/ginger)\
**Replies:** 5\
**Last updated:** [December 12, 2017, 11:28am UTC](https://discuss.elastic.co/t/more-about-recovery-process-detail/110533 "2017-12-12T11:28:25Z")

</div>

Hi, all. I want to learn more about the remote recovery process in ES 5.x. Through reading code, the recovery process is as following: phase1(index)-\>phase2(translog)-\>finalizeRecovery. As far as I know, operations is s…

---

## [Identify and delete duplicates on several indexes](https://discuss.elastic.co/t/identify-and-delete-duplicates-on-several-indexes/111317)

<div class="topic-metadata">

**Author:** [@zeusviper](https://discuss.elastic.co/u/zeusviper)\
**Replies:** 0\
**Last updated:** [December 12, 2017, 11:21am UTC](https://discuss.elastic.co/t/identify-and-delete-duplicates-on-several-indexes/111317 "2017-12-12T11:21:55Z")

</div>

Hello, I search a lot in the threads but still can't find a solution. Following to issue with my batch, I got to refeed my elastic but like I use some dated index, the \_id param was not sufficient to keep some unicity.…

---

## [ELK Database with Error Analysis](https://discuss.elastic.co/t/elk-database-with-error-analysis/111316)

<div class="topic-metadata">

**Author:** [@Goldberg](https://discuss.elastic.co/u/Goldberg)\
**Replies:** 0\
**Last updated:** [December 12, 2017, 11:20am UTC](https://discuss.elastic.co/t/elk-database-with-error-analysis/111316 "2017-12-12T11:20:52Z")

</div>

Hello all, I'm completly new to elasticsearch. I just want to get some opinions from some folk about a project i'm currently working on. Project: I want to visulize data which is coming from out database ( 35 columns …

---

## ['And' effect search for multiple nested object](https://discuss.elastic.co/t/and-effect-search-for-multiple-nested-object/111148)

<div class="topic-metadata">

**Author:** [@johntadd](https://discuss.elastic.co/u/johntadd)\
**Replies:** 1\
**Last updated:** [December 12, 2017, 10:57am UTC](https://discuss.elastic.co/t/and-effect-search-for-multiple-nested-object/111148 "2017-12-12T10:57:50Z")

</div>

I have a complicated mapping where multiple levels of nested objects contain information e.g. level3\_attr1 and level4\_attr1 I want to search. mappings : { mytype: { properties: { level1tag: { …

---

## [Clear Cache After Bulk Insertion](https://discuss.elastic.co/t/clear-cache-after-bulk-insertion/111081)

<div class="topic-metadata">

**Author:** [@shemilr](https://discuss.elastic.co/u/shemilr)\
**Replies:** 8\
**Last updated:** [December 12, 2017, 11:07am UTC](https://discuss.elastic.co/t/clear-cache-after-bulk-insertion/111081 "2017-12-12T11:07:21Z")

</div>

I am creating index which have 1 million data. I have many indexes with similar size. After creatng some indexes, this bulk insertion is too slow. If we are restarting the elasticsearch service in server, insert will be …

---

## [Document created even though only 1 node is active](https://discuss.elastic.co/t/document-created-even-though-only-1-node-is-active/111311)

<div class="topic-metadata">

**Author:** [@Alex\_Davidovich](https://discuss.elastic.co/u/Alex_Davidovich)\
**Replies:** 0\
**Last updated:** [December 12, 2017, 11:03am UTC](https://discuss.elastic.co/t/document-created-even-though-only-1-node-is-active/111311 "2017-12-12T11:03:22Z")

</div>

I have 3 nodes cluster with discovery.zen.minimum\_master\_nodes set to 2. 1 shard with 2 replicas. I kill -9 2 nodes of ES. After killing the second node, a document is sent via index API using transport client. 100 m…

---

## [Upgrade to NEST 5.0.0.0 and Elastic search 5.0.0.0 issue error 400 but with Kibana it is working fine and extracts result](https://discuss.elastic.co/t/upgrade-to-nest-5-0-0-0-and-elastic-search-5-0-0-0-issue-error-400-but-with-kibana-it-is-working-fine-and-extracts-result/110301)

<div class="topic-metadata">

**Author:** [@dibyajyoti\_dev](https://discuss.elastic.co/u/dibyajyoti_dev)\
**Replies:** 4\
**Last updated:** [December 12, 2017, 10:50am UTC](https://discuss.elastic.co/t/upgrade-to-nest-5-0-0-0-and-elastic-search-5-0-0-0-issue-error-400-but-with-kibana-it-is-working-fine-and-extracts-result/110301 "2017-12-12T10:50:58Z")

</div>

Hi , I got upgraded my MVC app to NEST and elastic version 5.0.0.0 and as I see the documentation about size parameter should be greater than 0 i did put Size(10). as below. var response = Elastic .Search(selector =\>…

---

## [GC s1 always used 100%, never less than 100%](https://discuss.elastic.co/t/gc-s1-always-used-100-never-less-than-100/111076)

<div class="topic-metadata">

**Author:** [@Robin\_Guo](https://discuss.elastic.co/u/Robin_Guo)\
**Replies:** 3\
**Last updated:** [December 12, 2017, 10:30am UTC](https://discuss.elastic.co/t/gc-s1-always-used-100-never-less-than-100/111076 "2017-12-12T10:30:00Z")

</div>

Hi Folks, I change from cms GC into g1 GC because of reducing of FGC during a week, but S1 got the problem like this. Is it okay? How can we avoid this situation? we have 300 servers send metrics to logstash ,and the…

---

## [Cross-aggregartion calculation](https://discuss.elastic.co/t/cross-aggregartion-calculation/110963)

<div class="topic-metadata">

**Author:** [@gilisade](https://discuss.elastic.co/u/gilisade)\
**Replies:** 1\
**Last updated:** [December 12, 2017, 10:27am UTC](https://discuss.elastic.co/t/cross-aggregartion-calculation/110963 "2017-12-12T10:27:54Z")

</div>

hi I have 4 aggregations - each runs on a different field. "aggs": { "URL\_1": { "terms": { "field": "URL\_1", "size": 1000 },"aggs": { "src\_count": { "cardinality": { …

---

## [How to Get formatted Source](https://discuss.elastic.co/t/how-to-get-formatted-source/111273)

<div class="topic-metadata">

**Author:** [@aneesh](https://discuss.elastic.co/u/aneesh)\
**Replies:** 0\
**Last updated:** [December 12, 2017, 8:43am UTC](https://discuss.elastic.co/t/how-to-get-formatted-source/111273 "2017-12-12T08:43:07Z")

</div>

I just want the actual data as array from ElasticSearch and not the meta related to that. Following is the my code. After getting the data from ES, I need to parse that and select the "\_source" from there. That way it …

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1856)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1858)
