# Elasticsearch **URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1972 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1973 --- ## [How do you think about ES hot/warm architecture](https://discuss.elastic.co/t/how-do-you-think-about-es-hot-warm-architecture/97882)
**Author:** [@no\_jihun](https://discuss.elastic.co/u/no_jihun)\ **Replies:** 1\ **Last updated:** [August 22, 2017, 9:36am UTC](https://discuss.elastic.co/t/how-do-you-think-about-es-hot-warm-architecture/97882 "2017-08-22T09:36:17Z")
Generally, I think warm node can act like hot node, but slowly. And machine cost a lot saved. But ES runs on Memory and require sufficient memory to process request regardless of how it fast. Memory is the most expensi… --- ## [Elasticsearch PHP client pass value to query from array](https://discuss.elastic.co/t/elasticsearch-php-client-pass-value-to-query-from-array/97887)
**Author:** [@moabbas](https://discuss.elastic.co/u/moabbas)\ **Replies:** 0\ **Last updated:** [August 22, 2017, 9:35am UTC](https://discuss.elastic.co/t/elasticsearch-php-client-pass-value-to-query-from-array/97887 "2017-08-22T09:35:29Z")
Hello, I have an array and need to pass it's value to the query to be fetched. $params=\[ 'index' =\> 'logstash-2017.08.14', 'type' =\> 'xms\_api\_station\_info', 'body' =\> \[ 'query'=\> \[ 'bool'=\> \[ 'must'=\> \[ 'match… --- ## [Initializing shards in updating non dynamic setting of Elasticsearch index](https://discuss.elastic.co/t/initializing-shards-in-updating-non-dynamic-setting-of-elasticsearch-index/97881)
**Author:** [@karniw](https://discuss.elastic.co/u/karniw)\ **Replies:** 2\ **Last updated:** [August 22, 2017, 9:16am UTC](https://discuss.elastic.co/t/initializing-shards-in-updating-non-dynamic-setting-of-elasticsearch-index/97881 "2017-08-22T09:16:51Z")
Setup: Elasticsearch 1.4.7 (I know it’s old, legacy issues). I need to update non dynamic settings of an index. We’re saving some metadata of the index in the settings. Since the settings are non dynamic I need to close… --- ## [Need help to understand filtered index alias](https://discuss.elastic.co/t/need-help-to-understand-filtered-index-alias/97860)
**Author:** [@elk\_user1](https://discuss.elastic.co/u/elk_user1)\ **Replies:** 1\ **Last updated:** [August 22, 2017, 9:11am UTC](https://discuss.elastic.co/t/need-help-to-understand-filtered-index-alias/97860 "2017-08-22T09:11:49Z")
Hello, I am trying to create an alias with a filter. But when I’m trying to find out the count of the documents under the filtered alias, it shows the total count under the index. And not the count of filtered documents… --- ## [Elasticsearch Service suddenly not working in Ubuntu](https://discuss.elastic.co/t/elasticsearch-service-suddenly-not-working-in-ubuntu/97856)
**Author:** [@TheCthulhuKid](https://discuss.elastic.co/u/TheCthulhuKid)\ **Replies:** 2\ **Last updated:** [August 22, 2017, 8:03am UTC](https://discuss.elastic.co/t/elasticsearch-service-suddenly-not-working-in-ubuntu/97856 "2017-08-22T08:03:55Z")
When I left the office yesterday I was using ES (5.5.2) with no problem on my Ubuntu 16.10 VM as I have been for the last couple of months. This morning I start up the VM and try to access the cluster and get an exceptio… --- ## [Aggregate/count fields on only first X documents](https://discuss.elastic.co/t/aggregate-count-fields-on-only-first-x-documents/97865)
**Author:** [@jomarl](https://discuss.elastic.co/u/jomarl)\ **Replies:** 0\ **Last updated:** [August 22, 2017, 7:35am UTC](https://discuss.elastic.co/t/aggregate-count-fields-on-only-first-x-documents/97865 "2017-08-22T07:35:19Z")
Hi, I have a use-case were I need count the number of docs in the top X documents of my search query that have values in certain fields - taking into consideration different sort orders. E.g. “The X first documents with… --- ## [Mapping for Bytes/percentage format](https://discuss.elastic.co/t/mapping-for-bytes-percentage-format/97430)
**Author:** [@randude](https://discuss.elastic.co/u/randude)\ **Replies:** 3\ **Last updated:** [August 22, 2017, 7:09am UTC](https://discuss.elastic.co/t/mapping-for-bytes-percentage-format/97430 "2017-08-22T07:09:10Z")
Hi, Is there a way to define automatically the format for some fields via a custom mapping? I’m talking about the BYTES or Percentage format. --- ## [Python elasticsearch\_dsl Attachment usage](https://discuss.elastic.co/t/python-elasticsearch-dsl-attachment-usage/97861)
**Author:** [@TheCthulhuKid](https://discuss.elastic.co/u/TheCthulhuKid)\ **Replies:** 0\ **Last updated:** [August 22, 2017, 6:56am UTC](https://discuss.elastic.co/t/python-elasticsearch-dsl-attachment-usage/97861 "2017-08-22T06:56:45Z")
I currently index attachments using the lower level elasticsearch.py. I was wanting to use elasticsearch\_dsl.py but I couldn’t find any examples of how to use it. Could anyone point me in the right direction? And pleas… --- ## [How to add date mapping in existing template](https://discuss.elastic.co/t/how-to-add-date-mapping-in-existing-template/97853)
**Author:** [@Jonesthomas](https://discuss.elastic.co/u/Jonesthomas)\ **Replies:** 5\ **Last updated:** [August 22, 2017, 6:45am UTC](https://discuss.elastic.co/t/how-to-add-date-mapping-in-existing-template/97853 "2017-08-22T06:45:39Z")
i have a default filebeat template, How to add date filed in that existing template.? For example; in log i have Time field as string i need to convert into timestamp field, I tried with logstash , the Time filed is c… --- ## [Supplying settings for custom realm while creating TransportClient](https://discuss.elastic.co/t/supplying-settings-for-custom-realm-while-creating-transportclient/97514)
**Author:** [@sumit\_monga](https://discuss.elastic.co/u/sumit_monga)\ **Replies:** 6\ **Last updated:** [August 22, 2017, 6:28am UTC](https://discuss.elastic.co/t/supplying-settings-for-custom-realm-while-creating-transportclient/97514 "2017-08-22T06:28:36Z")
Hello everyone, I have a custom realm implemented and installed as an extension with X-Pack. Now I need to query ES via java api. I am using below code to create TransportClient TransportClient client = new PreBuiltXPa… --- ## [Indexing, querying and bulk updating against time-based indexes](https://discuss.elastic.co/t/indexing-querying-and-bulk-updating-against-time-based-indexes/97831)
**Author:** [@jthoni](https://discuss.elastic.co/u/jthoni)\ **Replies:** 1\ **Last updated:** [August 22, 2017, 5:16am UTC](https://discuss.elastic.co/t/indexing-querying-and-bulk-updating-against-time-based-indexes/97831 "2017-08-22T05:16:33Z")
We have a system that collects, processes and stores customer generated data. The data comes from multiple streams with varying cadences. Some are near real time, and others 24 to 48 hours delayed. We are currently st… --- ## [Gc problem recently](https://discuss.elastic.co/t/gc-problem-recently/97841)
**Author:** [@whybangbang](https://discuss.elastic.co/u/whybangbang)\ **Replies:** 0\ **Last updated:** [August 22, 2017, 3:32am UTC](https://discuss.elastic.co/t/gc-problem-recently/97841 "2017-08-22T03:32:48Z")
i don't know why gc problem happen recently days, the log is always this: : \[ParNew: 296662K-\>34048K(306688K), 0.0294340 secs\] 5306677K-\>5044854K(8248064K), 0.0295360 secs\] \[Times: user=0.11 sys=0.00, real=0.03 secs\] … --- ## [Reindex Multiple Index](https://discuss.elastic.co/t/reindex-multiple-index/97839)
**Author:** [@jogoinar10](https://discuss.elastic.co/u/jogoinar10)\ **Replies:** 1\ **Last updated:** [August 22, 2017, 2:42am UTC](https://discuss.elastic.co/t/reindex-multiple-index/97839 "2017-08-22T02:42:48Z")
How to reindex with a source of multiple index. I tried to use wildcard (\*) but it doesn’t work. TIA --- ## [Docker image for 6.0.0-beta1 and elastic user password](https://discuss.elastic.co/t/docker-image-for-6-0-0-beta1-and-elastic-user-password/97836)
**Author:** [@fassisrosa](https://discuss.elastic.co/u/fassisrosa)\ **Replies:** 1\ **Last updated:** [August 22, 2017, 2:11am UTC](https://discuss.elastic.co/t/docker-image-for-6-0-0-beta1-and-elastic-user-password/97836 "2017-08-22T02:11:29Z")
Hi there, I am trying to use the 6.0.0-beta1 docker image. I am following instructions but it looks like ‘elastic’ user password is not ‘changeme’ as documented. This works fine with image for ‘5.5.2’. Am I missing some… --- ## [Elasticsearch appears to ignore -XX:+UseG1GC in jvm.options](https://discuss.elastic.co/t/elasticsearch-appears-to-ignore-xx-useg1gc-in-jvm-options/96862)
**Author:** [@goldfish](https://discuss.elastic.co/u/goldfish)\ **Replies:** 14\ **Last updated:** [August 22, 2017, 1:25am UTC](https://discuss.elastic.co/t/elasticsearch-appears-to-ignore-xx-useg1gc-in-jvm-options/96862 "2017-08-22T01:25:28Z")
Hi, We’re running Elasticsearch 5.4.1 on OpenJDK 1.8.0\_141. We recently tried switching from CMS to G1GC by replacing the following lines in jvm.options: -XX:+UseConcMarkSweepGC -XX:CMSInitiatingOccupancyFraction=75 -… --- ## [What is the best way to index of documents when aggregating logs?](https://discuss.elastic.co/t/what-is-the-best-way-to-index-of-documents-when-aggregating-logs/97668)
**Author:** [@zacscoding](https://discuss.elastic.co/u/zacscoding)\ **Replies:** 4\ **Last updated:** [August 22, 2017, 1:09am UTC](https://discuss.elastic.co/t/what-is-the-best-way-to-index-of-documents-when-aggregating-logs/97668 "2017-08-22T01:09:38Z")
I want to use on elasticsearch for saving access log datas from WEB APP or Database Web app logs and Database logs have difference fields respectively. for example, was-access log : “url” : xxx, “session-id” : xxx, … --- ## [I can't retrieve all data from index](https://discuss.elastic.co/t/i-cant-retrieve-all-data-from-index/97070)
**Author:** [@moabbas](https://discuss.elastic.co/u/moabbas)\ **Replies:** 14\ **Last updated:** [August 21, 2017, 10:57pm UTC](https://discuss.elastic.co/t/i-cant-retrieve-all-data-from-index/97070 "2017-08-21T22:57:26Z")
Hello, I need to retrieve all the data matching my query, they returned data exceed the default size for window which is 10000, How can i do it ? GET logstash-2017.08.04/\_search?scroll=5m { "query": { "matc… --- ## [Send info from twitter4j to elasticSeach with Async](https://discuss.elastic.co/t/send-info-from-twitter4j-to-elasticseach-with-async/97804)
**Author:** [@Lbr1](https://discuss.elastic.co/u/Lbr1)\ **Replies:** 0\ **Last updated:** [August 21, 2017, 4:56pm UTC](https://discuss.elastic.co/t/send-info-from-twitter4j-to-elasticseach-with-async/97804 "2017-08-21T16:56:11Z")
Hello, I’m trying to send twitter4j data to elasticSearch. I can get all the posts to twitter and then for each one I create an entity, add to an array of entities and use the ansyc method to send the posts to elastic, … --- ## [Error 500 : localhost can't handle request](https://discuss.elastic.co/t/error-500-localhost-cant-handle-request/97824)
**Author:** [@Gamer\_Dude](https://discuss.elastic.co/u/Gamer_Dude)\ **Replies:** 0\ **Last updated:** [August 21, 2017, 8:42pm UTC](https://discuss.elastic.co/t/error-500-localhost-cant-handle-request/97824 "2017-08-21T20:42:40Z")
I enabled error on php and this was the message returned. Array ( \[took\] =\> 1 \[timed\_out\] =\> \[\_shards\] =\> Array ( \[total\] =\> 10 \[successful\] =\> 10 \[failed\] =\> 0 ) \[hits\] =\> Array ( \[total\] =\> 0 \[max\_score\] =\> \[hits\] =\> … --- ## [First search per connection takes ~30 seconds](https://discuss.elastic.co/t/first-search-per-connection-takes-30-seconds/97795)
**Author:** [@james.daily](https://discuss.elastic.co/u/james.daily)\ **Replies:** 1\ **Last updated:** [August 21, 2017, 4:09pm UTC](https://discuss.elastic.co/t/first-search-per-connection-takes-30-seconds/97795 "2017-08-21T16:09:15Z")
I’m using Elastic Cloud (ES 5.4.2) and the Python client. We currently have about ~30M documents in our 1 node cluster across 17 indices and 81 shards. No memory pressure issues. I’ve been writing a Django front-end f… --- ## [Uneven JVM usage in cluster 40% to 74% -- can I even this out?](https://discuss.elastic.co/t/uneven-jvm-usage-in-cluster-40-to-74-can-i-even-this-out/97635)
**Author:** [@JJerpseth](https://discuss.elastic.co/u/JJerpseth)\ **Replies:** 2\ **Last updated:** [August 21, 2017, 7:42pm UTC](https://discuss.elastic.co/t/uneven-jvm-usage-in-cluster-40-to-74-can-i-even-this-out/97635 "2017-08-21T19:42:41Z")
My es cluster is 8 identical nodes being fed web logs from Logstash. All of the nodes are listed in the Logstash output so I am assuming that they are equally bearing the import load. Each node has 64GBytes RAM with th… --- ## [Ealsticsearch two nodes with the same cluster name having two different cluster uuid](https://discuss.elastic.co/t/ealsticsearch-two-nodes-with-the-same-cluster-name-having-two-different-cluster-uuid/97805)
**Author:** [@Mehdi\_Mouslih](https://discuss.elastic.co/u/Mehdi_Mouslih)\ **Replies:** 1\ **Last updated:** [August 21, 2017, 7:12pm UTC](https://discuss.elastic.co/t/ealsticsearch-two-nodes-with-the-same-cluster-name-having-two-different-cluster-uuid/97805 "2017-08-21T19:12:02Z")
I configured two node with the cluster name (production), but when I installed head plugin I didn’t see the two nodes. I saw the node which it’s address is used to open head plugin For instance : 9200/\_plugin/head will … --- ## [Sequence numbers unique?](https://discuss.elastic.co/t/sequence-numbers-unique/97814)
**Author:** [@ljcollins25](https://discuss.elastic.co/u/ljcollins25)\ **Replies:** 1\ **Last updated:** [August 21, 2017, 7:06pm UTC](https://discuss.elastic.co/t/sequence-numbers-unique/97814 "2017-08-21T19:06:09Z")
Are sequence numbers unique within a shard or is the pair (primary term, sequence number) the only thing guaranteed to be unique? --- ## [Elasticsearch scoring plugin with access to another document](https://discuss.elastic.co/t/elasticsearch-scoring-plugin-with-access-to-another-document/97790)
**Author:** [@mlbenjii](https://discuss.elastic.co/u/mlbenjii)\ **Replies:** 1\ **Last updated:** [August 21, 2017, 7:05pm UTC](https://discuss.elastic.co/t/elasticsearch-scoring-plugin-with-access-to-another-document/97790 "2017-08-21T19:05:56Z")
Hello, I am attempting to write a native plugin that scores documents relative to properties of a given document, call it X. A naive approach is to pass the properties of X to the plugin as parameters, but this exposes… --- ## [Stored filters using sequence numbers](https://discuss.elastic.co/t/stored-filters-using-sequence-numbers/97816)
**Author:** [@ljcollins25](https://discuss.elastic.co/u/ljcollins25)\ **Replies:** 0\ **Last updated:** [August 21, 2017, 7:03pm UTC](https://discuss.elastic.co/t/stored-filters-using-sequence-numbers/97816 "2017-08-21T19:03:40Z")
I am working on a set of changes to ElasticSearch which allow storing a filter for documents matching a query using sequence numbers. I would like to get feedback on my approach. This is implemented with these changes: … --- ## [Confusion on disable automatic type creation](https://discuss.elastic.co/t/confusion-on-disable-automatic-type-creation/97624)
**Author:** [@cord\_thomas](https://discuss.elastic.co/u/cord_thomas)\ **Replies:** 2\ **Last updated:** [August 21, 2017, 6:45pm UTC](https://discuss.elastic.co/t/confusion-on-disable-automatic-type-creation/97624 "2017-08-21T18:45:38Z")
I have a collection of JSON files that all together have over 1,000 fields. After a first round ingestion, I identified ~65 fields that would be interesting. I am loading the JSON files into ES via the curl XPOST meth… --- ## [Sliced Scroll Search question, what's the minimum max slice?](https://discuss.elastic.co/t/sliced-scroll-search-question-whats-the-minimum-max-slice/97642)
**Author:** [@frzhang](https://discuss.elastic.co/u/frzhang)\ **Replies:** 2\ **Last updated:** [August 21, 2017, 6:36pm UTC](https://discuss.elastic.co/t/sliced-scroll-search-question-whats-the-minimum-max-slice/97642 "2017-08-21T18:36:10Z")
Hi, My current index shards setting is 5, and I am using sliced scroll search to increase parallelism. But I found out if max slice number is less than the number of shards, the result is incomplete. Since I have anothe… --- ## [How to find snapshot size in ElasticSearch](https://discuss.elastic.co/t/how-to-find-snapshot-size-in-elasticsearch/97809)
**Author:** [@kabali12345](https://discuss.elastic.co/u/kabali12345)\ **Replies:** 0\ **Last updated:** [August 21, 2017, 5:57pm UTC](https://discuss.elastic.co/t/how-to-find-snapshot-size-in-elasticsearch/97809 "2017-08-21T17:57:20Z")
Hi all Here i am trying to find each Snapshot Size which are got created in elasticsearch where i came across \_cat/snapshots API but does not helps me. is there a way to find Snapshot Size in ElasticSearch? Thank you… --- ## [Elastic search geo\_distance query results not accurate](https://discuss.elastic.co/t/elastic-search-geo-distance-query-results-not-accurate/97808)
**Author:** [@Shantanu\_Deshmukh](https://discuss.elastic.co/u/Shantanu_Deshmukh)\ **Replies:** 0\ **Last updated:** [August 21, 2017, 5:52pm UTC](https://discuss.elastic.co/t/elastic-search-geo-distance-query-results-not-accurate/97808 "2017-08-21T17:52:43Z")
I am running a geo\_distance query on an index containing about 20k documents. Mapping for this index has a geo\_point type field. Results are coming out inaccurate. When I put distance as 1Km I am getting documents which … --- ## [404 when querying for alias soon after creation](https://discuss.elastic.co/t/404-when-querying-for-alias-soon-after-creation/97800)
**Author:** [@baller](https://discuss.elastic.co/u/baller)\ **Replies:** 0\ **Last updated:** [August 21, 2017, 4:39pm UTC](https://discuss.elastic.co/t/404-when-querying-for-alias-soon-after-creation/97800 "2017-08-21T16:39:42Z")
When create an alias and then query for existence of that alias using GET /\*/\_alias/\ I’m sometimes getting 404s even though the alias definitely exists. Then what ends up happening is my app mistakenly recrea… [Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1971) [Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1973)