# Elasticsearch **URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1347 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1348 --- ## [Reindex with adding subdocuments (filebeat index 5.6 to 6.6 migration)](https://discuss.elastic.co/t/reindex-with-adding-subdocuments-filebeat-index-5-6-to-6-6-migration/174582)
**Author:** [@Hubert\_Lyczek](https://discuss.elastic.co/u/Hubert_Lyczek)\ **Replies:** 1\ **Last updated:** [April 1, 2019, 12:40pm UTC](https://discuss.elastic.co/t/reindex-with-adding-subdocuments-filebeat-index-5-6-to-6-6-migration/174582 "2019-04-01T12:40:04Z")
Hello, I'm testing upgrade from 5.6 to 6.6 currently. After upgrading ES, Kibana, Logstash and Beats I noticed that documents produced by beats are slightly different. That's ok, as all is as described in the documentat… --- ## [Rollup search + script query](https://discuss.elastic.co/t/rollup-search-script-query/172777)
**Author:** [@rubarax](https://discuss.elastic.co/u/rubarax)\ **Replies:** 1\ **Last updated:** [April 1, 2019, 12:21pm UTC](https://discuss.elastic.co/t/rollup-search-script-query/172777 "2019-04-01T12:21:15Z")
Hello, I'd like to know if the "script query" can be used with the rollup searchs. https://www.elastic.co/guide/en/elasticsearch/reference/6.6/query-dsl-script-query.html#query-dsl-script-query I had the following que… --- ## [Weighted Average Aggregation Support in Rollup](https://discuss.elastic.co/t/weighted-average-aggregation-support-in-rollup/174300)
**Author:** [@Vipul\_Narula](https://discuss.elastic.co/u/Vipul_Narula)\ **Replies:** 1\ **Last updated:** [April 1, 2019, 12:18pm UTC](https://discuss.elastic.co/t/weighted-average-aggregation-support-in-rollup/174300 "2019-04-01T12:18:36Z")
Current version of Es Rollup API have no support for percentiles or weighted averages. It would be of great help if any plan to include the features in future versions or any tentative time line is shared --- ## [JOIN operation in elasticsearch](https://discuss.elastic.co/t/join-operation-in-elasticsearch/174760)
**Author:** [@Praneet\_Khandelwal](https://discuss.elastic.co/u/Praneet_Khandelwal)\ **Replies:** 4\ **Last updated:** [April 1, 2019, 11:18am UTC](https://discuss.elastic.co/t/join-operation-in-elasticsearch/174760 "2019-04-01T11:18:05Z")
Is there a way to do something similiar to a JOIN operation in elasticsearch? --- ## [How to use Scroll in Rails/Ruby to get more than 10,000 records?](https://discuss.elastic.co/t/how-to-use-scroll-in-rails-ruby-to-get-more-than-10-000-records/174737)
**Author:** [@unavailabl3](https://discuss.elastic.co/u/unavailabl3)\ **Replies:** 3\ **Last updated:** [April 1, 2019, 11:13am UTC](https://discuss.elastic.co/t/how-to-use-scroll-in-rails-ruby-to-get-more-than-10-000-records/174737 "2019-04-01T11:13:20Z")
I need to search in my 25,000 records. But elasticsearch allow only 10,000 (from and size is the same). How can I make search and get results more than 10,000? There is scroll api, but I don't understand how to use it. … --- ## [Max number of shards per elastic data node](https://discuss.elastic.co/t/max-number-of-shards-per-elastic-data-node/174572)
**Author:** [@githubkatten](https://discuss.elastic.co/u/githubkatten)\ **Replies:** 4\ **Last updated:** [April 1, 2019, 11:05am UTC](https://discuss.elastic.co/t/max-number-of-shards-per-elastic-data-node/174572 "2019-04-01T11:05:18Z")
Hi! I've found out that the recommended number of shards per elasticsearch data node is 20 \* GB heap memory. Ex. if I got a node with 16GB java heap, it can handle 20\*16=320 shards. Is this rule of thumb for open indi… --- ## [Geo Polygon Query retuns nothing](https://discuss.elastic.co/t/geo-polygon-query-retuns-nothing/174758)
**Author:** [@Yandex\_Art](https://discuss.elastic.co/u/Yandex_Art)\ **Replies:** 2\ **Last updated:** [April 1, 2019, 10:54am UTC](https://discuss.elastic.co/t/geo-polygon-query-retuns-nothing/174758 "2019-04-01T10:54:41Z")
1. Сreat new using the following request: PUT /test?pretty { "mappings": { "tst": { "properties": { "nm":{ "type":"text" }, "loc": { … --- ## [NoSuchFileException：/nodes/0/node.lock](https://discuss.elastic.co/t/nosuchfileexception-nodes-0-node-lock/174743)
**Author:** [@iamazy](https://discuss.elastic.co/u/iamazy)\ **Replies:** 1\ **Last updated:** [April 1, 2019, 10:50am UTC](https://discuss.elastic.co/t/nosuchfileexception-nodes-0-node-lock/174743 "2019-04-01T10:50:06Z")
hello When I start the elasticsearch 6.6.0，everything is ok，but after 10 minutes passed，elasticsearch throw the java.nio.file.NoSuchFileException: /home/wsn/es6.6/es\_data/node\_2/data/nodes/0/node.lock and most of shared… --- ## [Upgraded node not rejoining non upgraded cluster 6.5.1 to 6.7 upgrade - IOException\[Invalid string; unexpected character: 255 hex: ff\]](https://discuss.elastic.co/t/upgraded-node-not-rejoining-non-upgraded-cluster-6-5-1-to-6-7-upgrade-ioexception-invalid-string-unexpected-character-255-hex-ff/174326)
**Author:** [@John\_Swift](https://discuss.elastic.co/u/John_Swift)\ **Replies:** 26\ **Last updated:** [April 1, 2019, 10:45am UTC](https://discuss.elastic.co/t/upgraded-node-not-rejoining-non-upgraded-cluster-6-5-1-to-6-7-upgrade-ioexception-invalid-string-unexpected-character-255-hex-ff/174326 "2019-04-01T10:45:01Z")
Upgraded 1 node of a 4 node cluster this mroing from 6.5.1 to 6.7 Upgraded node starts up fine & comes online but is refusing to joing the existing cluster since the upgrade. Elasticsearch.yml is config cluster.name: … --- ## [How can I stop elasticsearch and kibana to check for upgrade?](https://discuss.elastic.co/t/how-can-i-stop-elasticsearch-and-kibana-to-check-for-upgrade/174091)
**Author:** [@subhas](https://discuss.elastic.co/u/subhas)\ **Replies:** 2\ **Last updated:** [April 1, 2019, 10:44am UTC](https://discuss.elastic.co/t/how-can-i-stop-elasticsearch-and-kibana-to-check-for-upgrade/174091 "2019-04-01T10:44:59Z")
Downtime happens everytime when there is a new release. Kibana would stop working or elasticsearch plugins would require upgrade and unable to start elasticsearch etc. How can we stop all the automatic upgrade process an… --- ## [Elastic 5.4.0 adding cluster for remote search](https://discuss.elastic.co/t/elastic-5-4-0-adding-cluster-for-remote-search/174720)
**Author:** [@srirama](https://discuss.elastic.co/u/srirama)\ **Replies:** 3\ **Last updated:** [April 1, 2019, 10:34am UTC](https://discuss.elastic.co/t/elastic-5-4-0-adding-cluster-for-remote-search/174720 "2019-04-01T10:34:31Z")
Hi, Initially I set up two clusters (by name "nc3" and "new-cluster2") and each is having two nodes. The cross cluster search worked from one cluster "nc3" to "new-cluster2". From both Kibana and REST API. But when sen… --- ## [Elasticsearch 6.7.0 Homebrew install macOS 10.14.4 fails to run ERROR: Cluster name \[elasticsearch\_nathan\] subdirectory exists in data paths](https://discuss.elastic.co/t/elasticsearch-6-7-0-homebrew-install-macos-10-14-4-fails-to-run-error-cluster-name-elasticsearch-nathan-subdirectory-exists-in-data-paths/174747)
**Author:** [@Nathan\_Sowatskey](https://discuss.elastic.co/u/Nathan_Sowatskey)\ **Replies:** 3\ **Last updated:** [April 1, 2019, 10:08am UTC](https://discuss.elastic.co/t/elasticsearch-6-7-0-homebrew-install-macos-10-14-4-fails-to-run-error-cluster-name-elasticsearch-nathan-subdirectory-exists-in-data-paths/174747 "2019-04-01T10:08:19Z")
I have installed ES on an iMac with macOS 10.14.4, then tried to run it. That failed as shown below. I was expecting this to run as is, as previous installs have run without any configuration required. This is the first … --- ## [Snapshot-restore red indices](https://discuss.elastic.co/t/snapshot-restore-red-indices/174723)
**Author:** [@shiveshabhishek](https://discuss.elastic.co/u/shiveshabhishek)\ **Replies:** 2\ **Last updated:** [April 1, 2019, 9:55am UTC](https://discuss.elastic.co/t/snapshot-restore-red-indices/174723 "2019-04-01T09:55:13Z")
Hey, is it okay to take a snapshot during restore process ? What I found was, I took snapshot\_4 earlier. While taking snapshot\_5, I restored my snapshot\_4 to another cluster . Some of the indices get restored as expected… --- ## [Query and sub query](https://discuss.elastic.co/t/query-and-sub-query/174403)
**Author:** [@lfourny](https://discuss.elastic.co/u/lfourny)\ **Replies:** 1\ **Last updated:** [April 1, 2019, 9:49am UTC](https://discuss.elastic.co/t/query-and-sub-query/174403 "2019-04-01T09:49:22Z")
Hello everyone, I am trying to translate in elasticsearch 'a sql query like the following example: SELECT numero\_serie, Qte\_errors FROM ( Select numero\_serie as numero\_serie, count(id) as Qte\_errors FROM IndexE… --- ## [Fuzzy all words in simple query string queries including stopwords gives 0 results](https://discuss.elastic.co/t/fuzzy-all-words-in-simple-query-string-queries-including-stopwords-gives-0-results/174749)
**Author:** [@Kevin\_Pietrzyk](https://discuss.elastic.co/u/Kevin_Pietrzyk)\ **Replies:** 0\ **Last updated:** [April 1, 2019, 9:44am UTC](https://discuss.elastic.co/t/fuzzy-all-words-in-simple-query-string-queries-including-stopwords-gives-0-results/174749 "2019-04-01T09:44:08Z")
Hi, Elasticsearch version: 6.6.2 I am trying to make a simple string query that fuzzies all the words and later on delete the fuzziness from the stop words using a character filter but it is not working. example: Cr… --- ## [Elastic clustering](https://discuss.elastic.co/t/elastic-clustering/174709)
**Author:** [@cppatel](https://discuss.elastic.co/u/cppatel)\ **Replies:** 3\ **Last updated:** [April 1, 2019, 9:44am UTC](https://discuss.elastic.co/t/elastic-clustering/174709 "2019-04-01T09:44:07Z")
Does Elasticsearch supports OS level clustering ? If it is so please provide a related document to refer it. We want that filebeat directly send an input to VIP. We are using 6.2.2 ELK stack. --- ## [Value and doc\_count difference](https://discuss.elastic.co/t/value-and-doc-count-difference/174738)
**Author:** [@victor3443](https://discuss.elastic.co/u/victor3443)\ **Replies:** 0\ **Last updated:** [April 1, 2019, 8:39am UTC](https://discuss.elastic.co/t/value-and-doc-count-difference/174738 "2019-04-01T08:39:11Z")
Hello, I am having a hard time trying to understand the value and doc\_count parameters when performing a query. As you see, in the result query I get two different numbers per "key" : "Access from malicious IP address"… --- ## [Get rid of duplicates](https://discuss.elastic.co/t/get-rid-of-duplicates/174443)
**Author:** [@vijayaraj](https://discuss.elastic.co/u/vijayaraj)\ **Replies:** 1\ **Last updated:** [April 1, 2019, 8:22am UTC](https://discuss.elastic.co/t/get-rid-of-duplicates/174443 "2019-04-01T08:22:41Z")
Hi, I am working on building a e-commerce backend, I do a search on productName, If 4 products have the same Name, I don't want all same 4 products. Is there any option to get rid of duplicates and show only unique re… --- ## [Return the buckets size after performing aggregations](https://discuss.elastic.co/t/return-the-buckets-size-after-performing-aggregations/174349)
**Author:** [@elk\_user188](https://discuss.elastic.co/u/elk_user188)\ **Replies:** 2\ **Last updated:** [April 1, 2019, 8:22am UTC](https://discuss.elastic.co/t/return-the-buckets-size-after-performing-aggregations/174349 "2019-04-01T08:22:26Z")
Hi there! I'd like to know the size of the buckets array so as to visualize it (as a metric for example). Let's say I have an index generated as follows: PUT hockey/player/\_bulk?refresh {"index":{"\_id":1}} {"first":"j… --- ## [Joining data from other source while returning response](https://discuss.elastic.co/t/joining-data-from-other-source-while-returning-response/174733)
**Author:** [@helper\_bro](https://discuss.elastic.co/u/helper_bro)\ **Replies:** 0\ **Last updated:** [April 1, 2019, 8:13am UTC](https://discuss.elastic.co/t/joining-data-from-other-source-while-returning-response/174733 "2019-04-01T08:13:34Z")
let's say we have indexed price and availability in the elasticsearch. And let's say we are working on a high frequency website/sale day it will be impossible/very time consuming to keep up the indexing with current stoc… --- ## [Watcher multiple if statements or and if](https://discuss.elastic.co/t/watcher-multiple-if-statements-or-and-if/174533)
**Author:** [@forestnd](https://discuss.elastic.co/u/forestnd)\ **Replies:** 1\ **Last updated:** [April 1, 2019, 8:10am UTC](https://discuss.elastic.co/t/watcher-multiple-if-statements-or-and-if/174533 "2019-04-01T08:10:27Z")
Hay all Is it possible in an watcher condition script to set and and if for exanple alert only if threshold belowmax\_threshold but above min\_threshold Trying to set the alert to auto close, but not want this action t… --- ## [GROK pattern for message](https://discuss.elastic.co/t/grok-pattern-for-message/174705)
**Author:** [@\_gandhe](https://discuss.elastic.co/u/_gandhe)\ **Replies:** 1\ **Last updated:** [April 1, 2019, 8:06am UTC](https://discuss.elastic.co/t/grok-pattern-for-message/174705 "2019-04-01T08:06:49Z")
I have following log line: - 2019-03-29 05:20:18 INFO::ModelId=model-cps-czooarea05nap01::ServiceName=Data Monitoring Tool::SolutionName=PM::ProcessStep=sitetags::SystemGuid=1d950a95-861b-47d8-b44e-2e220da138cc::Quality… --- ## [Error creating Roll Up](https://discuss.elastic.co/t/error-creating-roll-up/174083)
**Author:** [@digitalron](https://discuss.elastic.co/u/digitalron)\ **Replies:** 2\ **Last updated:** [April 1, 2019, 7:59am UTC](https://discuss.elastic.co/t/error-creating-roll-up/174083 "2019-04-01T07:59:38Z")
Using Elastic Stack 6.7.0 (Docker) I created a roll up but encountered this: Request failed with a error. \[remote\_transport\_exception\] \[92N-H5C\]\[172.20.0.6:9300\]\[cluster:admin/xpack/rollup/put\] \[92N-H5C\]\[172.20.0.6:93… --- ## [Cisco ASA syslog parsing](https://discuss.elastic.co/t/cisco-asa-syslog-parsing/174462)
**Author:** [@Mohammed\_Imran](https://discuss.elastic.co/u/Mohammed_Imran)\ **Replies:** 1\ **Last updated:** [April 1, 2019, 7:46am UTC](https://discuss.elastic.co/t/cisco-asa-syslog-parsing/174462 "2019-04-01T07:46:52Z")
I new to ELK, I am trying to parse cisco ASA syslogs. I am using default patterns of Cisco logs from this plugin from here I also see proper output in logstash { "src\_interface" =\> "outside", "src\_port" =\> "47148", … --- ## [Elasticsearch Indexed words List](https://discuss.elastic.co/t/elasticsearch-indexed-words-list/174727)
**Author:** [@moni15moni](https://discuss.elastic.co/u/moni15moni)\ **Replies:** 0\ **Last updated:** [April 1, 2019, 7:38am UTC](https://discuss.elastic.co/t/elasticsearch-indexed-words-list/174727 "2019-04-01T07:38:09Z")
Hi, I would like to know how many tokens are indexed in specific index , in the term of List of indexed tokens in the inverted index. Hope it's not available in API directly, Is there any way to get it from backend. --- ## [Elasticsearch watcher cannot to connect smtp host](https://discuss.elastic.co/t/elasticsearch-watcher-cannot-to-connect-smtp-host/173873)
**Author:** [@ZMMWMY](https://discuss.elastic.co/u/ZMMWMY)\ **Replies:** 4\ **Last updated:** [April 1, 2019, 7:11am UTC](https://discuss.elastic.co/t/elasticsearch-watcher-cannot-to-connect-smtp-host/173873 "2019-04-01T07:11:16Z")
i am using es 6.2.3 and i have configured watcher ,set up email configuration in elasticsearch.yml xpack.notification.email: default\_account: smtp\_account account: smtp\_account: profile: standard smtp: … --- ## [Watcher help send mutple alerts](https://discuss.elastic.co/t/watcher-help-send-mutple-alerts/173914)
**Author:** [@forestnd](https://discuss.elastic.co/u/forestnd)\ **Replies:** 5\ **Last updated:** [April 1, 2019, 7:10am UTC](https://discuss.elastic.co/t/watcher-help-send-mutple-alerts/173914 "2019-04-01T07:10:45Z")
Hello First time writing my own watcher and need some help please, I want it to alert if the system load on an host is grate then a set number for longer then 5 minutes. (for testing on my environment, i set it to an lo… --- ## [Elasticsearch and Kibana upgrade from 6.5.3 to 6.6.2](https://discuss.elastic.co/t/elasticsearch-and-kibana-upgrade-from-6-5-3-to-6-6-2/174711)
**Author:** [@arun.kumar92](https://discuss.elastic.co/u/arun.kumar92)\ **Replies:** 3\ **Last updated:** [April 1, 2019, 7:06am UTC](https://discuss.elastic.co/t/elasticsearch-and-kibana-upgrade-from-6-5-3-to-6-6-2/174711 "2019-04-01T07:06:42Z")
Hi Team Is there any known issues with elasticsearch 6.6.2 As I'm planning to upgrade from 6.5.3 to 6.6.2 Thanks in advance --- ## [Fetch data from elastic search to java application](https://discuss.elastic.co/t/fetch-data-from-elastic-search-to-java-application/174536)
**Author:** [@Mangesh\_Panchwagh](https://discuss.elastic.co/u/Mangesh_Panchwagh)\ **Replies:** 4\ **Last updated:** [April 1, 2019, 6:30am UTC](https://discuss.elastic.co/t/fetch-data-from-elastic-search-to-java-application/174536 "2019-04-01T06:30:38Z")
Hi, I am new to elasticsearch. I am building an application which uploads the resumes. Then I will fetch the resume of particular candidate using some filters like firstname, lastname etc. I am able to push my postgres… --- ## [FSCrawler is not indexing consistently](https://discuss.elastic.co/t/fscrawler-is-not-indexing-consistently/174267)
**Author:** [@sreed](https://discuss.elastic.co/u/sreed)\ **Replies:** 6\ **Last updated:** [April 1, 2019, 5:50am UTC](https://discuss.elastic.co/t/fscrawler-is-not-indexing-consistently/174267 "2019-04-01T05:50:36Z")
I have configured fscrawler to monitor a folder with 13 items (folders, files of types txt, pdf, doc, xls & ppt) But not all files (and their content) are being indexed. Only 8 are being indexed. Is there an error in th… [Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1346) [Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1348)