# Elasticsearch **URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1793 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1794 --- ## [How to prevent duplicate events which is already pushed into elastic using watcher action?](https://discuss.elastic.co/t/how-to-prevent-duplicate-events-which-is-already-pushed-into-elastic-using-watcher-action/118399)
**Author:** [@yash\_mangla](https://discuss.elastic.co/u/yash_mangla)\ **Replies:** 1\ **Last updated:** [February 9, 2018, 11:36pm UTC](https://discuss.elastic.co/t/how-to-prevent-duplicate-events-which-is-already-pushed-into-elastic-using-watcher-action/118399 "2018-02-09T23:36:54Z")
Hello Folks, I want to prevent duplicate documents from being inserted into new elastic index, using watcher actions. I am not sure whether it is possible or not. Here's the scenario. Watchers, scheduler is set to 15… --- ## [Calling a login page from X-pack realm](https://discuss.elastic.co/t/calling-a-login-page-from-x-pack-realm/119099)
**Author:** [@kasi](https://discuss.elastic.co/u/kasi)\ **Replies:** 2\ **Last updated:** [February 9, 2018, 11:21pm UTC](https://discuss.elastic.co/t/calling-a-login-page-from-x-pack-realm/119099 "2018-02-09T23:21:03Z")
The following is the requirement: We are planning on using Open ID connect and oauth2, should be able to bring in a login page from X-pack realm let the users enter the userid and password information and then redirec… --- ## [Terms Query Lookup with index on another cluster](https://discuss.elastic.co/t/terms-query-lookup-with-index-on-another-cluster/119313)
**Author:** [@apang](https://discuss.elastic.co/u/apang)\ **Replies:** 0\ **Last updated:** [February 9, 2018, 10:41pm UTC](https://discuss.elastic.co/t/terms-query-lookup-with-index-on-another-cluster/119313 "2018-02-09T22:41:54Z")
Running Elasticsearch 6.2.0. I can query values in the remote lookup index just fine, but I can't seem to use it in terms query. Ex. GET RemoteCluster:lookup/\_search { "query": { "match\_all": {} } } GET Remo… --- ## [XPack Watcher - SSL Error on Slack action](https://discuss.elastic.co/t/xpack-watcher-ssl-error-on-slack-action/119297)
**Author:** [@aaronloesattv](https://discuss.elastic.co/u/aaronloesattv)\ **Replies:** 2\ **Last updated:** [February 9, 2018, 10:28pm UTC](https://discuss.elastic.co/t/xpack-watcher-ssl-error-on-slack-action/119297 "2018-02-09T22:28:18Z")
I'm trying out the slack integration with watcher on our monitoring cluster. sending to slack is failing with the below exception. "sent\_messages": \[ { "status": "failure", "error": { … --- ## [Template Versioning](https://discuss.elastic.co/t/template-versioning/119311)
**Author:** [@Karthik\_Ramachandran](https://discuss.elastic.co/u/Karthik_Ramachandran)\ **Replies:** 0\ **Last updated:** [February 9, 2018, 10:26pm UTC](https://discuss.elastic.co/t/template-versioning/119311 "2018-02-09T22:26:17Z")
Elastic version 6.2 Referring article : https://www.elastic.co/guide/en/elasticsearch/reference/current/indices-templates.html When we add version to template, can we find what version of template the index uses when w… --- ## [Elastic 2.6 Monitoring with 6.x](https://discuss.elastic.co/t/elastic-2-6-monitoring-with-6-x/119125)
**Author:** [@Karthik\_Ramachandran](https://discuss.elastic.co/u/Karthik_Ramachandran)\ **Replies:** 2\ **Last updated:** [February 9, 2018, 10:23pm UTC](https://discuss.elastic.co/t/elastic-2-6-monitoring-with-6-x/119125 "2018-02-09T22:23:52Z")
We have a older cluster running in ES version 2.6. Can I send the monitoring data of this cluster to a newer version ES cluster, that is running 6.2 and used as monitoring cluster? If yes, does the dashboards and other … --- ## [\[SOLVED\] Index issues after upgrade from 5.x to 6.2](https://discuss.elastic.co/t/solved-index-issues-after-upgrade-from-5-x-to-6-2/119119)
**Author:** [@Diggy](https://discuss.elastic.co/u/Diggy)\ **Replies:** 5\ **Last updated:** [February 9, 2018, 10:20pm UTC](https://discuss.elastic.co/t/solved-index-issues-after-upgrade-from-5-x-to-6-2/119119 "2018-02-09T22:20:35Z")
Hello, all. Yesterday, I upgraded my Elastic stack from version 5.x to 6.2, and today, my logstash and filebeat indices no longer work. Here's some output from elasticsearch.log: \[2018-02-08T00:03:29,150\]\[WARN \]\[logst… --- ## [Recovery of replica from the local node](https://discuss.elastic.co/t/recovery-of-replica-from-the-local-node/119309)
**Author:** [@fhalde](https://discuss.elastic.co/u/fhalde)\ **Replies:** 0\ **Last updated:** [February 9, 2018, 9:51pm UTC](https://discuss.elastic.co/t/recovery-of-replica-from-the-local-node/119309 "2018-02-09T21:51:44Z")
I was wondering why replica recover happens over the network? I mean let's say a node containing a primary went down. Then the replica becomes the primary. Now when the previous node comes back up, can't the shard on tha… --- ## [What is causing refreshes?](https://discuss.elastic.co/t/what-is-causing-refreshes/119289)
**Author:** [@apechimp](https://discuss.elastic.co/u/apechimp)\ **Replies:** 4\ **Last updated:** [February 9, 2018, 9:28pm UTC](https://discuss.elastic.co/t/what-is-causing-refreshes/119289 "2018-02-09T21:28:28Z")
I am using elasticsearch 5.6.4 and I have a very update heavy workload. I have my refresh\_interval set to 10s. However, I'm seeing hundreds of concurrent refreshes going on (with a max refresh time of ~5s). Is there a wa… --- ## [\[ERROR\]\[shield.authz.esnative\] \[node name\] error occurred while checking the native roles for changes](https://discuss.elastic.co/t/error-shield-authz-esnative-node-name-error-occurred-while-checking-the-native-roles-for-changes/118824)
**Author:** [@a99lex](https://discuss.elastic.co/u/a99lex)\ **Replies:** 1\ **Last updated:** [February 9, 2018, 9:12pm UTC](https://discuss.elastic.co/t/error-shield-authz-esnative-node-name-error-occurred-while-checking-the-native-roles-for-changes/118824 "2018-02-09T21:12:50Z")
Hi Our application teams are getting time outs. Error in update document for userId: and exception:Exception while executing updates for user:None of the configured nodes were available, and the searches are timing out. … --- ## [Action \[cluster:monitor/main\] is unauthorized for user](https://discuss.elastic.co/t/action-cluster-monitor-main-is-unauthorized-for-user/119074)
**Author:** [@Turbo\_Fredriksson](https://discuss.elastic.co/u/Turbo_Fredriksson)\ **Replies:** 3\ **Last updated:** [February 9, 2018, 9:02pm UTC](https://discuss.elastic.co/t/action-cluster-monitor-main-is-unauthorized-for-user/119074 "2018-02-09T21:02:21Z")
I'm trying to setup X-Pack (on ES v5.1.1 - can't upgrade yet) using the Puppet module (https://github.com/elastic/puppet-elasticsearch/tree/5.x#advanced-features), but I'm having problem with authentication... I've crea… --- ## [Forward slashes not matching in regexp query](https://discuss.elastic.co/t/forward-slashes-not-matching-in-regexp-query/119283)
**Author:** [@Simon\_Leighton](https://discuss.elastic.co/u/Simon_Leighton)\ **Replies:** 3\ **Last updated:** [February 9, 2018, 8:51pm UTC](https://discuss.elastic.co/t/forward-slashes-not-matching-in-regexp-query/119283 "2018-02-09T20:51:28Z")
I've created a mapping and regexp query to search urls but these are failing when I add a forward slash to the regex query "mappings":{ "document":{ "properties":{ "url":{ "type":"text", "analyzer":"keyword" } } … --- ## [Where does Deprecated field \[inline\] used, expected \[source\] instead come from?](https://discuss.elastic.co/t/where-does-deprecated-field-inline-used-expected-source-instead-come-from/119104)
**Author:** [@javadevmtl](https://discuss.elastic.co/u/javadevmtl)\ **Replies:** 1\ **Last updated:** [February 9, 2018, 8:46pm UTC](https://discuss.elastic.co/t/where-does-deprecated-field-inline-used-expected-source-instead-come-from/119104 "2018-02-09T20:46:16Z")
Hi running 6.1.2, I see a bunch of these messages in my coordinator nodes only. I don't see what process is causing this... I have free monitoring enabled, I have some logstash pipelines filebeat -\> kafka -\> logstash -\> … --- ## [Access field document in an elasticsearch query](https://discuss.elastic.co/t/access-field-document-in-an-elasticsearch-query/119123)
**Author:** [@citestra2](https://discuss.elastic.co/u/citestra2)\ **Replies:** 3\ **Last updated:** [February 9, 2018, 7:13pm UTC](https://discuss.elastic.co/t/access-field-document-in-an-elasticsearch-query/119123 "2018-02-09T19:13:34Z")
For example suppose we have this mapping : { "location":{ "dynamic":"false", "properties":{ "locality":{"type":"text"}, "country":{"type":"text"}, "postalCode":{"t… --- ## [Data type for 3 - 8 dimensions in k-d tree?](https://discuss.elastic.co/t/data-type-for-3-8-dimensions-in-k-d-tree/118762)
**Author:** [@IanRC72](https://discuss.elastic.co/u/IanRC72)\ **Replies:** 2\ **Last updated:** [February 9, 2018, 6:42pm UTC](https://discuss.elastic.co/t/data-type-for-3-8-dimensions-in-k-d-tree/118762 "2018-02-09T18:42:25Z")
This blog post talks of having up to 8 dimensions in the internal k-d tree index. However, the only data type I can find that would use a k-d tree is the 2D geo type. How does one use 3+ dimensions? This would be very b… --- ## [Migrating from ES 2.4 to 5.x](https://discuss.elastic.co/t/migrating-from-es-2-4-to-5-x/116935)
**Author:** [@motts](https://discuss.elastic.co/u/motts)\ **Replies:** 17\ **Last updated:** [February 9, 2018, 6:29pm UTC](https://discuss.elastic.co/t/migrating-from-es-2-4-to-5-x/116935 "2018-02-09T18:29:00Z")
I am trying to install the migration tool and that seemed to work fine. However, I cannot seem to connect to the host with localhost:9200/\_plugin/elasticsearch-migration I get a 404 error, but ES is running. If I try to … --- ## [Can I use G1GC with Oracle JVM 8u121 and ES-5.6.2 at production environment?](https://discuss.elastic.co/t/can-i-use-g1gc-with-oracle-jvm-8u121-and-es-5-6-2-at-production-environment/119272)
**Author:** [@Claudio\_Ranieri](https://discuss.elastic.co/u/Claudio_Ranieri)\ **Replies:** 0\ **Last updated:** [February 9, 2018, 4:30pm UTC](https://discuss.elastic.co/t/can-i-use-g1gc-with-oracle-jvm-8u121-and-es-5-6-2-at-production-environment/119272 "2018-02-09T16:30:34Z")
In post https://issues.apache.org/jira/browse/LUCENE-5168 They speak about bug "Instance field load is replaced by wrong data Phi". This bug appear resolved in 8u121 https://bugs.java.com/view\_bug.do?bug\_id=8038348 C… --- ## [X-pack basic license can not be installed from Kabana](https://discuss.elastic.co/t/x-pack-basic-license-can-not-be-installed-from-kabana/119247)
**Author:** [@abdul\_qayyum](https://discuss.elastic.co/u/abdul_qayyum)\ **Replies:** 4\ **Last updated:** [February 9, 2018, 4:27pm UTC](https://discuss.elastic.co/t/x-pack-basic-license-can-not-be-installed-from-kabana/119247 "2018-02-09T16:27:37Z")
I have downloaded x-pack basic license and tried to install using kibana. It gives authentication error: { "error": { "root\_cause": \[ { "type": "security\_exception", "reason": "action \[cluster:admin/xpack/li… --- ## [Are the mappings with enabled=false using heap or disk cache (from OS)?](https://discuss.elastic.co/t/are-the-mappings-with-enabled-false-using-heap-or-disk-cache-from-os/119269)
**Author:** [@Claudio\_Ranieri](https://discuss.elastic.co/u/Claudio_Ranieri)\ **Replies:** 0\ **Last updated:** [February 9, 2018, 4:00pm UTC](https://discuss.elastic.co/t/are-the-mappings-with-enabled-false-using-heap-or-disk-cache-from-os/119269 "2018-02-09T16:00:06Z")
Hi, I used this config to type product of index model { "model": {"mappings": {"product":{ "enabled":false } } } } My question is if the elasticsearch load of these fields are consuming heap of JVM or disk cac… --- ## [Match only the same tokens](https://discuss.elastic.co/t/match-only-the-same-tokens/117789)
**Author:** [@Kseniia\_Pelykh](https://discuss.elastic.co/u/Kseniia_Pelykh)\ **Replies:** 2\ **Last updated:** [February 9, 2018, 3:07pm UTC](https://discuss.elastic.co/t/match-only-the-same-tokens/117789 "2018-02-09T15:07:03Z")
Hi, I have this situation: I want to get documents that have the same tokens as my query. Not documents that can have more tokens that my query as match\_phrase does. I can't use term because I need to consider also syn… --- ## [SAML support, custom authentication plugins](https://discuss.elastic.co/t/saml-support-custom-authentication-plugins/1813)
**Author:** [@owulff](https://discuss.elastic.co/u/owulff)\ **Replies:** 20\ **Last updated:** [February 9, 2018, 2:54pm UTC](https://discuss.elastic.co/t/saml-support-custom-authentication-plugins/1813 "2018-02-09T14:54:30Z")
This question has been raised in the Kibana community already: IMHO, it affects Elasticsearch and Shield as well. Does Shield provide an interface where I can handle the authentication process (validate SAML token) an… --- ## [Issue transferring data from Logstash to Elasticsearch](https://discuss.elastic.co/t/issue-transferring-data-from-logstash-to-elasticsearch/119260)
**Author:** [@GerryMc](https://discuss.elastic.co/u/GerryMc)\ **Replies:** 0\ **Last updated:** [February 9, 2018, 2:48pm UTC](https://discuss.elastic.co/t/issue-transferring-data-from-logstash-to-elasticsearch/119260 "2018-02-09T14:48:13Z")
Hello, I'm a relative novice who has managed to get the basic functions working between Elasticsearch and Kibana but am facing an issue with communication between Logstash and Elastic search. All data transfers are bet… --- ## [How to force queries for very high frequency words](https://discuss.elastic.co/t/how-to-force-queries-for-very-high-frequency-words/119180)
**Author:** [@comdiv](https://discuss.elastic.co/u/comdiv)\ **Replies:** 7\ **Last updated:** [February 9, 2018, 2:21pm UTC](https://discuss.elastic.co/t/how-to-force-queries-for-very-high-frequency-words/119180 "2018-02-09T14:21:27Z")
Problem: There is very frequent word for index for example: "company" ( 6mln over 8mln total documents) It's not stop word and is indexed It's very often that users make their request with this only word and it's legal… --- ## [Weird mappings to index for array of numeric ranges](https://discuss.elastic.co/t/weird-mappings-to-index-for-array-of-numeric-ranges/119249)
**Author:** [@Mukolajko25](https://discuss.elastic.co/u/Mukolajko25)\ **Replies:** 1\ **Last updated:** [February 9, 2018, 2:08pm UTC](https://discuss.elastic.co/t/weird-mappings-to-index-for-array-of-numeric-ranges/119249 "2018-02-09T14:08:12Z")
Hi. I have two arrays with numbers in ranges called ageRange and householdIncomeRange. For age range we can have values like \[null, 17\], \[18,24\], \[25,34\]...\[65,null\]. For household Income we can have values like \[null… --- ## [Planning for the future : single-type indices](https://discuss.elastic.co/t/planning-for-the-future-single-type-indices/119248)
**Author:** [@knights](https://discuss.elastic.co/u/knights)\ **Replies:** 0\ **Last updated:** [February 9, 2018, 1:54pm UTC](https://discuss.elastic.co/t/planning-for-the-future-single-type-indices/119248 "2018-02-09T13:54:55Z")
Hi, everyone. We are currently running a few production clusters in ES 5.5.1. We will soon migrate our data in ES 6.x (wichever will be the latest at that time) to take advantage of the new features, some of wich looks… --- ## [How to set the configuration in logstash to run dynamically](https://discuss.elastic.co/t/how-to-set-the-configuration-in-logstash-to-run-dynamically/118387)
**Author:** [@venkat545](https://discuss.elastic.co/u/venkat545)\ **Replies:** 8\ **Last updated:** [February 9, 2018, 1:52pm UTC](https://discuss.elastic.co/t/how-to-set-the-configuration-in-logstash-to-run-dynamically/118387 "2018-02-09T13:52:29Z")
I am pulling the data from pgadmin and pushing to elastic search through logstash..I am using JDBC driver in Logstash but how can i update dynamically like postgres updates ..can any one suggest..E.s &L.s ,kibana Version… --- ## [Indexing data into ElasticSearch 6.2 using java API](https://discuss.elastic.co/t/indexing-data-into-elasticsearch-6-2-using-java-api/118988)
**Author:** [@wandermonk](https://discuss.elastic.co/u/wandermonk)\ **Replies:** 8\ **Last updated:** [February 9, 2018, 1:29pm UTC](https://discuss.elastic.co/t/indexing-data-into-elasticsearch-6-2-using-java-api/118988 "2018-02-09T13:29:06Z")
As we know that the elasticsearch has deprecated types in 6.2.0 release how do we index data to an elastic search index. public class ElasticSearchWriter { private static final Logger LOGGER = LoggerFactory.getLogger(… --- ## [Elasticsearch Interpreter Zeppelin - Elastic Cloud - Found to be : ZEPPELIN-2031](https://discuss.elastic.co/t/elasticsearch-interpreter-zeppelin-elastic-cloud-found-to-be-zeppelin-2031/119048)
**Author:** [@Wayne\_Taylor](https://discuss.elastic.co/u/Wayne_Taylor)\ **Replies:** 1\ **Last updated:** [February 9, 2018, 1:27pm UTC](https://discuss.elastic.co/t/elasticsearch-interpreter-zeppelin-elastic-cloud-found-to-be-zeppelin-2031/119048 "2018-02-09T13:27:25Z")
Hi All, I am trying to setup Elastcisearch interpreter in zeppelin with our elastic.co/cloud server and unable to access. I can CURL to the server fine: curl -X GET https://myuser:mypassword@myhostname.us-east-1.aws.f… --- ## [Issue/bugs with High Level Rest Client](https://discuss.elastic.co/t/issue-bugs-with-high-level-rest-client/116828)
**Author:** [@Manish\_Bansal](https://discuss.elastic.co/u/Manish_Bansal)\ **Replies:** 3\ **Last updated:** [February 9, 2018, 1:07pm UTC](https://discuss.elastic.co/t/issue-bugs-with-high-level-rest-client/116828 "2018-02-09T13:07:48Z")
Hi There, I am new to Elasticsearch and this forum as well, I am facing a strange issue with my hello world example with Elasticsearch High level Rest API Java Client. this might be an issue with the API or I may not b… --- ## [Similar text search](https://discuss.elastic.co/t/similar-text-search/119211)
**Author:** [@GrigoryPtashko](https://discuss.elastic.co/u/GrigoryPtashko)\ **Replies:** 2\ **Last updated:** [February 9, 2018, 11:50am UTC](https://discuss.elastic.co/t/similar-text-search/119211 "2018-02-09T11:50:38Z")
Hello. I have a database of text objects where some of them are a variant of some others in a certain level of similarity. Specifically, these are news posts where some pieces of news are just slightly modified clones o… [Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1792) [Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1794)