# Elasticsearch **URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=904 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 905 --- ## [Query string query from javascript client](https://discuss.elastic.co/t/query-string-query-from-javascript-client/235084)
**Author:** [@yazhini\_ravi](https://discuss.elastic.co/u/yazhini_ravi)\ **Replies:** 0\ **Last updated:** [May 31, 2020, 7:04pm UTC](https://discuss.elastic.co/t/query-string-query-from-javascript-client/235084 "2020-05-31T19:04:29Z")
Hi, I am using elasticsearch 5.5 and my query is "query":{ "query\_string": { "query": "state:MD AND city:Baltimore AND postalcode:12345" } } This query works fine in kibana. But I use javascript API to execute the… --- ## [Elasticsearch 6.8.x and two versions of OpenJDK](https://discuss.elastic.co/t/elasticsearch-6-8-x-and-two-versions-of-openjdk/235039)
**Author:** [@lazyusername](https://discuss.elastic.co/u/lazyusername)\ **Replies:** 3\ **Last updated:** [May 31, 2020, 6:39pm UTC](https://discuss.elastic.co/t/elasticsearch-6-8-x-and-two-versions-of-openjdk/235039 "2020-05-31T18:39:52Z")
Hello, we have some mid sized cluster around ~70 nodes running on Debian Stretch (9.x) with OpenJDK-8. We will need to add some extra nodes with Debian Buster, where is present OpenJDK-11. Both versions of OpenJDK is o… --- ## [How to increase the priority of the re-indexing task?](https://discuss.elastic.co/t/how-to-increase-the-priority-of-the-re-indexing-task/235031)
**Author:** [@Guerreiro\_Sousa](https://discuss.elastic.co/u/Guerreiro_Sousa)\ **Replies:** 2\ **Last updated:** [May 31, 2020, 3:54pm UTC](https://discuss.elastic.co/t/how-to-increase-the-priority-of-the-re-indexing-task/235031 "2020-05-31T15:54:41Z")
Is it possible to somehow increase the speed of the re-indexing process? How could this be done? I am carrying out this process through the API / \_reindex --- ## [High Rest Client | Search for any value from list](https://discuss.elastic.co/t/high-rest-client-search-for-any-value-from-list/235062)
**Author:** [@AsfK](https://discuss.elastic.co/u/AsfK)\ **Replies:** 1\ **Last updated:** [May 31, 2020, 3:44pm UTC](https://discuss.elastic.co/t/high-rest-client-search-for-any-value-from-list/235062 "2020-05-31T15:44:31Z")
I have a simple index contains filename and status and I want to get all documents contains any filename from a given list. Below is a document sample: { "\_index" : "filestracking", "\_type" : "\_doc", "\_id" … --- ## [\[Ingest Pipeline\] Drop fields if duplicate](https://discuss.elastic.co/t/ingest-pipeline-drop-fields-if-duplicate/234971)
**Author:** [@Fernando\_Ruben\_Otero](https://discuss.elastic.co/u/Fernando_Ruben_Otero)\ **Replies:** 1\ **Last updated:** [May 31, 2020, 3:29pm UTC](https://discuss.elastic.co/t/ingest-pipeline-drop-fields-if-duplicate/234971 "2020-05-31T15:29:06Z")
Is it possible to drop a document if there's another document with the same \_source, or with the same subset of fields from \_source? "processors" : \[ { "drop": { "if": "ctx.\_source == documents\[ctx… --- ## [Snapshot management on S3](https://discuss.elastic.co/t/snapshot-management-on-s3/235000)
**Author:** [@robhuang](https://discuss.elastic.co/u/robhuang)\ **Replies:** 1\ **Last updated:** [May 31, 2020, 3:26pm UTC](https://discuss.elastic.co/t/snapshot-management-on-s3/235000 "2020-05-31T15:26:29Z")
We have ~200tb snapshot stored on S3 now, and I am looking for someways to clean it up. I read the official doc: Snapshots are taken incrementally. This means that when it creates a snapshot of an index, Elasticsearch a… --- ## [Change multiple fields with different variable](https://discuss.elastic.co/t/change-multiple-fields-with-different-variable/232090)
**Author:** [@dotan2401](https://discuss.elastic.co/u/dotan2401)\ **Replies:** 5\ **Last updated:** [May 31, 2020, 2:41pm UTC](https://discuss.elastic.co/t/change-multiple-fields-with-different-variable/232090 "2020-05-31T14:41:26Z")
Hi, I am using version -\> elasticsearch-7.5.2 I want to change multiple fields for a specific index. each field should get a different value. I am using c# Is it possible? currently, it changes all the fields for t… --- ## [Text or Keyword for short non-indexable fields?](https://discuss.elastic.co/t/text-or-keyword-for-short-non-indexable-fields/235069)
**Author:** [@Guerreiro\_Sousa](https://discuss.elastic.co/u/Guerreiro_Sousa)\ **Replies:** 0\ **Last updated:** [May 31, 2020, 2:24pm UTC](https://discuss.elastic.co/t/text-or-keyword-for-short-non-indexable-fields/235069 "2020-05-31T14:24:22Z")
What is cheaper, storing a text field as non-indexable or as a keyword field as non-indexable? I did a test and when storing a keyword type as not indexable the kibana still considers it as an aggregable field. It was f… --- ## [Getting repository verification exception](https://discuss.elastic.co/t/getting-repository-verification-exception/234811)
**Author:** [@hello5346](https://discuss.elastic.co/u/hello5346)\ **Replies:** 5\ **Last updated:** [May 31, 2020, 2:03pm UTC](https://discuss.elastic.co/t/getting-repository-verification-exception/234811 "2020-05-31T14:03:28Z")
I am trying to create snapshots of my ealsticsearch in s3 bucket. i had created an s3 bucket with public access and created an user with the following permission { "Statement": \[ { "Action": \[ … --- ## [Sorted scrolls and cache](https://discuss.elastic.co/t/sorted-scrolls-and-cache/235057)
**Author:** [@mlioz](https://discuss.elastic.co/u/mlioz)\ **Replies:** 0\ **Last updated:** [May 31, 2020, 9:58am UTC](https://discuss.elastic.co/t/sorted-scrolls-and-cache/235057 "2020-05-31T09:58:35Z")
Hi, I'm trying to understand how sorted scrolls work. After reading https://discuss.elastic.co/t/sorted-scroll-internal-workings-for-performance-optimizations/23866 I understand that some scrolls are stored in cache fo… --- ## [Query with union and subtract by field](https://discuss.elastic.co/t/query-with-union-and-subtract-by-field/235056)
**Author:** [@wildfire\_enterprise](https://discuss.elastic.co/u/wildfire_enterprise)\ **Replies:** 0\ **Last updated:** [May 31, 2020, 9:15am UTC](https://discuss.elastic.co/t/query-with-union-and-subtract-by-field/235056 "2020-05-31T09:15:13Z")
Hi. I'm new in elasticsearch, need some help to write a query. Assume this is my index data: "\_source" : { "id" : "1", "tag" : "tag1" } "\_source" : { "id" : "2", "tag" : "tag1" }… --- ## [ElasticSearch Cluster overload , Master removes and adds data node](https://discuss.elastic.co/t/elasticsearch-cluster-overload-master-removes-and-adds-data-node/234153)
**Author:** [@Parviz\_Makari](https://discuss.elastic.co/u/Parviz_Makari)\ **Replies:** 4\ **Last updated:** [May 30, 2020, 11:15pm UTC](https://discuss.elastic.co/t/elasticsearch-cluster-overload-master-removes-and-adds-data-node/234153 "2020-05-30T23:15:22Z")
Hi all, We're facing latency issue with our ES cluster. It started to happen since we rolled out a new service which is sending bulk requests to ES (there are other services which send bulk requests too). On average we … --- ## [ValidationError: child "xpack" fails because \[child "security" fails because \["authc" is not allowed\]\]](https://discuss.elastic.co/t/validationerror-child-xpack-fails-because-child-security-fails-because-authc-is-not-allowed/235006)
**Author:** [@Shan\_Chathusanda](https://discuss.elastic.co/u/Shan_Chathusanda)\ **Replies:** 4\ **Last updated:** [May 30, 2020, 8:20pm UTC](https://discuss.elastic.co/t/validationerror-child-xpack-fails-because-child-security-fails-because-authc-is-not-allowed/235006 "2020-05-30T20:20:55Z")
I am trying to add SAML authentication by referring the following doc. https://www.elastic.co/guide/en/kibana/current/kibana-authentication.html#saml I added the configs to the kibana.yml and start kibana server. Then … --- ## [Ingest pipeline set processor override property](https://discuss.elastic.co/t/ingest-pipeline-set-processor-override-property/235034)
**Author:** [@Dumitrel\_Ciprian](https://discuss.elastic.co/u/Dumitrel_Ciprian)\ **Replies:** 0\ **Last updated:** [May 30, 2020, 8:14pm UTC](https://discuss.elastic.co/t/ingest-pipeline-set-processor-override-property/235034 "2020-05-30T20:14:29Z")
Hi, I have difficulties in using the "override" option of the SET processor. The use case is the following: I'm creating a document like this: POST test\_index/\_doc { "foo": "foo", "bar": "bar" } Sometimes I … --- ## [Mlt - gives bad resaults](https://discuss.elastic.co/t/mlt-gives-bad-resaults/235030)
**Author:** [@Yaron\_K](https://discuss.elastic.co/u/Yaron_K)\ **Replies:** 0\ **Last updated:** [May 30, 2020, 6:20pm UTC](https://discuss.elastic.co/t/mlt-gives-bad-resaults/235030 "2020-05-30T18:20:33Z")
Hi, the reason i'm trying elastic is that i have in my company a lot of "tickets", i want to have the ability to search ticket that similar to another ticket. so i loaded most of the tickets to the elastic, all the tex… --- ## [Elasticsearch cluster health red and data backups](https://discuss.elastic.co/t/elasticsearch-cluster-health-red-and-data-backups/234848)
**Author:** [@Roshan\_Jha](https://discuss.elastic.co/u/Roshan_Jha)\ **Replies:** 5\ **Last updated:** [May 30, 2020, 3:11pm UTC](https://discuss.elastic.co/t/elasticsearch-cluster-health-red-and-data-backups/234848 "2020-05-30T15:11:49Z")
I have Elasticsearch cluster of 3 nodes, it was working fine till now then i changed default path.data path to my own custom data path and restarted the whole cluster now my cluster is in red state and when running clust… --- ## [Elasticsearch download on aws ec2 linux](https://discuss.elastic.co/t/elasticsearch-download-on-aws-ec2-linux/233575)
**Author:** [@Jun.8](https://discuss.elastic.co/u/Jun.8)\ **Replies:** 15\ **Last updated:** [May 30, 2020, 1:23pm UTC](https://discuss.elastic.co/t/elasticsearch-download-on-aws-ec2-linux/233575 "2020-05-30T13:23:30Z")
Hi, I'm trying to set elasticsearch on my AWS EC2 Linux server. I've followed the steps in https://www.elastic.co/guide/en/elasticsearch/reference/current/rpm.html using rpm. But I found the error message when I input … --- ## [Sorting on large index](https://discuss.elastic.co/t/sorting-on-large-index/235017)
**Author:** [@YvorL](https://discuss.elastic.co/u/YvorL)\ **Replies:** 1\ **Last updated:** [May 30, 2020, 1:16pm UTC](https://discuss.elastic.co/t/sorting-on-large-index/235017 "2020-05-30T13:16:28Z")
Hi! I read about index sorting in the documentation, but I don't know what are the limits and if there's any downside to do it. For example, I have a daily index with around 500M documents. I'd sort it by 5 fields from … --- ## [Nagios with Elastic](https://discuss.elastic.co/t/nagios-with-elastic/235016)
**Author:** [@shalauras](https://discuss.elastic.co/u/shalauras)\ **Replies:** 0\ **Last updated:** [May 30, 2020, 12:12pm UTC](https://discuss.elastic.co/t/nagios-with-elastic/235016 "2020-05-30T12:12:56Z")
Hi, I want to implement Nagios with Elastic and I can see notifications from Nagios in Elastic (Kibana). I am trying to install following manual: But when I try last step: /usr/share/logstash/bin/logstash --modules… --- ## [Getting "I/O dispatcher 1" java.lang.OutOfMemoryError: Direct buffer memory](https://discuss.elastic.co/t/getting-i-o-dispatcher-1-java-lang-outofmemoryerror-direct-buffer-memory/235013)
**Author:** [@HShetty](https://discuss.elastic.co/u/HShetty)\ **Replies:** 0\ **Last updated:** [May 30, 2020, 12:04pm UTC](https://discuss.elastic.co/t/getting-i-o-dispatcher-1-java-lang-outofmemoryerror-direct-buffer-memory/235013 "2020-05-30T12:04:14Z")
Continuing the discussion from Getting the error - Request cannot be executed; I/O reactor status: STOPPED: 2020-05-28T15:24:52.96+0530 \[RTR/0\] OUT 2020-05-28T15:24:53.72+0530 \[APP/PROC/WEB/0\] ERR Exception in thread "… --- ## [Relational indexes](https://discuss.elastic.co/t/relational-indexes/234946)
**Author:** [@adwaitjoshi](https://discuss.elastic.co/u/adwaitjoshi)\ **Replies:** 1\ **Last updated:** [May 30, 2020, 10:30am UTC](https://discuss.elastic.co/t/relational-indexes/234946 "2020-05-30T10:30:37Z")
I have two indexes where I almost need to do a join. An ID in one index needs to pull up information in another index. How can I do this in ELK? --- ## [Unable to configure oidc](https://discuss.elastic.co/t/unable-to-configure-oidc/234821)
**Author:** [@bandapally\_kumar](https://discuss.elastic.co/u/bandapally_kumar)\ **Replies:** 6\ **Last updated:** [May 30, 2020, 8:32am UTC](https://discuss.elastic.co/t/unable-to-configure-oidc/234821 "2020-05-30T08:32:22Z")
we are trying to setup elasticsearch to use oidc for authentication here is my yaml file xpack.security.authc.token.enabled: true xpack.security.authc.realms.oidc.oidc1: order: 1 rp.client\_id: "6bd9f9a3-… --- ## [Datastructure relational data](https://discuss.elastic.co/t/datastructure-relational-data/234561)
**Author:** [@michael\_9](https://discuss.elastic.co/u/michael_9)\ **Replies:** 7\ **Last updated:** [May 30, 2020, 4:28am UTC](https://discuss.elastic.co/t/datastructure-relational-data/234561 "2020-05-30T04:28:02Z")
I have the following data structure: I have a hierarchical structure where every element can link to n-further elements. (Similar to a tree, but an object can have multiple roots. A link is only downwards possible). The … --- ## [Kibana Canvas DISTINCT key word](https://discuss.elastic.co/t/kibana-canvas-distinct-key-word/234999)
**Author:** [@Khirod\_Panda](https://discuss.elastic.co/u/Khirod_Panda)\ **Replies:** 0\ **Last updated:** [May 30, 2020, 3:15am UTC](https://discuss.elastic.co/t/kibana-canvas-distinct-key-word/234999 "2020-05-30T03:15:19Z")
I am trying to run following query as SQL . its erring saying DISTINCT is not allowed SELECT DISTINCT ("context.correlationId" , gqlOperationName ) FROM "alpha-\*" where isError ='1' Can I any way achieve this in canvas… --- ## [Indexing User-Agent data](https://discuss.elastic.co/t/indexing-user-agent-data/231972)
**Author:** [@Jalpesh1](https://discuss.elastic.co/u/Jalpesh1)\ **Replies:** 7\ **Last updated:** [May 30, 2020, 3:12am UTC](https://discuss.elastic.co/t/indexing-user-agent-data/231972 "2020-05-30T03:12:32Z")
Hi Team, I have below user-agent column in Elastic doc tag.http@user\_agent - Mozilla/5.0 (Macintosh; Intel Mac OS X 10\_14\_6) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/74.0.3729.157 Safari/537.36 I want to spl… --- ## [Want to get distinct record across 2 fields](https://discuss.elastic.co/t/want-to-get-distinct-record-across-2-fields/234740)
**Author:** [@Khirod\_Panda](https://discuss.elastic.co/u/Khirod_Panda)\ **Replies:** 2\ **Last updated:** [May 30, 2020, 3:11am UTC](https://discuss.elastic.co/t/want-to-get-distinct-record-across-2-fields/234740 "2020-05-30T03:11:00Z")
I have an index where data may be duplicating . but in those duplicating data set. i have 2 fields that does not change . Now I want to get count of distinct records Ex:- cid='AE123456XYZ', opname ='getData' isError=… --- ## [Maximum number of snapshots](https://discuss.elastic.co/t/maximum-number-of-snapshots/234956)
**Author:** [@chiara](https://discuss.elastic.co/u/chiara)\ **Replies:** 1\ **Last updated:** [May 30, 2020, 3:07am UTC](https://discuss.elastic.co/t/maximum-number-of-snapshots/234956 "2020-05-30T03:07:30Z")
Does a limit exist for snapshots? Can I have 72 snapshots of the same cluster? Can I have any issue in restoring one of those snapshot to the old cluster or to a new cluster? I mean, in other situations forever increm… --- ## [When insert into django model elastic search gives error](https://discuss.elastic.co/t/when-insert-into-django-model-elastic-search-gives-error/234998)
**Author:** [@Shriram\_Choubey](https://discuss.elastic.co/u/Shriram_Choubey)\ **Replies:** 0\ **Last updated:** [May 30, 2020, 1:45am UTC](https://discuss.elastic.co/t/when-insert-into-django-model-elastic-search-gives-error/234998 "2020-05-30T01:45:24Z")
'error': {'type': 'mapper\_parsing\_exception', 'reason': "failed to parse field \[transaction\_timestamp\] of type \[date\] in document with id '3'. Preview of field's value: '2020-05-29 17:50:51.721000'", 'caused\_by': {'type… --- ## [Combining three different indices into one available to be queried by ODBC with Tableau](https://discuss.elastic.co/t/combining-three-different-indices-into-one-available-to-be-queried-by-odbc-with-tableau/234864)
**Author:** [@saif3r](https://discuss.elastic.co/u/saif3r)\ **Replies:** 2\ **Last updated:** [May 29, 2020, 1:44pm UTC](https://discuss.elastic.co/t/combining-three-different-indices-into-one-available-to-be-queried-by-odbc-with-tableau/234864 "2020-05-29T13:44:03Z")
Hello, I have three different indices called: first, second, third. first is the main index, second references to main and third references to second index using id fields. The sample data looks like this: first - 2 … --- ## [Watcher email alert fails intermittently](https://discuss.elastic.co/t/watcher-email-alert-fails-intermittently/234994)
**Author:** [@cglencr](https://discuss.elastic.co/u/cglencr)\ **Replies:** 0\ **Last updated:** [May 29, 2020, 10:46pm UTC](https://discuss.elastic.co/t/watcher-email-alert-fails-intermittently/234994 "2020-05-29T22:46:47Z")
I am using ES 7.4 and have created a Watcher with an email alert. It is scheduled to go off once a day. Some days it works. Others it fails. And this is with no changes to ES or environment. When I go to research why… [Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=903) [Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=905)