# Elasticsearch **URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1016 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1017 --- ## [Scroll api or search\_after giving duplicate records](https://discuss.elastic.co/t/scroll-api-or-search-after-giving-duplicate-records/219254)
**Author:** [@arjun\_kumar](https://discuss.elastic.co/u/arjun_kumar)\ **Replies:** 4\ **Last updated:** [February 14, 2020, 9:05am UTC](https://discuss.elastic.co/t/scroll-api-or-search-after-giving-duplicate-records/219254 "2020-02-14T09:05:54Z")
Hi I would like query huge amount of data (more than 500k), to achieve this, I used scroll API and searc\_after(with modified time) in both the cases it's giving me the same records(duplicate) multiple times { … --- ## [No handler found for uri \[/\_sql\] and method \[POST\]](https://discuss.elastic.co/t/no-handler-found-for-uri-sql-and-method-post/219121)
**Author:** [@Basil\_Paul](https://discuss.elastic.co/u/Basil_Paul)\ **Replies:** 6\ **Last updated:** [February 14, 2020, 7:29am UTC](https://discuss.elastic.co/t/no-handler-found-for-uri-sql-and-method-post/219121 "2020-02-14T07:29:27Z")
Hello, I had added the plugin for sql in Elastic search. Inspite of adding sql plugin for sql. Iam unable to run sql queries. Below given is the command: curl -H "Content-Type: application/json" -XPOST 'http://10.94.1… --- ## [Avoid recalculation from scratch of Transform aggregation](https://discuss.elastic.co/t/avoid-recalculation-from-scratch-of-transform-aggregation/218845)
**Author:** [@pmagne](https://discuss.elastic.co/u/pmagne)\ **Replies:** 2\ **Last updated:** [February 14, 2020, 7:14am UTC](https://discuss.elastic.co/t/avoid-recalculation-from-scratch-of-transform-aggregation/218845 "2020-02-14T07:14:33Z")
Hi, In a continuous transform, when a new document is added to the source index and the transform has to update one of its own document, it seems that the aggregations calculations are restarted from scratch. It induces… --- ## [Pipeline in Elastic cloud](https://discuss.elastic.co/t/pipeline-in-elastic-cloud/219215)
**Author:** [@ErwinEnableU](https://discuss.elastic.co/u/ErwinEnableU)\ **Replies:** 2\ **Last updated:** [February 14, 2020, 6:58am UTC](https://discuss.elastic.co/t/pipeline-in-elastic-cloud/219215 "2020-02-14T06:58:19Z")
Hi everyone, I am a new to the Elasticsearch stack. We are using the Elasticsearch cloud (7.5.2). Because logstash isn't part of the cloud solution I am trying out the ingest node using the pipeline. We want to be able… --- ## [Pass raw json string query to Elastic Search using java](https://discuss.elastic.co/t/pass-raw-json-string-query-to-elastic-search-using-java/219154)
**Author:** [@Smack\_Alpha](https://discuss.elastic.co/u/Smack_Alpha)\ **Replies:** 1\ **Last updated:** [February 14, 2020, 6:41am UTC](https://discuss.elastic.co/t/pass-raw-json-string-query-to-elastic-search-using-java/219154 "2020-02-14T06:41:47Z")
I have got the data from Elasticsearch index by using the below code: SearchRequest request = new SearchRequest("football\_sum\_csv").scroll(new TimeValue(60000)); SearchSourceBuilder searchSourceBuilder = new SearchSourc… --- ## [\[SOLVED\] Recommendations for index mapping](https://discuss.elastic.co/t/solved-recommendations-for-index-mapping/219303)
**Author:** [@lepe](https://discuss.elastic.co/u/lepe)\ **Replies:** 0\ **Last updated:** [February 14, 2020, 3:56am UTC](https://discuss.elastic.co/t/solved-recommendations-for-index-mapping/219303 "2020-02-14T03:56:55Z")
I'm trying to imitate a SQL database structure (to have a similar structure, but I can change it if needed). The SQL tables are like: Table: main ------------------------ main\_id : integer added : datetime part\_i… --- ## ["IOException while reading user\_dictionary: /app/config/userdict\_ko.txt"](https://discuss.elastic.co/t/ioexception-while-reading-user-dictionary-app-config-userdict-ko-txt/219314)
**Author:** [@fuzes](https://discuss.elastic.co/u/fuzes)\ **Replies:** 0\ **Last updated:** [February 14, 2020, 6:02am UTC](https://discuss.elastic.co/t/ioexception-while-reading-user-dictionary-app-config-userdict-ko-txt/219314 "2020-02-14T06:02:03Z")
I'm using elastic cloud deployment and i want to add user dictionary to deployment so I add custom plugin with .zip file which is consist of /dictionaries/userdict\_ko.txt and I manage plugins and settings. but when i c… --- ## [How to filter the elastic results based logged person roles and permission](https://discuss.elastic.co/t/how-to-filter-the-elastic-results-based-logged-person-roles-and-permission/219126)
**Author:** [@kiransatheesh](https://discuss.elastic.co/u/kiransatheesh)\ **Replies:** 3\ **Last updated:** [February 14, 2020, 1:56am UTC](https://discuss.elastic.co/t/how-to-filter-the-elastic-results-based-logged-person-roles-and-permission/219126 "2020-02-14T01:56:34Z")
How to filter the elastic results based logged person roles and permission --- ## [Need help to store and access document](https://discuss.elastic.co/t/need-help-to-store-and-access-document/219293)
**Author:** [@Benoit\_Martin](https://discuss.elastic.co/u/Benoit_Martin)\ **Replies:** 0\ **Last updated:** [February 13, 2020, 11:53pm UTC](https://discuss.elastic.co/t/need-help-to-store-and-access-document/219293 "2020-02-13T23:53:42Z")
Hi, Data : { "key1": "value1", "key2": "value2", "key3": "value3", "key4": "value4", "key5": { "key6": \[ { "key7": { "ipv4\_unicast": \[ "somevalue" … --- ## [When to open/close java RestHighLevelClient](https://discuss.elastic.co/t/when-to-open-close-java-resthighlevelclient/219265)
**Author:** [@ViniFKroth](https://discuss.elastic.co/u/ViniFKroth)\ **Replies:** 2\ **Last updated:** [February 13, 2020, 9:49pm UTC](https://discuss.elastic.co/t/when-to-open-close-java-resthighlevelclient/219265 "2020-02-13T21:49:07Z")
Searching the web, I found little to no regarding the the scope of Java's RestHighLevelClient, like tradeoffs on using it application scoped or request scope? I understand that RestLowLevelClient manages a thread pool an… --- ## [Two nodes cluster - can't detect each other](https://discuss.elastic.co/t/two-nodes-cluster-cant-detect-each-other/219098)
**Author:** [@kuku\_blof](https://discuss.elastic.co/u/kuku_blof)\ **Replies:** 2\ **Last updated:** [February 13, 2020, 7:55pm UTC](https://discuss.elastic.co/t/two-nodes-cluster-cant-detect-each-other/219098 "2020-02-13T19:55:26Z")
Hello, I'm running a two nodes cluster on AWS (as EC2 instances, didn't use any community image, installed with RPM). the nodes are 10.90.20.100 and 10.90.20.101, both are reachable to each other in ports 9200 and 930… --- ## [Managing Dangling Indices](https://discuss.elastic.co/t/managing-dangling-indices/219258)
**Author:** [@C\_Sawyer](https://discuss.elastic.co/u/C_Sawyer)\ **Replies:** 2\ **Last updated:** [February 13, 2020, 5:42pm UTC](https://discuss.elastic.co/t/managing-dangling-indices/219258 "2020-02-13T17:42:59Z")
Hi I'm new to ES and have inherited a 3-node data/master cluster which continually logs the same set of DanglingIndices. All of the indices listed are closed. Some appear to be common to all 3 nodes, others only 2 or … --- ## [Fielddata stats](https://discuss.elastic.co/t/fielddata-stats/194315)
**Author:** [@ram123](https://discuss.elastic.co/u/ram123)\ **Replies:** 1\ **Last updated:** [February 13, 2020, 5:28pm UTC](https://discuss.elastic.co/t/fielddata-stats/194315 "2020-02-13T17:28:58Z")
I am on ElasticSearch 6.3 and there are no text fields in my schema with fielddata enabled (but I do have keyword fields). When I do GET /\_stats/fielddata?fields=\* , I see something like \` "\_all" : { "primaries" : {… --- ## [Question about approximate counts](https://discuss.elastic.co/t/question-about-approximate-counts/218800)
**Author:** [@axlrosen](https://discuss.elastic.co/u/axlrosen)\ **Replies:** 5\ **Last updated:** [February 13, 2020, 5:22pm UTC](https://discuss.elastic.co/t/question-about-approximate-counts/218800 "2020-02-13T17:22:21Z")
We're currently evaluating Elasticsearch, and trying to get a handle on the approximate counts that it uses. I know that in cardinality aggregations, the default value for 'precision\_threshold' is 3000. I think this mean… --- ## [Watcher to create snapshot and restore snapshot](https://discuss.elastic.co/t/watcher-to-create-snapshot-and-restore-snapshot/219236)
**Author:** [@jlim0930](https://discuss.elastic.co/u/jlim0930)\ **Replies:** 2\ **Last updated:** [February 13, 2020, 5:07pm UTC](https://discuss.elastic.co/t/watcher-to-create-snapshot-and-restore-snapshot/219236 "2020-02-13T17:07:23Z")
I am trying to create a watcher to create a snapshot and another watcher to restore the same snapshot then delete it. to take the snapshot I have POST \_watcher/watch/test { "trigger": { "schedule": { "inter… --- ## [How to get particular document using cmd from an index in Elastic Search](https://discuss.elastic.co/t/how-to-get-particular-document-using-cmd-from-an-index-in-elastic-search/219020)
**Author:** [@Joseph\_Raj](https://discuss.elastic.co/u/Joseph_Raj)\ **Replies:** 8\ **Last updated:** [February 13, 2020, 4:45pm UTC](https://discuss.elastic.co/t/how-to-get-particular-document-using-cmd-from-an-index-in-elastic-search/219020 "2020-02-13T16:45:31Z")
We want to see the particular document is available in ES under the particular index, so we tried the below query in cerebro visualization tool. GET Method en\_y\_91/basic\_type/denmod\_y\_107722 Output: { "\_index": "… --- ## [ElasticSearch - DiskThresholdMonitor - Indexes read only](https://discuss.elastic.co/t/elasticsearch-diskthresholdmonitor-indexes-read-only/219250)
**Author:** [@Klearchos\_Klearchou](https://discuss.elastic.co/u/Klearchos_Klearchou)\ **Replies:** 1\ **Last updated:** [February 13, 2020, 4:24pm UTC](https://discuss.elastic.co/t/elasticsearch-diskthresholdmonitor-indexes-read-only/219250 "2020-02-13T16:24:21Z")
Hi , I am receiving the following exception: org.elasticsearch.ElasticsearchStatusException: Elasticsearch exception \[type=cluster\_block\_exception, reason=blocked by: \[FORBIDDEN/12/index read-only / allow delete (api)\]… --- ## [G Suite integration with ELK](https://discuss.elastic.co/t/g-suite-integration-with-elk/219244)
**Author:** [@data101](https://discuss.elastic.co/u/data101)\ **Replies:** 0\ **Last updated:** [February 13, 2020, 3:50pm UTC](https://discuss.elastic.co/t/g-suite-integration-with-elk/219244 "2020-02-13T15:50:44Z")
Hi everybody, hope that someone can help me to solve my issue. I've already read all the related topics on this forum but didn't find anything apt to me. I wanted to know whether is it possible to integrate G Suite log… --- ## [Dense vector Euclidean Distance comparison function speed](https://discuss.elastic.co/t/dense-vector-euclidean-distance-comparison-function-speed/218992)
**Author:** [@ndtreviv](https://discuss.elastic.co/u/ndtreviv)\ **Replies:** 1\ **Last updated:** [February 13, 2020, 3:37pm UTC](https://discuss.elastic.co/t/dense-vector-euclidean-distance-comparison-function-speed/218992 "2020-02-13T15:37:35Z")
Are there any benchmarks on the speed of this function (release in 7.4, I believe)? I have some data that represents a high-dimension vectors that I'd like to consider it for. Thanks for any help! --- ## [Elastic search book recommendation 2020](https://discuss.elastic.co/t/elastic-search-book-recommendation-2020/219007)
**Author:** [@raghavan20](https://discuss.elastic.co/u/raghavan20)\ **Replies:** 2\ **Last updated:** [February 13, 2020, 2:32pm UTC](https://discuss.elastic.co/t/elastic-search-book-recommendation-2020/219007 "2020-02-13T14:32:08Z")
Hi, I do use the online documentation for reference. At the same time, I would like to read book(s) which help understand Elastic Search (not LK) in-depth. Hope the book would cover following areas in-depth indexes cl… --- ## [A question about primary/replica re-sync implementation](https://discuss.elastic.co/t/a-question-about-primary-replica-re-sync-implementation/219109)
**Author:** [@iamorchid](https://discuss.elastic.co/u/iamorchid)\ **Replies:** 3\ **Last updated:** [February 13, 2020, 2:10pm UTC](https://discuss.elastic.co/t/a-question-about-primary-replica-re-sync-implementation/219109 "2020-02-13T14:10:12Z")
Let's say we have 3 replicas for one index shard and they have the following local op seqs: node#1(primary) : 1, 2, 3, 4, 5, 6, 7, 8 (local checkpoint: 8, max seqNo: 8, global checkpoint: 5) node#2(replica#1): 1, 2, 3… --- ## [CCR - Connections between nodes](https://discuss.elastic.co/t/ccr-connections-between-nodes/218872)
**Author:** [@javierE](https://discuss.elastic.co/u/javierE)\ **Replies:** 2\ **Last updated:** [February 13, 2020, 2:06pm UTC](https://discuss.elastic.co/t/ccr-connections-between-nodes/218872 "2020-02-13T14:06:34Z")
Hi, I am testing CCR and I have some doubts about its operation. When defining a remote cluster, according to the documentation, 3 default connections to selected gateway nodes are established. I understand that these… --- ## [Upgrade ECK cluster 7.5.2 to 7.6.0](https://discuss.elastic.co/t/upgrade-eck-cluster-7-5-2-to-7-6-0/219193)
**Author:** [@operatorequals](https://discuss.elastic.co/u/operatorequals)\ **Replies:** 0\ **Last updated:** [February 13, 2020, 12:09pm UTC](https://discuss.elastic.co/t/upgrade-eck-cluster-7-5-2-to-7-6-0/219193 "2020-02-13T12:09:29Z")
Hello people! A week ago, I used: kubectl apply -f https://download.elastic.co/downloads/eck/1.0.0/all-in-one.yaml and created an ES cluster in a Kubernetes (deployed in EC2 instances), of version 7.5.2. Today, as I … --- ## [How to limit results with same field value to X amount of documents every time it shows up multiple times in a row](https://discuss.elastic.co/t/how-to-limit-results-with-same-field-value-to-x-amount-of-documents-every-time-it-shows-up-multiple-times-in-a-row/217809)
**Author:** [@SeverinDK](https://discuss.elastic.co/u/SeverinDK)\ **Replies:** 9\ **Last updated:** [February 13, 2020, 12:58pm UTC](https://discuss.elastic.co/t/how-to-limit-results-with-same-field-value-to-x-amount-of-documents-every-time-it-shows-up-multiple-times-in-a-row/217809 "2020-02-13T12:58:21Z")
I have an issue that I am not quite sure how to solve. Really hope someone here can help me figure out how to go about it. Imagine that I have 100 documents, all with user\_id fields. I know that most documents are from … --- ## [Question about diacritics stored as NCR data in database](https://discuss.elastic.co/t/question-about-diacritics-stored-as-ncr-data-in-database/219196)
**Author:** [@Wakizashi\_Yoshikawa](https://discuss.elastic.co/u/Wakizashi_Yoshikawa)\ **Replies:** 0\ **Last updated:** [February 13, 2020, 12:18pm UTC](https://discuss.elastic.co/t/question-about-diacritics-stored-as-ncr-data-in-database/219196 "2020-02-13T12:18:09Z")
Hello, hopefully someone will be able to clarify this for me. We are planing e-commerce upgrade to a system that comes with ES built in. Our current data in the database is stored as UTF-8. However during the migration… --- ## [Elastic Cluster Rejected Execution Exception](https://discuss.elastic.co/t/elastic-cluster-rejected-execution-exception/219143)
**Author:** [@Garima\_Tripathi](https://discuss.elastic.co/u/Garima_Tripathi)\ **Replies:** 2\ **Last updated:** [February 13, 2020, 10:43am UTC](https://discuss.elastic.co/t/elastic-cluster-rejected-execution-exception/219143 "2020-02-13T10:43:28Z")
Hi, I have the following cluster configuration : Master -3 node (4 cpu, 20 gb ram) coordinating -3 node (16 cpu, 98 GB,) data- 5 node (28 cpu, 48 RAM) And thread pool configuration is following thread\_pool: search… --- ## [Building a website that uses elastic](https://discuss.elastic.co/t/building-a-website-that-uses-elastic/219051)
**Author:** [@iukea](https://discuss.elastic.co/u/iukea)\ **Replies:** 2\ **Last updated:** [February 13, 2020, 10:27am UTC](https://discuss.elastic.co/t/building-a-website-that-uses-elastic/219051 "2020-02-13T10:27:49Z")
Hello, I need some wisdom and guidance. I am trying to build a website where users can submit an IP address into a search box and that search box reaches into an Elasticsearch server and pulls out the data associated w… --- ## [Search empty string not working](https://discuss.elastic.co/t/search-empty-string-not-working/219049)
**Author:** [@telebh](https://discuss.elastic.co/u/telebh)\ **Replies:** 1\ **Last updated:** [February 13, 2020, 9:59am UTC](https://discuss.elastic.co/t/search-empty-string-not-working/219049 "2020-02-13T09:59:48Z")
hi there, I am searching ES to find empty string field using "must\_not" and exists as follows, but it returns "0" hits. After I change the query to "must" and exists I am getting all hits where the filed having empty va… --- ## [Illegal\_argument\_exception while creating new index](https://discuss.elastic.co/t/illegal-argument-exception-while-creating-new-index/219074)
**Author:** [@JustSomeoneOnline](https://discuss.elastic.co/u/JustSomeoneOnline)\ **Replies:** 1\ **Last updated:** [February 13, 2020, 9:54am UTC](https://discuss.elastic.co/t/illegal-argument-exception-while-creating-new-index/219074 "2020-02-13T09:54:41Z")
Hi. I'm running into issues when trying to create a new index in ElasticSearch 7.5 The error message is: The difference between max\_gram and min\_gram in NGram Tokenizer must be less than or equal to: \[1\] but was \[18\]. … --- ## [Geopoint requires deprecated Elasticsearch mapping types](https://discuss.elastic.co/t/geopoint-requires-deprecated-elasticsearch-mapping-types/219085)
**Author:** [@Junebee](https://discuss.elastic.co/u/Junebee)\ **Replies:** 1\ **Last updated:** [February 13, 2020, 9:49am UTC](https://discuss.elastic.co/t/geopoint-requires-deprecated-elasticsearch-mapping-types/219085 "2020-02-13T09:49:52Z")
I would like to add Geopoint data to my index. The Elasticsearch 7.6 geoip processor states I need to add the geopoint type to my index mappings. https://www.elastic.co/guide/en/logstash/current/plugins-filters-geoip.… [Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1015) [Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1017)