# Elasticsearch **URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1258 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1259 --- ## [Is it possible to create a customized S3 client to connect via the repository-s3 plugin?](https://discuss.elastic.co/t/is-it-possible-to-create-a-customized-s3-client-to-connect-via-the-repository-s3-plugin/186259)
**Author:** [@slmingol](https://discuss.elastic.co/u/slmingol)\ **Replies:** 10\ **Last updated:** [June 19, 2019, 12:30pm UTC](https://discuss.elastic.co/t/is-it-possible-to-create-a-customized-s3-client-to-connect-via-the-repository-s3-plugin/186259 "2019-06-19T12:30:46Z")
The docs would lead you to believe that it's possible to create your own clients as part of the repository-s3 plugin. PUT \_snapshot/my\_s3\_repository { "type": "s3", "settings": { "bucket": "my\_bucket", "clie… --- ## [License validation seems to take for very long](https://discuss.elastic.co/t/license-validation-seems-to-take-for-very-long/186126)
**Author:** [@jmartori](https://discuss.elastic.co/u/jmartori)\ **Replies:** 9\ **Last updated:** [June 19, 2019, 12:30pm UTC](https://discuss.elastic.co/t/license-validation-seems-to-take-for-very-long/186126 "2019-06-19T12:30:07Z")
Hi everyone, we are currently running a cluster 5.6 with 5 nodes, 4 mdi and 1 coordinator, and a valid xpack license. When we restart a node it takes forever (about 8minutes) until the license is validated and node is … --- ## [Escaping html in elastic search response](https://discuss.elastic.co/t/escaping-html-in-elastic-search-response/179930)
**Author:** [@Valentin](https://discuss.elastic.co/u/Valentin)\ **Replies:** 7\ **Last updated:** [June 19, 2019, 11:51am UTC](https://discuss.elastic.co/t/escaping-html-in-elastic-search-response/179930 "2019-06-19T11:51:08Z")
Hi everyone, To enable highlighting in elasticsearch search result and avoid javascript injection, we decided to escape special characters before indexing them. But doing this, we have remarked that ascii folding featur… --- ## [Choose Correct Text Analyzer/ Tokenizer](https://discuss.elastic.co/t/choose-correct-text-analyzer-tokenizer/185867)
**Author:** [@M.alsioufi](https://discuss.elastic.co/u/M.alsioufi)\ **Replies:** 3\ **Last updated:** [June 19, 2019, 11:46am UTC](https://discuss.elastic.co/t/choose-correct-text-analyzer-tokenizer/185867 "2019-06-19T11:46:04Z")
I have a text field that represents a file name, this field follow a specific format. It contains several parts separated by underscore (\_) one part could have letters, numbers and dashes (-) and it ends with a dot (.) a… --- ## [Decimal precision issue](https://discuss.elastic.co/t/decimal-precision-issue/186456)
**Author:** [@Karine\_Hovhannisyan](https://discuss.elastic.co/u/Karine_Hovhannisyan)\ **Replies:** 0\ **Last updated:** [June 19, 2019, 11:42am UTC](https://discuss.elastic.co/t/decimal-precision-issue/186456 "2019-06-19T11:42:52Z")
Hi. I'm looking for a way to omit rounding large numbers when uploading to elastic through NEST. I've came through another topic, where it was suggested that Kibana rounds the numbers, rather than Elastic. However, the s… --- ## [Force change cluster master](https://discuss.elastic.co/t/force-change-cluster-master/46155)
**Author:** [@Zaid\_Amir](https://discuss.elastic.co/u/Zaid_Amir)\ **Replies:** 10\ **Last updated:** [June 19, 2019, 11:40am UTC](https://discuss.elastic.co/t/force-change-cluster-master/46155 "2019-06-19T11:40:14Z")
Hi, Today I've been trying to increase the storage of my elasticsearch nodes. The nodes are hosted on AWS EC2 each with an attached EBS of 10 GB. I was trying to increase the EBS size to 20GB for each node and it all w… --- ## [Elasticsearch 7.1.1 cluster not forming using discovery-ec2](https://discuss.elastic.co/t/elasticsearch-7-1-1-cluster-not-forming-using-discovery-ec2/186427)
**Author:** [@haktoggle](https://discuss.elastic.co/u/haktoggle)\ **Replies:** 3\ **Last updated:** [June 19, 2019, 11:14am UTC](https://discuss.elastic.co/t/elasticsearch-7-1-1-cluster-not-forming-using-discovery-ec2/186427 "2019-06-19T11:14:32Z")
I have setup 3 nodes in AWS using discovery-ec2 plugin but they are not forming cluster. They just formed as its own cluster. elasticsearch.yml config on all three nodes bootstrap.memory\_lock: true discovery.seed\_prov… --- ## [X of x shards failed](https://discuss.elastic.co/t/x-of-x-shards-failed/185863)
**Author:** [@jamesp220291](https://discuss.elastic.co/u/jamesp220291)\ **Replies:** 5\ **Last updated:** [June 19, 2019, 10:22am UTC](https://discuss.elastic.co/t/x-of-x-shards-failed/185863 "2019-06-19T10:22:38Z")
Hi I have a single node setup. It looks like each index has 5 primary shards and when loading data on the kibana dashboard, we keep getting x of x shards failed error messages. Can anyone advise how to solve this? --- ## [UpdateRequest upsert with retryOnConflict using BulkProcessor failed](https://discuss.elastic.co/t/updaterequest-upsert-with-retryonconflict-using-bulkprocessor-failed/182455)
**Author:** [@edumucelli](https://discuss.elastic.co/u/edumucelli)\ **Replies:** 7\ **Last updated:** [June 19, 2019, 10:15am UTC](https://discuss.elastic.co/t/updaterequest-upsert-with-retryonconflict-using-bulkprocessor-failed/182455 "2019-06-19T10:15:32Z")
Althought ES documentation and staff suggests using retry\_on\_conflict to mitigate version conflict, this feature is broken. I am using High Level Client 6.6.1 and here is the way I am building the request: IndexRequest… --- ## [NEST v7 backwards compatibility](https://discuss.elastic.co/t/nest-v7-backwards-compatibility/186420)
**Author:** [@olid](https://discuss.elastic.co/u/olid)\ **Replies:** 0\ **Last updated:** [June 19, 2019, 9:22am UTC](https://discuss.elastic.co/t/nest-v7-backwards-compatibility/186420 "2019-06-19T09:22:47Z")
We have some C# client code that currently talks to two clusters using NEST, both of which are on ElasticSearch 6.x, however we want to upgrade one of the clusters to ES 7. From searches on this forum it looks like NEST… --- ## [Heap size Not tally](https://discuss.elastic.co/t/heap-size-not-tally/185789)
**Author:** [@skyluke.1987](https://discuss.elastic.co/u/skyluke.1987)\ **Replies:** 18\ **Last updated:** [June 19, 2019, 9:20am UTC](https://discuss.elastic.co/t/heap-size-not-tally/185789 "2019-06-19T09:20:30Z")
Hi all, may I know is this correct? No matter how I change the heapsize, it will not take any effect. in JVM.options file : -Xms8g -Xmx12g --- ## [HELP ! Upgrade ES 6.7.0 to 7.1.0](https://discuss.elastic.co/t/help-upgrade-es-6-7-0-to-7-1-0/185317)
**Author:** [@skyluke.1987](https://discuss.elastic.co/u/skyluke.1987)\ **Replies:** 30\ **Last updated:** [June 19, 2019, 9:11am UTC](https://discuss.elastic.co/t/help-upgrade-es-6-7-0-to-7-1-0/185317 "2019-06-19T09:11:41Z")
Hi all, I need some help on the upgrading. Following the guide from here: https://www.elastic.co/blog/getting-started-with-elasticsearch-security. I downloaded the installation files and configured. When about to start… --- ## [How to move data in 1.6.0v to 6.4.x](https://discuss.elastic.co/t/how-to-move-data-in-1-6-0v-to-6-4-x/186408)
**Author:** [@Minsik\_Kim](https://discuss.elastic.co/u/Minsik_Kim)\ **Replies:** 2\ **Last updated:** [June 19, 2019, 8:55am UTC](https://discuss.elastic.co/t/how-to-move-data-in-1-6-0v-to-6-4-x/186408 "2019-06-19T08:55:26Z")
My elasticsearch version is so old (1.6.0). I want to upgrade this to 6.4.2v !! But I guess both snapshot type was different :frowning: I've tried 2ways to solve this problem. make snapshot on 1.6.0v And move tha… --- ## [ICU Folding for Latin Subscript Letters](https://discuss.elastic.co/t/icu-folding-for-latin-subscript-letters/186241)
**Author:** [@tiwari.piyush7](https://discuss.elastic.co/u/tiwari.piyush7)\ **Replies:** 0\ **Last updated:** [June 18, 2019, 11:45am UTC](https://discuss.elastic.co/t/icu-folding-for-latin-subscript-letters/186241 "2019-06-18T11:45:31Z")
I have created a custom keyword analyzer which has ICU Folding Token filter. While using this analyzer I noticed that following subscript letters are not supported by ICU Folding: ᵢ \[LATIN SUBSCRIPT SMALL LETTER I\] ᵣ \[… --- ## [Installing and configuring ELK Stack in different servers](https://discuss.elastic.co/t/installing-and-configuring-elk-stack-in-different-servers/186412)
**Author:** [@randomizer0000](https://discuss.elastic.co/u/randomizer0000)\ **Replies:** 0\ **Last updated:** [June 19, 2019, 8:39am UTC](https://discuss.elastic.co/t/installing-and-configuring-elk-stack-in-different-servers/186412 "2019-06-19T08:39:48Z")
Hi, I'm trying to set up two different separated Ubuntu 18.04 servers running on the same network that has logstash installed on one, and both elasticsearch and kibana on another one. I have successfully completed the … --- ## [Filter by size of nested object](https://discuss.elastic.co/t/filter-by-size-of-nested-object/186410)
**Author:** [@Jean-Marc\_Autexier](https://discuss.elastic.co/u/Jean-Marc_Autexier)\ **Replies:** 0\ **Last updated:** [June 19, 2019, 8:22am UTC](https://discuss.elastic.co/t/filter-by-size-of-nested-object/186410 "2019-06-19T08:22:34Z")
Hi, I have an index with nested objects (flags). Example document: { "title": "Sample title", "flags": \[ {"read"}, {"marked"} \] } I want to query all documents which have more than one flag. How can this be d… --- ## [Repository verification exception in kibana](https://discuss.elastic.co/t/repository-verification-exception-in-kibana/186042)
**Author:** [@swapnali](https://discuss.elastic.co/u/swapnali)\ **Replies:** 3\ **Last updated:** [June 19, 2019, 7:56am UTC](https://discuss.elastic.co/t/repository-verification-exception-in-kibana/186042 "2019-06-19T07:56:35Z")
Hi, I want to take snapshot of my cluster, i have three nodes elsearchdv1,elsearchdv2 , elsearchdv3 and master is elsearchdv2. I am using curator, version 5.7.6. i created repository using below command: PUT /\_snapsh… --- ## [Getting error while creating Watcher Email Configuration](https://discuss.elastic.co/t/getting-error-while-creating-watcher-email-configuration/184495)
**Author:** [@stalinbritto](https://discuss.elastic.co/u/stalinbritto)\ **Replies:** 10\ **Last updated:** [June 19, 2019, 7:03am UTC](https://discuss.elastic.co/t/getting-error-while-creating-watcher-email-configuration/184495 "2019-06-19T07:03:37Z")
Hi, I am the new one for ELK installation setup, Now I have completed ELK setup end to end. for POC I have enabled platinum license for one month. Now am trying to setup watcher email configuration, But I couldn't, ge… --- ## [Upgrade assistant fails to reindex due to include\_in\_all field](https://discuss.elastic.co/t/upgrade-assistant-fails-to-reindex-due-to-include-in-all-field/186388)
**Author:** [@juusom](https://discuss.elastic.co/u/juusom)\ **Replies:** 0\ **Last updated:** [June 19, 2019, 6:54am UTC](https://discuss.elastic.co/t/upgrade-assistant-fails-to-reindex-due-to-include-in-all-field/186388 "2019-06-19T06:54:29Z")
Hi, I'm running ES and Kibana 6.8.0, and using the 7.0 upgrade assistant, I'm trying to reindex some old Logstash indices created in ES 5.x. It fails due to the presence of the include\_in\_all field in the index mappings… --- ## [What is .monitor-es-yyyy-mm-dd used to do?](https://discuss.elastic.co/t/what-is-monitor-es-yyyy-mm-dd-used-to-do/186385)
**Author:** [@wenchaodu](https://discuss.elastic.co/u/wenchaodu)\ **Replies:** 1\ **Last updated:** [June 19, 2019, 6:45am UTC](https://discuss.elastic.co/t/what-is-monitor-es-yyyy-mm-dd-used-to-do/186385 "2019-06-19T06:45:38Z")
Hi Team I used ELK 6.3.2, I found there are lots of .monitor-es/kibana-yyyy-mm-dd indices, what does these indices used to do ? May I delete these indices, is there any impacted if i delete these indices ? Thanks Wayn… --- ## [How should I denormalize my data?](https://discuss.elastic.co/t/how-should-i-denormalize-my-data/186379)
**Author:** [@beginner99](https://discuss.elastic.co/u/beginner99)\ **Replies:** 0\ **Last updated:** [June 19, 2019, 6:04am UTC](https://discuss.elastic.co/t/how-should-i-denormalize-my-data/186379 "2019-06-19T06:04:57Z")
Hi all, I'm new to elasticsearch and having trouble to come up with a data model for the index (or maybe I shall create multiple indices?). My data is hierarchical as I have grandparent-parent-child-grandchildren. As a… --- ## [LDAP and X-Pack-Security](https://discuss.elastic.co/t/ldap-and-x-pack-security/186286)
**Author:** [@jorgemuza](https://discuss.elastic.co/u/jorgemuza)\ **Replies:** 1\ **Last updated:** [June 19, 2019, 5:09am UTC](https://discuss.elastic.co/t/ldap-and-x-pack-security/186286 "2019-06-19T05:09:09Z")
I understand that in order to enable X-Pack-Security we have to have a valid license ( which in our case we have GOLD ), and also I know we have to configure TLS for inter-node communication, I understand this is obvious… --- ## [How to prevent both primary and replica shards to be in the same rack/hypervisor?](https://discuss.elastic.co/t/how-to-prevent-both-primary-and-replica-shards-to-be-in-the-same-rack-hypervisor/186366)
**Author:** [@TsuWeiQuan](https://discuss.elastic.co/u/TsuWeiQuan)\ **Replies:** 2\ **Last updated:** [June 19, 2019, 3:31am UTC](https://discuss.elastic.co/t/how-to-prevent-both-primary-and-replica-shards-to-be-in-the-same-rack-hypervisor/186366 "2019-06-19T03:31:05Z")
Hello, I was wondering if given a case where i set Primary Shard : 1 Replica Shard : 1 with this setup What if my primary shad is in node 4 while my replica shad is in node 5 and when rack 1 goes down, I would res… --- ## [Esrally got "The benchmark ended already during warmup" when running custom track](https://discuss.elastic.co/t/esrally-got-the-benchmark-ended-already-during-warmup-when-running-custom-track/186076)
**Author:** [@jackgzj](https://discuss.elastic.co/u/jackgzj)\ **Replies:** 8\ **Last updated:** [June 19, 2019, 3:04am UTC](https://discuss.elastic.co/t/esrally-got-the-benchmark-ended-already-during-warmup-when-running-custom-track/186076 "2019-06-19T03:04:44Z")
I am running a custom track on esrally 1.1.0. My custom index is like: { "mappings": { "\_default\_": { "\_all": { "enabled": false }, "\_field\_names": { "enabled": fals… --- ## [Elasticsearch Free Storage space checkpoint](https://discuss.elastic.co/t/elasticsearch-free-storage-space-checkpoint/186363)
**Author:** [@ardel](https://discuss.elastic.co/u/ardel)\ **Replies:** 0\ **Last updated:** [June 19, 2019, 2:52am UTC](https://discuss.elastic.co/t/elasticsearch-free-storage-space-checkpoint/186363 "2019-06-19T02:52:41Z")
Hello All, Is there a way using curator on how we can check what the cause of sudden decrease in free storage space? BTW, we use elastic search service manage by AWS. Thank you so much in advance. --- ## [Wish list: Ingest pipeline monitoring similar to that for logstash pipelines](https://discuss.elastic.co/t/wish-list-ingest-pipeline-monitoring-similar-to-that-for-logstash-pipelines/186357)
**Author:** [@rugenl](https://discuss.elastic.co/u/rugenl)\ **Replies:** 1\ **Last updated:** [June 19, 2019, 2:34am UTC](https://discuss.elastic.co/t/wish-list-ingest-pipeline-monitoring-similar-to-that-for-logstash-pipelines/186357 "2019-06-19T02:34:11Z")
It sure would be nice to have monitoring for the ingest pipelines :slight\_smile: --- ## [Typescript elasticsearch 7.X - not compiling](https://discuss.elastic.co/t/typescript-elasticsearch-7-x-not-compiling/186348)
**Author:** [@Raj\_Kumar2](https://discuss.elastic.co/u/Raj_Kumar2)\ **Replies:** 0\ **Last updated:** [June 18, 2019, 9:18pm UTC](https://discuss.elastic.co/t/typescript-elasticsearch-7-x-not-compiling/186348 "2019-06-18T21:18:38Z")
I am using "@elastic/elasticsearch": "^7.1.0", when I access the Client form the this library, I get compile errors when I compile and launch in Angular 7 ERROR in ./node\_modules/@elastic/elasticsearch/lib/Connectio… --- ## [Streaming Sink doesnt work without checkpoint?](https://discuss.elastic.co/t/streaming-sink-doesnt-work-without-checkpoint/186345)
**Author:** [@RahulGS](https://discuss.elastic.co/u/RahulGS)\ **Replies:** 1\ **Last updated:** [June 18, 2019, 8:55pm UTC](https://discuss.elastic.co/t/streaming-sink-doesnt-work-without-checkpoint/186345 "2019-06-18T20:55:31Z")
Streaming sink with commit log disabled still throws the exception , any reason why it looks for checkpointlocation when i have option set not to use checkpoint ? :frowning: org.apache.spark.sql.AnalysisException: check… --- ## [What is the best way to Index documents present in a directory](https://discuss.elastic.co/t/what-is-the-best-way-to-index-documents-present-in-a-directory/186325)
**Author:** [@armharish](https://discuss.elastic.co/u/armharish)\ **Replies:** 1\ **Last updated:** [June 18, 2019, 8:04pm UTC](https://discuss.elastic.co/t/what-is-the-best-way-to-index-documents-present-in-a-directory/186325 "2019-06-18T20:04:37Z")
Is there a ES plugin (or any other solution) that can track new file and modifications to existing documents (PDF, TXT/CSV, Excel and MS Word) in a directory and index documents. --- ## [How to get geo data from IP addresses within Elastic](https://discuss.elastic.co/t/how-to-get-geo-data-from-ip-addresses-within-elastic/186330)
**Author:** [@Vincent\_Stevenson](https://discuss.elastic.co/u/Vincent_Stevenson)\ **Replies:** 1\ **Last updated:** [June 18, 2019, 7:42pm UTC](https://discuss.elastic.co/t/how-to-get-geo-data-from-ip-addresses-within-elastic/186330 "2019-06-18T19:42:50Z")
We have log documents that contain IP addresses and this data is already saved in an Elastic index. Can we make use of a custom analyzer to take the IP Address and let us get the geographical data from the IP addresses? … [Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1257) [Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1259)