# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1878

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1879

---

## [Problem with inconsistently inserted documents using javascript client with etl](https://discuss.elastic.co/t/problem-with-inconsistently-inserted-documents-using-javascript-client-with-etl/108943)

<div class="topic-metadata">

**Author:** [@kyv](https://discuss.elastic.co/u/kyv)\
**Replies:** 1\
**Last updated:** [November 24, 2017, 6:21am UTC](https://discuss.elastic.co/t/problem-with-inconsistently-inserted-documents-using-javascript-client-with-etl/108943 "2017-11-24T06:21:14Z")

</div>

I am having trouble with the consistency of indexing data using javascript client and etl package for node. My code imports data to mongodb or elasticsearch, depending on a config option. The following code contains t…

---

## [Analyze case sensitive/insensitive](https://discuss.elastic.co/t/analyze-case-sensitive-insensitive/108946)

<div class="topic-metadata">

**Author:** [@Anthonio\_Martinez](https://discuss.elastic.co/u/Anthonio_Martinez)\
**Replies:** 1\
**Last updated:** [November 24, 2017, 6:19am UTC](https://discuss.elastic.co/t/analyze-case-sensitive-insensitive/108946 "2017-11-24T06:19:05Z")

</div>

Hello, I'm new to the forum, I have to ask for help to solve a problem, I have an "analyzer" created in the following way that will leave you lines below, however, I need it to work as follows: 1.- Perform the search o…

---

## [Duplicate document in Elasticsearch5.4](https://discuss.elastic.co/t/duplicate-document-in-elasticsearch5-4/108950)

<div class="topic-metadata">

**Author:** [@Albert\_zheng](https://discuss.elastic.co/u/Albert_zheng)\
**Replies:** 2\
**Last updated:** [November 24, 2017, 6:16am UTC](https://discuss.elastic.co/t/duplicate-document-in-elasticsearch5-4/108950 "2017-11-24T06:16:03Z")

</div>

I try to use fingerprint to create document ID for overwriting duplicate document. but i found some document still uses auto\_id in \_id field, does anyone has same issue in ES 5.4? \[image\] \[image\]

---

## [How HighlightBuilder work on wildcardQuery](https://discuss.elastic.co/t/how-highlightbuilder-work-on-wildcardquery/108838)

<div class="topic-metadata">

**Author:** [@dearnero](https://discuss.elastic.co/u/dearnero)\
**Replies:** 3\
**Last updated:** [November 24, 2017, 6:13am UTC](https://discuss.elastic.co/t/how-highlightbuilder-work-on-wildcardquery/108838 "2017-11-24T06:13:48Z")

</div>

i have a field(not\_analyzed) now i want to use wildcardQuery work on this field. for example： i use 'hell\*' to query, and expect ‘hello,world’ not ‘hello,world’

---

## [Elasticsearch.yml made an error after adding \[bootstrap.mlockall: true\]. The version used was 5.6.3](https://discuss.elastic.co/t/elasticsearch-yml-made-an-error-after-adding-bootstrap-mlockall-true-the-version-used-was-5-6-3/108660)

<div class="topic-metadata">

**Author:** [@648007679](https://discuss.elastic.co/u/648007679)\
**Replies:** 4\
**Last updated:** [November 24, 2017, 5:55am UTC](https://discuss.elastic.co/t/elasticsearch-yml-made-an-error-after-adding-bootstrap-mlockall-true-the-version-used-was-5-6-3/108660 "2017-11-24T05:55:45Z")

</div>

Hi elasticsearch.yml is after adding \[bootstrap.mlockall: true\],An error occurred while the program was started: uncaught exception in thread \[main\] org.elasticsearch.bootstrap.StartupException: java.lang.IllegalArgum…

---

## [A ruined shard caused ES node down](https://discuss.elastic.co/t/a-ruined-shard-caused-es-node-down/108810)

<div class="topic-metadata">

**Author:** [@HelloUniverse](https://discuss.elastic.co/u/HelloUniverse)\
**Replies:** 9\
**Last updated:** [November 24, 2017, 2:46am UTC](https://discuss.elastic.co/t/a-ruined-shard-caused-es-node-down/108810 "2017-11-24T02:46:17Z")

</div>

Does anyone encounter this kind of problem? A ruined but appeared as healthy shard caused the ES node shut down, and a memory dump is created. The ES we used is 5.4.1. We have an index with more than 200GB data, and 12 …

---

## [Reindex with field value converted to uppercase](https://discuss.elastic.co/t/reindex-with-field-value-converted-to-uppercase/108937)

<div class="topic-metadata">

**Author:** [@abhisheksimion](https://discuss.elastic.co/u/abhisheksimion)\
**Replies:** 1\
**Last updated:** [November 24, 2017, 12:53am UTC](https://discuss.elastic.co/t/reindex-with-field-value-converted-to-uppercase/108937 "2017-11-24T00:53:18Z")

</div>

I am trying to migrate from ES 1.4 to ES 5.5. In one of the index I need to change the name of field and also convert it's value to uppercase. I am able to reindex with change in name of field and remove the unwanted fie…

---

## [Can elastic support these requirments](https://discuss.elastic.co/t/can-elastic-support-these-requirments/108682)

<div class="topic-metadata">

**Author:** [@sharongur](https://discuss.elastic.co/u/sharongur)\
**Replies:** 4\
**Last updated:** [November 23, 2017, 10:13pm UTC](https://discuss.elastic.co/t/can-elastic-support-these-requirments/108682 "2017-11-23T22:13:26Z")

</div>

Hi all, Im now considering which DB i should use and elastic is a strong candidate. I have few requirements im not sure if ES can handle, i would appreciate if someone with experience can assure me it can be done befor…

---

## [Create Index with GeoPoint type](https://discuss.elastic.co/t/create-index-with-geopoint-type/107293)

<div class="topic-metadata">

**Author:** [@yanwei2508](https://discuss.elastic.co/u/yanwei2508)\
**Replies:** 9\
**Last updated:** [November 23, 2017, 8:22pm UTC](https://discuss.elastic.co/t/create-index-with-geopoint-type/107293 "2017-11-23T20:22:07Z")

</div>

NEST/Elasticsearch.Net version:5.5 I want to Create index with model like below: public class company { public long id { get; set; } public string name { get; set; } public string address { get; set; } public long…

---

## [Viewing search results using NEST](https://discuss.elastic.co/t/viewing-search-results-using-nest/108724)

<div class="topic-metadata">

**Author:** [@Liron1379](https://discuss.elastic.co/u/Liron1379)\
**Replies:** 2\
**Last updated:** [November 23, 2017, 8:19pm UTC](https://discuss.elastic.co/t/viewing-search-results-using-nest/108724 "2017-11-23T20:19:30Z")

</div>

Hi! Im having a bit trouble getting the actual results (or JSON). I know that the query works by the .total number of results.. To view the results im trying to use: results = searchResponse.Documents; Consol…

---

## [Can you run a bucket selector aggregation using the output of a stats bucket agg?](https://discuss.elastic.co/t/can-you-run-a-bucket-selector-aggregation-using-the-output-of-a-stats-bucket-agg/108432)

<div class="topic-metadata">

**Author:** [@jtalmi](https://discuss.elastic.co/u/jtalmi)\
**Replies:** 4\
**Last updated:** [November 23, 2017, 5:13pm UTC](https://discuss.elastic.co/t/can-you-run-a-bucket-selector-aggregation-using-the-output-of-a-stats-bucket-agg/108432 "2017-11-23T17:13:42Z")

</div>

Hi, The basic overview of the user events query below: We bucket by week, then we bucket by user, then for each user we bucket by day, to get events per day per user per week. The goal is to return a count of users who …

---

## [Loading cluster information is taking too long](https://discuss.elastic.co/t/loading-cluster-information-is-taking-too-long/108911)

<div class="topic-metadata">

**Author:** [@Wedney\_Yuri](https://discuss.elastic.co/u/Wedney_Yuri)\
**Replies:** 3\
**Last updated:** [November 23, 2017, 4:10pm UTC](https://discuss.elastic.co/t/loading-cluster-information-is-taking-too-long/108911 "2017-11-23T16:10:10Z")

</div>

Hi guys, we are experiencing nodes lefting and joining the cluster intermittently and sometimes our elasticsearch cluster is taking too long to load the following pages (required by kopf): /\_stats/docs,store /\_nodes/st…

---

## [Openshift Elastic Search Logging Spam (1b+ logs a month)](https://discuss.elastic.co/t/openshift-elastic-search-logging-spam-1b-logs-a-month/108882)

<div class="topic-metadata">

**Author:** [@rmarcand](https://discuss.elastic.co/u/rmarcand)\
**Replies:** 4\
**Last updated:** [November 23, 2017, 3:53pm UTC](https://discuss.elastic.co/t/openshift-elastic-search-logging-spam-1b-logs-a-month/108882 "2017-11-23T15:53:44Z")

</div>

The elasticshearch inside openshift origin is generating 25 million hits per day in the operations area (42 million overall), causing a high volume of logs between kibana and Splunk. When did you start to notice this is…

---

## [Migration of 2.3 indices to 5.6 using Painless](https://discuss.elastic.co/t/migration-of-2-3-indices-to-5-6-using-painless/108859)

<div class="topic-metadata">

**Author:** [@Bostjan\_Kovac](https://discuss.elastic.co/u/Bostjan_Kovac)\
**Replies:** 1\
**Last updated:** [November 23, 2017, 2:30pm UTC](https://discuss.elastic.co/t/migration-of-2-3-indices-to-5-6-using-painless/108859 "2017-11-23T14:30:57Z")

</div>

hi, I have trouble with Painless scripting language and I cannot find any helpful info about my problem. My case is I want to migrate 2.3 ES index to 5.6 and create inner objects from some flat fields on 2.3. Source fie…

---

## [Ec2 discovery does not work with ES 6.0.0](https://discuss.elastic.co/t/ec2-discovery-does-not-work-with-es-6-0-0/108439)

<div class="topic-metadata">

**Author:** [@nkoothrappahli](https://discuss.elastic.co/u/nkoothrappahli)\
**Replies:** 3\
**Last updated:** [November 23, 2017, 1:57pm UTC](https://discuss.elastic.co/t/ec2-discovery-does-not-work-with-es-6-0-0/108439 "2017-11-23T13:57:10Z")

</div>

I have setup a VPC with 3 subnets in 3 availibility zones and a autoscaling group. All instances has a IAM role which allows to describe the instances (like suggested in the docs). From aws cli this works fine. Then i sc…

---

## [Content type header application/x-ldjson not supported](https://discuss.elastic.co/t/content-type-header-application-x-ldjson-not-supported/108897)

<div class="topic-metadata">

**Author:** [@parinita1995](https://discuss.elastic.co/u/parinita1995)\
**Replies:** 1\
**Last updated:** [November 23, 2017, 1:54pm UTC](https://discuss.elastic.co/t/content-type-header-application-x-ldjson-not-supported/108897 "2017-11-23T13:54:50Z")

</div>

I am using elastic search in our application I am getting error on using client.bulk method. Please suggest us next steps on this \<- 406 { "error": "Content-Type header \[application/x-ldjson\] is not supported", "s…

---

## [Doubt about performance elastic 2.4 matchAll X boolQuery](https://discuss.elastic.co/t/doubt-about-performance-elastic-2-4-matchall-x-boolquery/108408)

<div class="topic-metadata">

**Author:** [@RafaelPosthaus](https://discuss.elastic.co/u/RafaelPosthaus)\
**Replies:** 4\
**Last updated:** [November 23, 2017, 1:41pm UTC](https://discuss.elastic.co/t/doubt-about-performance-elastic-2-4-matchall-x-boolquery/108408 "2017-11-23T13:41:43Z")

</div>

Good afternoon, Browsing a legacy font I found a search in elasticSearch 2.4, which did the following: create the filters and sorts, and then apply this to a matchAll Query. Would I have more performance if instead of …

---

## [Delete obsolete indexes?](https://discuss.elastic.co/t/delete-obsolete-indexes/108889)

<div class="topic-metadata">

**Author:** [@elastic\_paul](https://discuss.elastic.co/u/elastic_paul)\
**Replies:** 1\
**Last updated:** [November 23, 2017, 1:36pm UTC](https://discuss.elastic.co/t/delete-obsolete-indexes/108889 "2017-11-23T13:36:51Z")

</div>

I have upgraded my test ES cluster from 2.3 to 5.6 (on my way to 6.0) and got myself into a pickle I have now found some very old indexes from 1.5 that can not be upgraded, and this is fine because I don't want them any…

---

## [Why Kibana and monitor idexes 2 shards by default](https://discuss.elastic.co/t/why-kibana-and-monitor-idexes-2-shards-by-default/108794)

<div class="topic-metadata">

**Author:** [@GambitK](https://discuss.elastic.co/u/GambitK)\
**Replies:** 0\
**Last updated:** [November 22, 2017, 9:25pm UTC](https://discuss.elastic.co/t/why-kibana-and-monitor-idexes-2-shards-by-default/108794 "2017-11-22T21:25:47Z")

</div>

Hello, I have a new server to try elasticsearch 6 and there's something that's giving me a lot of headache, why by default are the kibana, logstash, monitor indexes created with 2 shards? Right now my 1 node cluster sho…

---

## [Elasticsearch Memlock with Docker](https://discuss.elastic.co/t/elasticsearch-memlock-with-docker/108556)

<div class="topic-metadata">

**Author:** [@Burak\_Aydin](https://discuss.elastic.co/u/Burak_Aydin)\
**Replies:** 0\
**Last updated:** [November 21, 2017, 11:47am UTC](https://discuss.elastic.co/t/elasticsearch-memlock-with-docker/108556 "2017-11-21T11:47:32Z")

</div>

Hi, We are using elasticsearch in a Docker container with one node . We want to use memlock parameter as true. But when we set bootstrap.memory\_lock: true in elasticsearch.yml file we received ; ERROR: \[1\] bootstrap ch…

---

## [Significant text aggregation with custom analyzer in Elasticsearch 6](https://discuss.elastic.co/t/significant-text-aggregation-with-custom-analyzer-in-elasticsearch-6/108253)

<div class="topic-metadata">

**Author:** [@philv](https://discuss.elastic.co/u/philv)\
**Replies:** 5\
**Last updated:** [November 23, 2017, 12:44pm UTC](https://discuss.elastic.co/t/significant-text-aggregation-with-custom-analyzer-in-elasticsearch-6/108253 "2017-11-23T12:44:59Z")

</div>

Should SignificantText aggs work with a text field that has a custom analysis chain ? (Or the other mappings customisations I outline in the mappings segment below) I have a 'text' type field that I can't get buckets f…

---

## [How can i remove a document type from an index](https://discuss.elastic.co/t/how-can-i-remove-a-document-type-from-an-index/108864)

<div class="topic-metadata">

**Author:** [@saafianihan](https://discuss.elastic.co/u/saafianihan)\
**Replies:** 1\
**Last updated:** [November 23, 2017, 10:44am UTC](https://discuss.elastic.co/t/how-can-i-remove-a-document-type-from-an-index/108864 "2017-11-23T10:44:44Z")

</div>

I want to delete one document type created under one index. How it is possible?

---

## [How to fix elasticsearch cluster network connection with docker](https://discuss.elastic.co/t/how-to-fix-elasticsearch-cluster-network-connection-with-docker/108498)

<div class="topic-metadata">

**Author:** [@hanase](https://discuss.elastic.co/u/hanase)\
**Replies:** 17\
**Last updated:** [November 23, 2017, 10:18am UTC](https://discuss.elastic.co/t/how-to-fix-elasticsearch-cluster-network-connection-with-docker/108498 "2017-11-23T10:18:39Z")

</div>

Hi, My environment is two physical machine, both running in docker-compose. I use OpenvSwitch and pipework to build Elasticsearch cluster, Elasticsearch cluster with docker and have two nodes. When docker container sta…

---

## [Setting up Elasticsearch on a virtual machine](https://discuss.elastic.co/t/setting-up-elasticsearch-on-a-virtual-machine/108849)

<div class="topic-metadata">

**Author:** [@Sylvain\_Attoumani](https://discuss.elastic.co/u/Sylvain_Attoumani)\
**Replies:** 6\
**Last updated:** [November 23, 2017, 9:57am UTC](https://discuss.elastic.co/t/setting-up-elasticsearch-on-a-virtual-machine/108849 "2017-11-23T09:57:46Z")

</div>

Hello everybody. I'm working with a virtual machine using vagrant and try to setting up Elasticsearch on this VM. But when i run bin/elasticsearch it's using 127.0.0.1 wich is not the localhost of my virtual machine. I'…

---

## [Configuration 4 nodes witch defining the roles](https://discuss.elastic.co/t/configuration-4-nodes-witch-defining-the-roles/108852)

<div class="topic-metadata">

**Author:** [@RafaelPosthaus](https://discuss.elastic.co/u/RafaelPosthaus)\
**Replies:** 2\
**Last updated:** [November 23, 2017, 9:53am UTC](https://discuss.elastic.co/t/configuration-4-nodes-witch-defining-the-roles/108852 "2017-11-23T09:53:40Z")

</div>

Good morning, I have a cluster elaticsearch, 2.4.2, with the 4 nodes having the same hardware. is configured as follows: 1 node Data = false and master = true 1 node Data = true and master = true 2 nodes Data = true …

---

## [Want to store data (even binary) efficiently in Elasticsearch?](https://discuss.elastic.co/t/want-to-store-data-even-binary-efficiently-in-elasticsearch/108846)

<div class="topic-metadata">

**Author:** [@Attila\_Nagy](https://discuss.elastic.co/u/Attila_Nagy)\
**Replies:** 0\
**Last updated:** [November 23, 2017, 9:18am UTC](https://discuss.elastic.co/t/want-to-store-data-even-binary-efficiently-in-elasticsearch/108846 "2017-11-23T09:18:27Z")

</div>

If you want to store data in the most efficient and compact way in Elasticsearch, you should exclude those fields which contain them from source: https://www.elastic.co/guide/en/elasticsearch/reference/5.5/mapping-sourc…

---

## [How can backup the \_template with snapshot and restore](https://discuss.elastic.co/t/how-can-backup-the-template-with-snapshot-and-restore/108825)

<div class="topic-metadata">

**Author:** [@zqc0512](https://discuss.elastic.co/u/zqc0512)\
**Replies:** 7\
**Last updated:** [November 23, 2017, 9:08am UTC](https://discuss.elastic.co/t/how-can-backup-the-template-with-snapshot-and-restore/108825 "2017-11-23T09:08:32Z")

</div>

how can backup the \_template with snapshot and restore. i don't know how can do it. thanks..

---

## [Mapper\_parsing\_exception while creating Percentage](https://discuss.elastic.co/t/mapper-parsing-exception-while-creating-percentage/108819)

<div class="topic-metadata">

**Author:** [@saafianihan](https://discuss.elastic.co/u/saafianihan)\
**Replies:** 3\
**Last updated:** [November 23, 2017, 8:20am UTC](https://discuss.elastic.co/t/mapper-parsing-exception-while-creating-percentage/108819 "2017-11-23T08:20:32Z")

</div>

When i am trying to create a column with format as Percentage it throws an error like this: { "error": { "root\_cause": \[ { "type": "mapper\_parsing\_exception", "reason": "No handler for type \[number\] declared on fie…

---

## [Problem with uax\_url\_email tokenizer with pattern capture filter](https://discuss.elastic.co/t/problem-with-uax-url-email-tokenizer-with-pattern-capture-filter/108834)

<div class="topic-metadata">

**Author:** [@Madhur\_Tandon](https://discuss.elastic.co/u/Madhur_Tandon)\
**Replies:** 0\
**Last updated:** [November 23, 2017, 8:11am UTC](https://discuss.elastic.co/t/problem-with-uax-url-email-tokenizer-with-pattern-capture-filter/108834 "2017-11-23T08:11:14Z")

</div>

Using tokenizer uax\_url\_email and filter lowercase, email\_filter, unique email\_filter: "type" =\> "pattern\_capture", "preserve\_original" =\> true, "patterns" =\> \[ "(\[^@\]+)", "(\\p{L}+)", "(\\d+)"…

---

## [Elastic Cloud 6.0 - User authentications](https://discuss.elastic.co/t/elastic-cloud-6-0-user-authentications/108809)

<div class="topic-metadata">

**Author:** [@shanim](https://discuss.elastic.co/u/shanim)\
**Replies:** 6\
**Last updated:** [November 23, 2017, 7:41am UTC](https://discuss.elastic.co/t/elastic-cloud-6-0-user-authentications/108809 "2017-11-23T07:41:56Z")

</div>

Hi, I'm a noob at Elastic Cloud 6.0 and I'm using X-Pack for the first time. I have been attempting to add some data into a cluster I created on elastic cloud. I created a new user (as I didn't want to use the elastic …

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1877)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1879)
