# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1242

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1243

---

## [How the users can access my Elasticsearch database in my Django SaaS?](https://discuss.elastic.co/t/how-the-users-can-access-my-elasticsearch-database-in-my-django-saas/188181)

<div class="topic-metadata">

**Author:** [@whiterabbit](https://discuss.elastic.co/u/whiterabbit)\
**Replies:** 2\
**Last updated:** [July 3, 2019, 12:54am UTC](https://discuss.elastic.co/t/how-the-users-can-access-my-elasticsearch-database-in-my-django-saas/188181 "2019-07-03T00:54:44Z")

</div>

Let's say that I have a SaaS based on Django backend that processes the data of the users and write everything to the Elasticsearch. Now I would like to give users access to search and request their data stored in ES usi…

---

## [Problems working with Cluster](https://discuss.elastic.co/t/problems-working-with-cluster/188352)

<div class="topic-metadata">

**Author:** [@khaiolopes](https://discuss.elastic.co/u/khaiolopes)\
**Replies:** 5\
**Last updated:** [July 2, 2019, 6:49pm UTC](https://discuss.elastic.co/t/problems-working-with-cluster/188352 "2019-07-02T18:49:31Z")

</div>

Guys, I'm having trouble working in Cluster with Elastic. I'm a beginner. I have some outputs in my logs, I've already looked into the solution but so far none has come up in my solution. Below the configuration of my …

---

## [Upgrade stopped monitoring](https://discuss.elastic.co/t/upgrade-stopped-monitoring/137880)

<div class="topic-metadata">

**Author:** [@Karthik\_Ramachandran](https://discuss.elastic.co/u/Karthik_Ramachandran)\
**Replies:** 6\
**Last updated:** [July 2, 2019, 6:36pm UTC](https://discuss.elastic.co/t/upgrade-stopped-monitoring/137880 "2019-07-02T18:36:53Z")

</div>

Environment Info We had two clusters with version 6.2.1, where one is dedicated for monitoring. The monitoring cluster was also monitoring logstash (Docker 6.2). We upgraded the monitoring cluster to 6.3 from 6.2.1. R…

---

## [Script for Aggs](https://discuss.elastic.co/t/script-for-aggs/188366)

<div class="topic-metadata">

**Author:** [@schneider](https://discuss.elastic.co/u/schneider)\
**Replies:** 2\
**Last updated:** [July 2, 2019, 5:51pm UTC](https://discuss.elastic.co/t/script-for-aggs/188366 "2019-07-02T17:51:47Z")

</div>

The search is working fine, but i want to retrive only the "remetente" with ("doc\_count"\>=50), This is exemple for the search: GET /imsva\_message/\_search { "size": 0, "aggs" : { "aggdata" : { "filter": …

---

## [ES Spark Connector - Circuit Breaker error](https://discuss.elastic.co/t/es-spark-connector-circuit-breaker-error/187358)

<div class="topic-metadata">

**Author:** [@Daniel\_Solow](https://discuss.elastic.co/u/Daniel_Solow)\
**Replies:** 2\
**Last updated:** [July 2, 2019, 5:25pm UTC](https://discuss.elastic.co/t/es-spark-connector-circuit-breaker-error/187358 "2019-07-02T17:25:33Z")

</div>

I'm using ES 7.1.1 and Spark 2.4.2. The ES cluster is on Google Kubernetes Engine and the Spark cluster is on Google Dataproc. Big jobs are failing with the following error, often several hours into the job: 19/06/25 0…

---

## [How to Best define the shards and replica in Elasticsearch](https://discuss.elastic.co/t/how-to-best-define-the-shards-and-replica-in-elasticsearch/188555)

<div class="topic-metadata">

**Author:** [@Karn\_Gusain](https://discuss.elastic.co/u/Karn_Gusain)\
**Replies:** 2\
**Last updated:** [July 2, 2019, 5:18pm UTC](https://discuss.elastic.co/t/how-to-best-define-the-shards-and-replica-in-elasticsearch/188555 "2019-07-02T17:18:40Z")

</div>

Hello ELK Experts, I would like to seek your expert opinion for my use case where i have 3 node ELK cluster setup and each not is also serving as a data node. Below is my elasticsearch.yml file. # cat /etc/elasticsear…

---

## [Limiting results by field](https://discuss.elastic.co/t/limiting-results-by-field/188541)

<div class="topic-metadata">

**Author:** [@Daz762](https://discuss.elastic.co/u/Daz762)\
**Replies:** 3\
**Last updated:** [July 2, 2019, 4:36pm UTC](https://discuss.elastic.co/t/limiting-results-by-field/188541 "2019-07-02T16:36:18Z")

</div>

Hi, I have a query that searches for a specific field value within the last hour. the problem is that this query will find roughly 4 documents each time as that is how often the data is generated. I'm trying to limit th…

---

## [Ingest pipeline filebeat nginx error provided by nginx module - timestamp error UTC+4](https://discuss.elastic.co/t/ingest-pipeline-filebeat-nginx-error-provided-by-nginx-module-timestamp-error-utc-4/188534)

<div class="topic-metadata">

**Author:** [@ORich](https://discuss.elastic.co/u/ORich)\
**Replies:** 2\
**Last updated:** [July 2, 2019, 3:59pm UTC](https://discuss.elastic.co/t/ingest-pipeline-filebeat-nginx-error-provided-by-nginx-module-timestamp-error-utc-4/188534 "2019-07-02T15:59:53Z")

</div>

Versions: Elastic Suite 6.5.1 with Filebeat nginx module. Thanks to Kibana DevTools, here under is the filebeat-nginx-error-pipeline provided by Filebeat nginx module. Also from here enclosed record, the local time is s…

---

## [Urgent - Problem when parsing date](https://discuss.elastic.co/t/urgent-problem-when-parsing-date/188464)

<div class="topic-metadata">

**Author:** [@soufiane1](https://discuss.elastic.co/u/soufiane1)\
**Replies:** 7\
**Last updated:** [July 2, 2019, 3:41pm UTC](https://discuss.elastic.co/t/urgent-problem-when-parsing-date/188464 "2019-07-02T15:41:45Z")

</div>

Hello everyone, I am trying to load a csv file which contains a date field where data is sorted like the following example (01/07/2019 14:11), but receiving this elasticsearch error, "error"=\>{"type"=\>"mapper\_parsing\_e…

---

## [Elastic Common Schema Java Implementation](https://discuss.elastic.co/t/elastic-common-schema-java-implementation/188391)

<div class="topic-metadata">

**Author:** [@cpmoore](https://discuss.elastic.co/u/cpmoore)\
**Replies:** 3\
**Last updated:** [July 2, 2019, 2:00pm UTC](https://discuss.elastic.co/t/elastic-common-schema-java-implementation/188391 "2019-07-02T14:00:50Z")

</div>

I'm just looking for some general ideas of mapping java log fields to the elastic common schema. A couple fields are already taken care of, such as log.level and process.thread.id, but there's a couple fields that I fee…

---

## [Thread pool stats in .monitoring-es\* indices](https://discuss.elastic.co/t/thread-pool-stats-in-monitoring-es-indices/188523)

<div class="topic-metadata">

**Author:** [@jonathan\_rowe](https://discuss.elastic.co/u/jonathan_rowe)\
**Replies:** 0\
**Last updated:** [July 2, 2019, 1:51pm UTC](https://discuss.elastic.co/t/thread-pool-stats-in-monitoring-es-indices/188523 "2019-07-02T13:51:31Z")

</div>

Hi Folks Noticed that the elasticsearch built-in (and metricbeat) monitoring doesn't capture all the thread pool stats, it only captures queue size, rejected count and current threads (pool size, which usually stays the…

---

## [How Come match\_phrase does not work when "." present?](https://discuss.elastic.co/t/how-come-match-phrase-does-not-work-when-present/187079)

<div class="topic-metadata">

**Author:** [@initproto](https://discuss.elastic.co/u/initproto)\
**Replies:** 6\
**Last updated:** [July 2, 2019, 1:08pm UTC](https://discuss.elastic.co/t/how-come-match-phrase-does-not-work-when-present/187079 "2019-07-02T13:08:39Z")

</div>

I have a field called "name". I run a match\_phrase with name query "17p13". It finds a record with exactly that name and another with "(del)17p13", but NOT one with "17p13.1". "name" mapping is set to text. This seems…

---

## [Stopping trying to execute pipeline for document not on current index](https://discuss.elastic.co/t/stopping-trying-to-execute-pipeline-for-document-not-on-current-index/188473)

<div class="topic-metadata">

**Author:** [@EldrosKandar](https://discuss.elastic.co/u/EldrosKandar)\
**Replies:** 3\
**Last updated:** [July 2, 2019, 1:02pm UTC](https://discuss.elastic.co/t/stopping-trying-to-execute-pipeline-for-document-not-on-current-index/188473 "2019-07-02T13:02:31Z")

</div>

I've been looking into one of the most recent log file (.i.e the log entries for one day) and I've found about 295 log entry similar to the following: \[DEBUG\]\[o.e.a.b.TransportBulkAction\] \[es-1\] failed to execute pipel…

---

## [\[7.2\] Unexplained Null Pointer Exception when doing explore query using certain phrases](https://discuss.elastic.co/t/7-2-unexplained-null-pointer-exception-when-doing-explore-query-using-certain-phrases/188498)

<div class="topic-metadata">

**Author:** [@Dan421](https://discuss.elastic.co/u/Dan421)\
**Replies:** 2\
**Last updated:** [July 2, 2019, 12:17pm UTC](https://discuss.elastic.co/t/7-2-unexplained-null-pointer-exception-when-doing-explore-query-using-certain-phrases/188498 "2019-07-02T12:17:57Z")

</div>

Hi there. I am getting a really hard to trace null pointer exception from my elastic cluster when doing explore queries with certain words eg: Game Console: Null pointer exception Game Consoles: Results I am hoping s…

---

## [Is it possible to upgrade Elastic 6.x to 7.0 if I have a document type?](https://discuss.elastic.co/t/is-it-possible-to-upgrade-elastic-6-x-to-7-0-if-i-have-a-document-type/188506)

<div class="topic-metadata">

**Author:** [@virgilp](https://discuss.elastic.co/u/virgilp)\
**Replies:** 0\
**Last updated:** [July 2, 2019, 12:08pm UTC](https://discuss.elastic.co/t/is-it-possible-to-upgrade-elastic-6-x-to-7-0-if-i-have-a-document-type/188506 "2019-07-02T12:08:39Z")

</div>

So, i have an application deployed in production that uses a non-standard document type name (logEvent). Can I upgrade to 7.0, or am I stuck to 6.x forever? Basically, I have this problem: if I ask the clients to upgr…

---

## [Update elasticsearch/kibana from 6.4.3 to latest one](https://discuss.elastic.co/t/update-elasticsearch-kibana-from-6-4-3-to-latest-one/188495)

<div class="topic-metadata">

**Author:** [@Karuppasamy\_K](https://discuss.elastic.co/u/Karuppasamy_K)\
**Replies:** 1\
**Last updated:** [July 2, 2019, 11:55am UTC](https://discuss.elastic.co/t/update-elasticsearch-kibana-from-6-4-3-to-latest-one/188495 "2019-07-02T11:55:03Z")

</div>

How to update kibana and elastic search from old version to new version.

---

## [Unit Elastisearch.service not found](https://discuss.elastic.co/t/unit-elastisearch-service-not-found/188500)

<div class="topic-metadata">

**Author:** [@wiem1](https://discuss.elastic.co/u/wiem1)\
**Replies:** 0\
**Last updated:** [July 2, 2019, 11:54am UTC](https://discuss.elastic.co/t/unit-elastisearch-service-not-found/188500 "2019-07-02T11:54:13Z")

</div>

Hi, i install elasticsearch on ubuntu 18.04 after that i do the following command : systemctl start elasticsearch.service and this is the error message "Failed to start elasticsearch.service:unit elasticsearch.service n…

---

## [Script.painless.regex.enabled: true](https://discuss.elastic.co/t/script-painless-regex-enabled-true/188440)

<div class="topic-metadata">

**Author:** [@Champ](https://discuss.elastic.co/u/Champ)\
**Replies:** 1\
**Last updated:** [July 2, 2019, 11:18am UTC](https://discuss.elastic.co/t/script-painless-regex-enabled-true/188440 "2019-07-02T11:18:47Z")

</div>

I am running Elasticsearch in docker and I can't figure out where to configure the "script.painless.regex.enabled: true" in the elasticsearch.yml file. The following is my elasticsearch.yml file Module: elasticsearch D…

---

## [ES heap space is always at 90% for all the 11 nodes having 20GB JVM space allocated (out of 28 GB) with 4 core CPU](https://discuss.elastic.co/t/es-heap-space-is-always-at-90-for-all-the-11-nodes-having-20gb-jvm-space-allocated-out-of-28-gb-with-4-core-cpu/188488)

<div class="topic-metadata">

**Author:** [@Manoj\_Chhetri](https://discuss.elastic.co/u/Manoj_Chhetri)\
**Replies:** 0\
**Last updated:** [July 2, 2019, 11:07am UTC](https://discuss.elastic.co/t/es-heap-space-is-always-at-90-for-all-the-11-nodes-having-20gb-jvm-space-allocated-out-of-28-gb-with-4-core-cpu/188488 "2019-07-02T11:07:05Z")

</div>

I have a 11 node ES cluster. Each node has 4 core cpu Total memory 28GB (To ES i allocated 20 GB for each node) 1 OS disk 2TB , 2 attached data disk of 2TB =\> total 6 TB each ES node Total cluster disk space 6 \* 11 …

---

## [Kibana 4 authorization exception error](https://discuss.elastic.co/t/kibana-4-authorization-exception-error/188357)

<div class="topic-metadata">

**Author:** [@mavericknomad](https://discuss.elastic.co/u/mavericknomad)\
**Replies:** 5\
**Last updated:** [July 2, 2019, 10:50am UTC](https://discuss.elastic.co/t/kibana-4-authorization-exception-error/188357 "2019-07-02T10:50:58Z")

</div>

We use AWS elasticsearch service and kibana is installed on the ec2 instance. From last few days, we started getting below error. Could you please let us know what may cause this error? ############ Fatal Error Kiban…

---

## [Group docs with same internal ID and then aggregate in to buckets by number of matches](https://discuss.elastic.co/t/group-docs-with-same-internal-id-and-then-aggregate-in-to-buckets-by-number-of-matches/188476)

<div class="topic-metadata">

**Author:** [@spk3r](https://discuss.elastic.co/u/spk3r)\
**Replies:** 0\
**Last updated:** [July 2, 2019, 10:25am UTC](https://discuss.elastic.co/t/group-docs-with-same-internal-id-and-then-aggregate-in-to-buckets-by-number-of-matches/188476 "2019-07-02T10:25:35Z")

</div>

I have index called "events", where each doc is different event. Events are generated by devices, which have internal ID's. I want to group events by "deviceId", and then aggregate them by number of events they generate…

---

## [Boosting documents in search results which are matched to array](https://discuss.elastic.co/t/boosting-documents-in-search-results-which-are-matched-to-array/188474)

<div class="topic-metadata">

**Author:** [@sonu\_gaur](https://discuss.elastic.co/u/sonu_gaur)\
**Replies:** 0\
**Last updated:** [July 2, 2019, 10:15am UTC](https://discuss.elastic.co/t/boosting-documents-in-search-results-which-are-matched-to-array/188474 "2019-07-02T10:15:19Z")

</div>

Hi all, I have this relatively complex search query that's already being built and working with perfect sorting. But I think here searching is slow just because of script so all I want to remove script and write query …

---

## [Indexing - processing node](https://discuss.elastic.co/t/indexing-processing-node/188450)

<div class="topic-metadata">

**Author:** [@jetnet](https://discuss.elastic.co/u/jetnet)\
**Replies:** 4\
**Last updated:** [July 2, 2019, 9:54am UTC](https://discuss.elastic.co/t/indexing-processing-node/188450 "2019-07-02T09:54:45Z")

</div>

hello All, I've been indexing some documents on a cluster of 3 nodes (1 master-only and 2 regular). There is an external ETL process running on all servers, generating nearly the same load. Looking at the OS load diagr…

---

## [Older data deletion in elasticsearch](https://discuss.elastic.co/t/older-data-deletion-in-elasticsearch/186651)

<div class="topic-metadata">

**Author:** [@Tania\_Saez](https://discuss.elastic.co/u/Tania_Saez)\
**Replies:** 6\
**Last updated:** [July 2, 2019, 9:52am UTC](https://discuss.elastic.co/t/older-data-deletion-in-elasticsearch/186651 "2019-07-02T09:52:23Z")

</div>

Hello, I created an index with their fields in kibana and I am ingesting logs to them. In coming days I will have a lot of logs, how can i do to deleted the older 7 days logs as an automatical task with version 7.x ? T…

---

## [Reindex in a cluster does not get all documents](https://discuss.elastic.co/t/reindex-in-a-cluster-does-not-get-all-documents/186492)

<div class="topic-metadata">

**Author:** [@M.alsioufi](https://discuss.elastic.co/u/M.alsioufi)\
**Replies:** 5\
**Last updated:** [July 2, 2019, 9:48am UTC](https://discuss.elastic.co/t/reindex-in-a-cluster-does-not-get-all-documents/186492 "2019-07-02T09:48:52Z")

</div>

Elastic Stack Version: 6.5 I am trying to reindex my index "old\_index" to another index "new\_index" on the same cluster. POST \_reindex { "source": { "index": "old\_index", "\_source": { "include": \[…

---

## [Elastic Search and Python Connection](https://discuss.elastic.co/t/elastic-search-and-python-connection/188436)

<div class="topic-metadata">

**Author:** [@roma\_sodha](https://discuss.elastic.co/u/roma_sodha)\
**Replies:** 5\
**Last updated:** [July 2, 2019, 7:59am UTC](https://discuss.elastic.co/t/elastic-search-and-python-connection/188436 "2019-07-02T07:59:34Z")

</div>

Hi, I am trying to connect elastic search thru python, However I get below connection error message. elasticsearch.exceptions.ConnectionError: ConnectionError(\<urllib3.connection.HTTPConnection object at 0x0000021B1AA7…

---

## [Calculate the percentage of a bucket over the total](https://discuss.elastic.co/t/calculate-the-percentage-of-a-bucket-over-the-total/188446)

<div class="topic-metadata">

**Author:** [@algorrim](https://discuss.elastic.co/u/algorrim)\
**Replies:** 0\
**Last updated:** [July 2, 2019, 7:17am UTC](https://discuss.elastic.co/t/calculate-the-percentage-of-a-bucket-over-the-total/188446 "2019-07-02T07:17:24Z")

</div>

Hi! I'm quite new with Elasticsearch and I'm exploring the analytics feature of ES. I was trying to calculate the percentage of each bucket from a histogram over the total. So if I have three buckets with these values: …

---

## [RefreshRequest with WAIT\_UNTIL mode](https://discuss.elastic.co/t/refreshrequest-with-wait-until-mode/186176)

<div class="topic-metadata">

**Author:** [@shayantabrizi](https://discuss.elastic.co/u/shayantabrizi)\
**Replies:** 12\
**Last updated:** [July 2, 2019, 6:01am UTC](https://discuss.elastic.co/t/refreshrequest-with-wait-until-mode/186176 "2019-07-02T06:01:48Z")

</div>

Assume that I do several updates/inserts/deletes to the elasticsearch in response to a user request in different parts of my code and I want to make sure they are visible to the user before I return a success status to t…

---

## [Master Nodes not communicating properly in AWS](https://discuss.elastic.co/t/master-nodes-not-communicating-properly-in-aws/188388)

<div class="topic-metadata">

**Author:** [@USA-RedDragon](https://discuss.elastic.co/u/USA-RedDragon)\
**Replies:** 1\
**Last updated:** [July 2, 2019, 5:52am UTC](https://discuss.elastic.co/t/master-nodes-not-communicating-properly-in-aws/188388 "2019-07-02T05:52:32Z")

</div>

I am using Hashicorp Nomad in AWS with Docker images based on the official ones(docker.elastic.co/elasticsearch/elasticsearch:7.2.0) The security groups allow communication properly, as I can verify with netcat inside t…

---

## [Connection problems in Elastic Stack cluster](https://discuss.elastic.co/t/connection-problems-in-elastic-stack-cluster/187561)

<div class="topic-metadata">

**Author:** [@MaxON](https://discuss.elastic.co/u/MaxON)\
**Replies:** 1\
**Last updated:** [July 2, 2019, 5:48am UTC](https://discuss.elastic.co/t/connection-problems-in-elastic-stack-cluster/187561 "2019-07-02T05:48:40Z")

</div>

Hello All! I got such a problem in the Elastic Stack: one of four nodes sometimes disconnects the cluster giving logs of such kind: \[2019-06-26T12:46:08,746\]\[INFO \]\[o.e.m.j.JvmGcMonitorService\] \[node-dbtest\] \[gc\]\[26144…

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1241)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1243)
