# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1614

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1615

---

## [Error creating index template after migrating to ES 6](https://discuss.elastic.co/t/error-creating-index-template-after-migrating-to-es-6/140395)

<div class="topic-metadata">

**Author:** [@alexvollmer](https://discuss.elastic.co/u/alexvollmer)\
**Replies:** 0\
**Last updated:** [July 17, 2018, 8:59pm UTC](https://discuss.elastic.co/t/error-creating-index-template-after-migrating-to-es-6/140395 "2018-07-17T20:59:02Z")

</div>

We're attempting to migrate from Elasticsearch 5.6.6 to the latest (6.3.1). In doing so we can no longer create the index template we use. When I attempt to do so I get this error: \[2018-07-17T20:54:06,310\]\[WARN \]\[r.su…

---

## [Upgrade with docker-compose fails to start](https://discuss.elastic.co/t/upgrade-with-docker-compose-fails-to-start/139797)

<div class="topic-metadata">

**Author:** [@alexvollmer](https://discuss.elastic.co/u/alexvollmer)\
**Replies:** 1\
**Last updated:** [July 17, 2018, 8:43pm UTC](https://discuss.elastic.co/t/upgrade-with-docker-compose-fails-to-start/139797 "2018-07-17T20:43:32Z")

</div>

In our local development environments we use docker-compose to run Elasticsearch and Kibana. We're getting ready to upgrade from 5.6 to 6.3, so my starting point was updating our docker-compose.yml file to point to the n…

---

## [How many indices can be created](https://discuss.elastic.co/t/how-many-indices-can-be-created/140226)

<div class="topic-metadata">

**Author:** [@Pierre\_Abreu](https://discuss.elastic.co/u/Pierre_Abreu)\
**Replies:** 7\
**Last updated:** [July 17, 2018, 7:58pm UTC](https://discuss.elastic.co/t/how-many-indices-can-be-created/140226 "2018-07-17T19:58:38Z")

</div>

HI, my ES data can grow up to 270,000 indexes. I'm creating one index per user. Is there a ES limit to create indexes? Each index has one shard and one replica only. My cluster have 3 master nodes and 2 data nodes

---

## [X-pack on Kubernetes with TLS](https://discuss.elastic.co/t/x-pack-on-kubernetes-with-tls/140387)

<div class="topic-metadata">

**Author:** [@Rajesh\_Kodali](https://discuss.elastic.co/u/Rajesh_Kodali)\
**Replies:** 0\
**Last updated:** [July 17, 2018, 7:51pm UTC](https://discuss.elastic.co/t/x-pack-on-kubernetes-with-tls/140387 "2018-07-17T19:51:14Z")

</div>

Is anyone able to run elasticsearch 6.3.1 with X-Pack on Kubernetes deployment? This https://github.com/kubernetes/charts/tree/master/incubator/elasticsearch does not have the setup yet. Anyone have a working model setti…

---

## [Elasticsearch Metrics](https://discuss.elastic.co/t/elasticsearch-metrics/140382)

<div class="topic-metadata">

**Author:** [@RockD](https://discuss.elastic.co/u/RockD)\
**Replies:** 0\
**Last updated:** [July 17, 2018, 7:24pm UTC](https://discuss.elastic.co/t/elasticsearch-metrics/140382 "2018-07-17T19:24:37Z")

</div>

Hi I'm using a script to get some metrics from an elastic cluster, and there some metrics that still confuse me a lot, one of them is the index\_total metric; when I cross reference this data with the value that the logs…

---

## [Node-RED + Elasticsearch](https://discuss.elastic.co/t/node-red-elasticsearch/140345)

<div class="topic-metadata">

**Author:** [@Nicolas\_Prange](https://discuss.elastic.co/u/Nicolas_Prange)\
**Replies:** 4\
**Last updated:** [July 17, 2018, 7:07pm UTC](https://discuss.elastic.co/t/node-red-elasticsearch/140345 "2018-07-17T19:07:18Z")

</div>

Hi, I am trying to send data from Node-RED to Elasticsearch, but I receive the following error: Elasticsearch ERROR: 2018-07-17T14:30:15Z Error: Request error, retrying HEAD http://localhost/twitterr/tweets/1 =\> conn…

---

## [Why does elasticsearch-dsl-py raise an exception on pypy but not cpython?](https://discuss.elastic.co/t/why-does-elasticsearch-dsl-py-raise-an-exception-on-pypy-but-not-cpython/140343)

<div class="topic-metadata">

**Author:** [@seanthegeek](https://discuss.elastic.co/u/seanthegeek)\
**Replies:** 0\
**Last updated:** [July 17, 2018, 2:22pm UTC](https://discuss.elastic.co/t/why-does-elasticsearch-dsl-py-raise-an-exception-on-pypy-but-not-cpython/140343 "2018-07-17T14:22:55Z")

</div>

I have some code that saves data to Elasticsearch. It runs fine in Python 3.5.2 (cpython), but raises an exception when running on pypi3 6.0.0 (Python 3.5.3). Any ideas why? File "/opt/venvs/parsedmarc/site-packages/par…

---

## [(AWS Linux) Failed to connect to localhost port 9200: Connection refused](https://discuss.elastic.co/t/aws-linux-failed-to-connect-to-localhost-port-9200-connection-refused/140271)

<div class="topic-metadata">

**Author:** [@justintranjt](https://discuss.elastic.co/u/justintranjt)\
**Replies:** 1\
**Last updated:** [July 17, 2018, 5:20pm UTC](https://discuss.elastic.co/t/aws-linux-failed-to-connect-to-localhost-port-9200-connection-refused/140271 "2018-07-17T17:20:24Z")

</div>

I am unable to start my elasticsearch service successfully despite a correctly configured elasticsearch.yml file. I have only uncommented one line and edited it. network.host: "localhost" I start my service with sudo s…

---

## [ES heap memory and OS filecaching](https://discuss.elastic.co/t/es-heap-memory-and-os-filecaching/140333)

<div class="topic-metadata">

**Author:** [@anon24174512](https://discuss.elastic.co/u/anon24174512)\
**Replies:** 2\
**Last updated:** [July 17, 2018, 5:07pm UTC](https://discuss.elastic.co/t/es-heap-memory-and-os-filecaching/140333 "2018-07-17T17:07:12Z")

</div>

Hi, Do we have to keep the same amount of memory available for the OS as for Elasticsearch ? So if I have 16Go memory available on the machine, should I set JMX/JMS to 8Go and keep another 8Go free for the OS in order …

---

## [Unable to create index pattern in Kibana after installing X-Pack on Elastic Search Nodes](https://discuss.elastic.co/t/unable-to-create-index-pattern-in-kibana-after-installing-x-pack-on-elastic-search-nodes/140371)

<div class="topic-metadata">

**Author:** [@ashishmehtta1984](https://discuss.elastic.co/u/ashishmehtta1984)\
**Replies:** 0\
**Last updated:** [July 17, 2018, 5:05pm UTC](https://discuss.elastic.co/t/unable-to-create-index-pattern-in-kibana-after-installing-x-pack-on-elastic-search-nodes/140371 "2018-07-17T17:05:24Z")

</div>

Hi, I have a 3 Node Elastic Search production cluster on AWS. I installed X-Pack basic on cluster nodes, and after that when I am trying to create index pattern in Kibana, it is erroring out. Below are the logs from the…

---

## [Laravel Scout Elastic](https://discuss.elastic.co/t/laravel-scout-elastic/140349)

<div class="topic-metadata">

**Author:** [@ademozmermer](https://discuss.elastic.co/u/ademozmermer)\
**Replies:** 0\
**Last updated:** [July 17, 2018, 2:51pm UTC](https://discuss.elastic.co/t/laravel-scout-elastic/140349 "2018-07-17T14:51:33Z")

</div>

Hello. I use the https://packagist.org/packages/tamayo/laravel-scout-elastic package for Laravel Scout Elastic. I had to write a closure function to use fuzzy. My problem is that I need to get the true values ​​in the In…

---

## [How to bulk update using PHP](https://discuss.elastic.co/t/how-to-bulk-update-using-php/140344)

<div class="topic-metadata">

**Author:** [@Shrimp-Fried-Rice](https://discuss.elastic.co/u/Shrimp-Fried-Rice)\
**Replies:** 0\
**Last updated:** [July 17, 2018, 2:29pm UTC](https://discuss.elastic.co/t/how-to-bulk-update-using-php/140344 "2018-07-17T14:29:31Z")

</div>

Hi all, i have followed this article https://www.elastic.co/guide/en/elasticsearch/client/php-api/current/\_indexing\_documents.html to bulk index documents., but now i want to update the 2 fields of 70% of documents.,…

---

## [xpack.reporting.csv.maxSizeBytes is to 50mb, yet reports are still being truncate at default 10mb](https://discuss.elastic.co/t/xpack-reporting-csv-maxsizebytes-is-to-50mb-yet-reports-are-still-being-truncate-at-default-10mb/137529)

<div class="topic-metadata">

**Author:** [@alexus](https://discuss.elastic.co/u/alexus)\
**Replies:** 0\
**Last updated:** [June 27, 2018, 3:00am UTC](https://discuss.elastic.co/t/xpack-reporting-csv-maxsizebytes-is-to-50mb-yet-reports-are-still-being-truncate-at-default-10mb/137529 "2018-06-27T03:00:52Z")

</div>

I followed X-Pack reporting settings in Kibana, specifically: xpack.reporting.csv.maxSizeBytes by setting value to 50x1024x1024, like following: # egrep -i 'xpack.reporting.csv.maxSizeBytes' docker-compose.override.…

---

## [Docker test container](https://discuss.elastic.co/t/docker-test-container/140332)

<div class="topic-metadata">

**Author:** [@vvelichkovich](https://discuss.elastic.co/u/vvelichkovich)\
**Replies:** 0\
**Last updated:** [July 17, 2018, 1:09pm UTC](https://discuss.elastic.co/t/docker-test-container/140332 "2018-07-17T13:09:19Z")

</div>

I am trying to use Docker container as described in https://github.com/dadoonet/testcontainers-java-module-elasticsearch . The very first thing I do is ElasticsearchContainer container = new ElasticsearchContainer(); …

---

## [How to compute the average number of indexed documents/sec from an ES query?](https://discuss.elastic.co/t/how-to-compute-the-average-number-of-indexed-documents-sec-from-an-es-query/140301)

<div class="topic-metadata">

**Author:** [@anon24174512](https://discuss.elastic.co/u/anon24174512)\
**Replies:** 1\
**Last updated:** [July 17, 2018, 1:00pm UTC](https://discuss.elastic.co/t/how-to-compute-the-average-number-of-indexed-documents-sec-from-an-es-query/140301 "2018-07-17T13:00:59Z")

</div>

Hello, I would like to construct a query to get the @timestamp of the first and last indexed documents and from that to compute the average number of documents indexed per second in this interval. I know I can use \_sta…

---

## [Sending logfiles with Filebeats: Do I need to Install the entire ELK Stack on My Client Server?](https://discuss.elastic.co/t/sending-logfiles-with-filebeats-do-i-need-to-install-the-entire-elk-stack-on-my-client-server/140041)

<div class="topic-metadata">

**Author:** [@threeas](https://discuss.elastic.co/u/threeas)\
**Replies:** 2\
**Last updated:** [July 17, 2018, 12:36pm UTC](https://discuss.elastic.co/t/sending-logfiles-with-filebeats-do-i-need-to-install-the-entire-elk-stack-on-my-client-server/140041 "2018-07-17T12:36:48Z")

</div>

I am new to elastic search but fascinated with it's powerful ability. I have 2 subnets; A and B in my virtual KVM lab, I want a server in A to send log files to an elasticsearch server in B. I have set up elasticsearch/…

---

## [Timestamp field being passed in epoch with Hadoop Library](https://discuss.elastic.co/t/timestamp-field-being-passed-in-epoch-with-hadoop-library/138774)

<div class="topic-metadata">

**Author:** [@Wayne\_Taylor](https://discuss.elastic.co/u/Wayne_Taylor)\
**Replies:** 1\
**Last updated:** [July 17, 2018, 12:33pm UTC](https://discuss.elastic.co/t/timestamp-field-being-passed-in-epoch-with-hadoop-library/138774 "2018-07-17T12:33:18Z")

</div>

HI Team, I have been able to follow instructions to get my ORC data passed to Elasticsearch but having issues with my data source not having a timestamp and even with formatting the timestamp shows as numeric. Below ar…

---

## [Failed to parse field \[fields\]\]](https://discuss.elastic.co/t/failed-to-parse-field-fields/140327)

<div class="topic-metadata">

**Author:** [@halleystar](https://discuss.elastic.co/u/halleystar)\
**Replies:** 0\
**Last updated:** [July 17, 2018, 12:15pm UTC](https://discuss.elastic.co/t/failed-to-parse-field-fields/140327 "2018-07-17T12:15:46Z")

</div>

The elasticsearch version is 5.6.4 and the RestHighLevelClient is also 5.6.4 SearchRequest{searchType=QUERY\_THEN\_FETCH, indices=\[gis-region-alias\], indicesOptions=IndicesOptions\[id=38, ignore\_unavailable=false, allow\_no…

---

## [Courier fetch failed to fetch 34 shards](https://discuss.elastic.co/t/courier-fetch-failed-to-fetch-34-shards/140324)

<div class="topic-metadata">

**Author:** [@victor.nilsson](https://discuss.elastic.co/u/victor.nilsson)\
**Replies:** 0\
**Last updated:** [July 17, 2018, 12:01pm UTC](https://discuss.elastic.co/t/courier-fetch-failed-to-fetch-34-shards/140324 "2018-07-17T12:01:57Z")

</div>

Hi I was trying to create a visulization with a coordinate map using the geoip.location tag but immediately gets an error in Kibana where it says "Courier fetch: 34 of 54 shards failed." I tried to increase the "thread\_…

---

## [Elasticsearch indexing performance below expectations at a single installation](https://discuss.elastic.co/t/elasticsearch-indexing-performance-below-expectations-at-a-single-installation/140165)

<div class="topic-metadata">

**Author:** [@matw](https://discuss.elastic.co/u/matw)\
**Replies:** 5\
**Last updated:** [July 17, 2018, 11:54am UTC](https://discuss.elastic.co/t/elasticsearch-indexing-performance-below-expectations-at-a-single-installation/140165 "2018-07-17T11:54:17Z")

</div>

we've got problems with the indexing rate of elasticsearch at a customer's installation. Our system is a single node redis -\> logstash (5.6.1) -\> elasticsearch (5.6.1) pipeline. we've run several different tests in our…

---

## [How to get phonetic suggsetion?](https://discuss.elastic.co/t/how-to-get-phonetic-suggsetion/139575)

<div class="topic-metadata">

**Author:** [@vishwas\_jadav](https://discuss.elastic.co/u/vishwas_jadav)\
**Replies:** 0\
**Last updated:** [July 11, 2018, 1:23pm UTC](https://discuss.elastic.co/t/how-to-get-phonetic-suggsetion/139575 "2018-07-11T13:23:24Z")

</div>

I have used search query for phonetic search. But, now first I want to get suggestion before searching. I tried using same analyzer which I used for phonetic searching, but, got messy result. Here is an example GE…

---

## [All shards failed exception from elasticsearch aggregation query](https://discuss.elastic.co/t/all-shards-failed-exception-from-elasticsearch-aggregation-query/140319)

<div class="topic-metadata">

**Author:** [@ankur\_singla](https://discuss.elastic.co/u/ankur_singla)\
**Replies:** 1\
**Last updated:** [July 17, 2018, 11:35am UTC](https://discuss.elastic.co/t/all-shards-failed-exception-from-elasticsearch-aggregation-query/140319 "2018-07-17T11:35:52Z")

</div>

Hi, I am trying to execute an aggregate query in which I am getting index\_out\_of\_bounds\_exception: null exception. I looked into stack trace of exception in elasticsearch logs but couldn't understand the proper cause. H…

---

## [Discovery - Exclude wildcard?](https://discuss.elastic.co/t/discovery-exclude-wildcard/140201)

<div class="topic-metadata">

**Author:** [@S\_Chase](https://discuss.elastic.co/u/S_Chase)\
**Replies:** 1\
**Last updated:** [July 17, 2018, 11:34am UTC](https://discuss.elastic.co/t/discovery-exclude-wildcard/140201 "2018-07-17T11:34:51Z")

</div>

Currently on Elastic Stack 6.3.0. We (for now) use rsyslog as a central log collection and that server sends it in json format to Elastic Stack. All that is working good except I'm trying to filter out system login(s) …

---

## [All indexes deleted (including .kibana)](https://discuss.elastic.co/t/all-indexes-deleted-including-kibana/140292)

<div class="topic-metadata">

**Author:** [@Jerzy\_Stopa](https://discuss.elastic.co/u/Jerzy_Stopa)\
**Replies:** 7\
**Last updated:** [July 17, 2018, 11:21am UTC](https://discuss.elastic.co/t/all-indexes-deleted-including-kibana/140292 "2018-07-17T11:21:34Z")

</div>

Hi, I suddenly lost all data in elasticsearch. It is single node system. Log shows following: \[2018-07-17T07:44:52,833\]\[INFO \]\[o.e.c.m.MetaDataDeleteIndexService\] \[n524Xf9\] \[.monitoring-kibana-6-2018.07.17/cY3e38j6T…

---

## [NGINX Load Balancer with x-pack security](https://discuss.elastic.co/t/nginx-load-balancer-with-x-pack-security/140221)

<div class="topic-metadata">

**Author:** [@Steph\_van\_Schalkwyk](https://discuss.elastic.co/u/Steph_van_Schalkwyk)\
**Replies:** 1\
**Last updated:** [July 17, 2018, 11:04am UTC](https://discuss.elastic.co/t/nginx-load-balancer-with-x-pack-security/140221 "2018-07-17T11:04:51Z")

</div>

Trying to use NGINX LB when x-pack security is configured. I don't want to use NGINX Basic Auth, as thet efeats the purpose of x-pack security. Are there any guielines to o this? I can't seem to pass the user:password …

---

## [What is the name of anomaly index](https://discuss.elastic.co/t/what-is-the-name-of-anomaly-index/140280)

<div class="topic-metadata">

**Author:** [@rijinmp](https://discuss.elastic.co/u/rijinmp)\
**Replies:** 1\
**Last updated:** [July 17, 2018, 10:49am UTC](https://discuss.elastic.co/t/what-is-the-name-of-anomaly-index/140280 "2018-07-17T10:49:57Z")

</div>

HI All , I want to know the anomaly details saved index name . Where can I find the detected anomalies details . Job name , anomaly score etc The anomaly email alerts details, i want to fetch from index.

---

## [Geo Distance Query while using Query strings](https://discuss.elastic.co/t/geo-distance-query-while-using-query-strings/140305)

<div class="topic-metadata">

**Author:** [@Nico\_Benitez](https://discuss.elastic.co/u/Nico_Benitez)\
**Replies:** 0\
**Last updated:** [July 17, 2018, 10:18am UTC](https://discuss.elastic.co/t/geo-distance-query-while-using-query-strings/140305 "2018-07-17T10:18:38Z")

</div>

Greetings to all, We are developing a search project in which we are using query strings to access our Elastic Search Index. We would like to include a Geo Distance query to filter out results within a radius. But we …

---

## [Upgrade reindex helper creates duplicates of indexes that prevent launch](https://discuss.elastic.co/t/upgrade-reindex-helper-creates-duplicates-of-indexes-that-prevent-launch/140214)

<div class="topic-metadata">

**Author:** [@Ant](https://discuss.elastic.co/u/Ant)\
**Replies:** 7\
**Last updated:** [July 17, 2018, 9:30am UTC](https://discuss.elastic.co/t/upgrade-reindex-helper-creates-duplicates-of-indexes-that-prevent-launch/140214 "2018-07-17T09:30:52Z")

</div>

org.elasticsearch.bootstrap.StartupException: java.lang.IllegalStateException: index and alias names need to be unique, but the following duplicates were found \[.watches (alias of \[.watches-6/WIUCyhnGQPqZxIZ7Advo6Q\])\] I…

---

## [Position offsets incorrect on analysis - not getting results from a phrase query using query\_string](https://discuss.elastic.co/t/position-offsets-incorrect-on-analysis-not-getting-results-from-a-phrase-query-using-query-string/138586)

<div class="topic-metadata">

**Author:** [@O\_Rory](https://discuss.elastic.co/u/O_Rory)\
**Replies:** 1\
**Last updated:** [July 17, 2018, 9:09am UTC](https://discuss.elastic.co/t/position-offsets-incorrect-on-analysis-not-getting-results-from-a-phrase-query-using-query-string/138586 "2018-07-17T09:09:21Z")

</div>

Hi, got a weird situation where I was expecting to get a result for a phrase query but I'm getting nothing. This is in 6.2.3 and in 6.3 The index structure is as follows: PUT testing { "mappings": { "raw": { …

---

## [Elastalert for aws Elasticsearch service](https://discuss.elastic.co/t/elastalert-for-aws-elasticsearch-service/140154)

<div class="topic-metadata">

**Author:** [@Abdur\_Raqeeb1](https://discuss.elastic.co/u/Abdur_Raqeeb1)\
**Replies:** 2\
**Last updated:** [July 17, 2018, 9:08am UTC](https://discuss.elastic.co/t/elastalert-for-aws-elasticsearch-service/140154 "2018-07-17T09:08:18Z")

</div>

HI, Please let us know how can we configured elastalert for aws elasticsearch service.Because we don't any dedicated elastic IP .Also it has to access via url provided by an aws. Please suggest how can we configured it…

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1613)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1615)
