# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1396

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1397

---

## [IBM Compose For Elasticsearch - Same as Elastic Search](https://discuss.elastic.co/t/ibm-compose-for-elasticsearch-same-as-elastic-search/168083)

<div class="topic-metadata">

**Author:** [@clouduser](https://discuss.elastic.co/u/clouduser)\
**Replies:** 2\
**Last updated:** [February 13, 2019, 4:47pm UTC](https://discuss.elastic.co/t/ibm-compose-for-elasticsearch-same-as-elastic-search/168083 "2019-02-13T16:47:23Z")

</div>

I came across IBM compose-for-elasticsearch. Just curious is the same Elastic Search 6.6 or its completely different product. Can someone share insights or any differences ? TIA

---

## [Elastic Search connection time (performance)](https://discuss.elastic.co/t/elastic-search-connection-time-performance/168252)

<div class="topic-metadata">

**Author:** [@Fr4nk](https://discuss.elastic.co/u/Fr4nk)\
**Replies:** 0\
**Last updated:** [February 13, 2019, 3:36pm UTC](https://discuss.elastic.co/t/elastic-search-connection-time-performance/168252 "2019-02-13T15:36:52Z")

</div>

We have Elastic Search installed on a Google Cloud Compute Engine. We query it via a Google Cloud App Engine. Now that should not be relevant.... The query execution time of Elastic is great! But our problem is the conn…

---

## [High Availability of my elastic cluster](https://discuss.elastic.co/t/high-availability-of-my-elastic-cluster/164933)

<div class="topic-metadata">

**Author:** [@pme](https://discuss.elastic.co/u/pme)\
**Replies:** 7\
**Last updated:** [February 13, 2019, 3:09pm UTC](https://discuss.elastic.co/t/high-availability-of-my-elastic-cluster/164933 "2019-02-13T15:09:52Z")

</div>

Hello, I have to maintain an elastic cluster composed of 8 data nodes on 4 virtual machines, 2 nodes per virtual machine. We have one index created every day, composed of 8 shards and 1 replica per shards. In this con…

---

## [Elasticsearch stack requirement](https://discuss.elastic.co/t/elasticsearch-stack-requirement/168245)

<div class="topic-metadata">

**Author:** [@devsecops-reetika](https://discuss.elastic.co/u/devsecops-reetika)\
**Replies:** 0\
**Last updated:** [February 13, 2019, 2:51pm UTC](https://discuss.elastic.co/t/elasticsearch-stack-requirement/168245 "2019-02-13T14:51:55Z")

</div>

Hi everyone, I have currently running ELK stack on aws cloud. Currently I am facing performance issue with same and highwater mark. I want to redeploy cluster , currently we have daily 400 GB data generated and we have…

---

## [Configuration on the index template for strict mapping](https://discuss.elastic.co/t/configuration-on-the-index-template-for-strict-mapping/168242)

<div class="topic-metadata">

**Author:** [@pkaramol](https://discuss.elastic.co/u/pkaramol)\
**Replies:** 0\
**Last updated:** [February 13, 2019, 2:42pm UTC](https://discuss.elastic.co/t/configuration-on-the-index-template-for-strict-mapping/168242 "2019-02-13T14:42:41Z")

</div>

This might be easy, but I was unable to find a relevant concrete example. In an index template, where should the dynamic: strict should be set so that strict mapping is enforced? Any examples?

---

## [GPG key](https://discuss.elastic.co/t/gpg-key/168116)

<div class="topic-metadata">

**Author:** [@simpsonr](https://discuss.elastic.co/u/simpsonr)\
**Replies:** 2\
**Last updated:** [February 13, 2019, 2:30pm UTC](https://discuss.elastic.co/t/gpg-key/168116 "2019-02-13T14:30:43Z")

</div>

Dear team, I am unable to install the gpg key or I am having a problem with it. see below: Connecting to artifacts.elastic.co|2a04:4e42:3b::734|:443... failed: Network is unreachable. thoughts....

---

## [Centralized Kibana + Elasticsearch + Log-pilot (Filebeat) for multiple kubernetes clusters](https://discuss.elastic.co/t/centralized-kibana-elasticsearch-log-pilot-filebeat-for-multiple-kubernetes-clusters/168238)

<div class="topic-metadata">

**Author:** [@Eka\_Heriyawan](https://discuss.elastic.co/u/Eka_Heriyawan)\
**Replies:** 0\
**Last updated:** [February 13, 2019, 2:12pm UTC](https://discuss.elastic.co/t/centralized-kibana-elasticsearch-log-pilot-filebeat-for-multiple-kubernetes-clusters/168238 "2019-02-13T14:12:41Z")

</div>

I have 5 kubernetes clusters in Alibabacloud, i have a plan to deploying ELK stack for logging management covering all clusters. I'v tested for single cluster (the cluster that ELK stack installed), but how if I want to …

---

## [Question on elastic search migration from 2.X to 6.X](https://discuss.elastic.co/t/question-on-elastic-search-migration-from-2-x-to-6-x/168234)

<div class="topic-metadata">

**Author:** [@jefferychen](https://discuss.elastic.co/u/jefferychen)\
**Replies:** 0\
**Last updated:** [February 13, 2019, 2:00pm UTC](https://discuss.elastic.co/t/question-on-elastic-search-migration-from-2-x-to-6-x/168234 "2019-02-13T14:00:48Z")

</div>

We are trying to migrate our elasticsearch to use HighLevelRestApi. I couldn't figure out how to match couple x-pack settings in HighLevelRestApi. In original transport api, we disabled ssl validation from client side b…

---

## [Delete Indices with Curator correct timestring format](https://discuss.elastic.co/t/delete-indices-with-curator-correct-timestring-format/168171)

<div class="topic-metadata">

**Author:** [@aleksei.saiko](https://discuss.elastic.co/u/aleksei.saiko)\
**Replies:** 2\
**Last updated:** [February 13, 2019, 1:47pm UTC](https://discuss.elastic.co/t/delete-indices-with-curator-correct-timestring-format/168171 "2019-02-13T13:47:06Z")

</div>

Hello! I'm trying to delete with Curator Indices that are older than X time. Seems like after running curator, it doesn't really work, because I still can see older Indices when running curl -X GET "localhost:9200/\_cat…

---

## [Discussion on Migration 2.x to 5.x](https://discuss.elastic.co/t/discussion-on-migration-2-x-to-5-x/168224)

<div class="topic-metadata">

**Author:** [@EliuFlorez](https://discuss.elastic.co/u/EliuFlorez)\
**Replies:** 0\
**Last updated:** [February 13, 2019, 1:03pm UTC](https://discuss.elastic.co/t/discussion-on-migration-2-x-to-5-x/168224 "2019-02-13T13:03:23Z")

</div>

\#Inglesh What differences or improvements can I get to migrate ElasticSearch 2.x to 5.x. Since I need to optimize my queries with more than 1 million records. It will be that my documents or query is wrong or due to the…

---

## [Setting Out Elastic Stack Test Infrastructure for PoC](https://discuss.elastic.co/t/setting-out-elastic-stack-test-infrastructure-for-poc/168210)

<div class="topic-metadata">

**Author:** [@Solomon\_UDOH](https://discuss.elastic.co/u/Solomon_UDOH)\
**Replies:** 0\
**Last updated:** [February 13, 2019, 12:17pm UTC](https://discuss.elastic.co/t/setting-out-elastic-stack-test-infrastructure-for-poc/168210 "2019-02-13T12:17:39Z")

</div>

Hi Everyone, I am new to the community but I have been lurking with elastic search for a while now. I would say I am fairly comfortable with ES tech. I have an idea that I have been working on for some time now and its…

---

## [Elasticsearch's default index recovery prioritisation for historical data](https://discuss.elastic.co/t/elasticsearchs-default-index-recovery-prioritisation-for-historical-data/168203)

<div class="topic-metadata">

**Author:** [@adaisley](https://discuss.elastic.co/u/adaisley)\
**Replies:** 2\
**Last updated:** [February 13, 2019, 12:12pm UTC](https://discuss.elastic.co/t/elasticsearchs-default-index-recovery-prioritisation-for-historical-data/168203 "2019-02-13T12:12:33Z")

</div>

Hi, We're reviewing what indices should be prioritised when our Elasticsearch cluster restarts, and before making modifications using settings.priority, we were wondering if Elasticsearch, by default uses some sort of l…

---

## [Elasticsearch Memory Usage Problem in Docker Container](https://discuss.elastic.co/t/elasticsearch-memory-usage-problem-in-docker-container/168204)

<div class="topic-metadata">

**Author:** [@nakyuz](https://discuss.elastic.co/u/nakyuz)\
**Replies:** 0\
**Last updated:** [February 13, 2019, 11:48am UTC](https://discuss.elastic.co/t/elasticsearch-memory-usage-problem-in-docker-container/168204 "2019-02-13T11:48:53Z")

</div>

I have a problem about memory usage of elasticsearch. In my system, 60000 documents are written to the database per hour . But memory usage is constantly increasing over time. I don't understand why it is always incr…

---

## [Getting documents based on field length](https://discuss.elastic.co/t/getting-documents-based-on-field-length/168178)

<div class="topic-metadata">

**Author:** [@saqibjavid](https://discuss.elastic.co/u/saqibjavid)\
**Replies:** 4\
**Last updated:** [February 13, 2019, 12:01pm UTC](https://discuss.elastic.co/t/getting-documents-based-on-field-length/168178 "2019-02-13T12:01:02Z")

</div>

I have uploaded nearly 1,000,000 JSON files into elastic search. I am looking for a query which will help me filter and return documents based on a condition of field length using kibana. For example I have a field of …

---

## [Elasticsearch - Low Level Rest Client Initialisation throwing exception](https://discuss.elastic.co/t/elasticsearch-low-level-rest-client-initialisation-throwing-exception/168046)

<div class="topic-metadata">

**Author:** [@Nikesh](https://discuss.elastic.co/u/Nikesh)\
**Replies:** 3\
**Last updated:** [February 13, 2019, 11:55am UTC](https://discuss.elastic.co/t/elasticsearch-low-level-rest-client-initialisation-throwing-exception/168046 "2019-02-13T11:55:37Z")

</div>

Hi, I am working on implementing Low Level Rest Client. I am facing issues with Initialising RestClient. The dependency in pom.xml is : \<dependency\> \<groupId\>org.elasticsearch.client\</groupId\> \<artifac…

---

## [Advice to process events in elasticsearch](https://discuss.elastic.co/t/advice-to-process-events-in-elasticsearch/168190)

<div class="topic-metadata">

**Author:** [@Ganesh2303](https://discuss.elastic.co/u/Ganesh2303)\
**Replies:** 4\
**Last updated:** [February 13, 2019, 11:53am UTC](https://discuss.elastic.co/t/advice-to-process-events-in-elasticsearch/168190 "2019-02-13T11:53:09Z")

</div>

Hi Team, Can anyone clear my doubt, we have stand-alone elasticsearch service is running and we are trying to parse 1 lakhs of record in 1s, is it possible to achieve that with good performance tuning. Parsing is happe…

---

## [Is it recommended to read/load 1TB of elastic search indexed data directly from spark](https://discuss.elastic.co/t/is-it-recommended-to-read-load-1tb-of-elastic-search-indexed-data-directly-from-spark/168198)

<div class="topic-metadata">

**Author:** [@Nagarjuna\_Gadikatla](https://discuss.elastic.co/u/Nagarjuna_Gadikatla)\
**Replies:** 0\
**Last updated:** [February 13, 2019, 11:31am UTC](https://discuss.elastic.co/t/is-it-recommended-to-read-load-1tb-of-elastic-search-indexed-data-directly-from-spark/168198 "2019-02-13T11:31:21Z")

</div>

Is it recommended to read/load 1TB of elastic search indexed data directly from spark. if not what is the recommended way to do that.

---

## [Ideas for data distribution in a cross cluster search design](https://discuss.elastic.co/t/ideas-for-data-distribution-in-a-cross-cluster-search-design/167452)

<div class="topic-metadata">

**Author:** [@scathatheworm](https://discuss.elastic.co/u/scathatheworm)\
**Replies:** 6\
**Last updated:** [February 13, 2019, 11:10am UTC](https://discuss.elastic.co/t/ideas-for-data-distribution-in-a-cross-cluster-search-design/167452 "2019-02-13T11:10:01Z")

</div>

Hello, I am working on building a large cross cluster search setup, consisting of several underlying clusters all equally sized, and a single smaller dedicated cluster to be used to access all nodes below with cross clu…

---

## [Curator Reindex Failed](https://discuss.elastic.co/t/curator-reindex-failed/168182)

<div class="topic-metadata">

**Author:** [@PoLo\_Chang](https://discuss.elastic.co/u/PoLo_Chang)\
**Replies:** 0\
**Last updated:** [February 13, 2019, 10:30am UTC](https://discuss.elastic.co/t/curator-reindex-failed/168182 "2019-02-13T10:30:47Z")

</div>

Hi Everyone, I wanted to reindex my daily indices to monthly with Curator. But i encountered a error like this : 2019-02-13 10:12:37,083 ERROR Failed to complete action: reindex. \<class 'curator.exceptions.Faile…

---

## [Parent-Child Query in two Index for es6.6](https://discuss.elastic.co/t/parent-child-query-in-two-index-for-es6-6/168168)

<div class="topic-metadata">

**Author:** [@iamazy](https://discuss.elastic.co/u/iamazy)\
**Replies:** 2\
**Last updated:** [February 13, 2019, 9:16am UTC](https://discuss.elastic.co/t/parent-child-query-in-two-index-for-es6-6/168168 "2019-02-13T09:16:58Z")

</div>

Is there anyway to achieve parent-child query in two different index for es6.6？

---

## [Indexing pdf and word files](https://discuss.elastic.co/t/indexing-pdf-and-word-files/168163)

<div class="topic-metadata">

**Author:** [@ronyarmon](https://discuss.elastic.co/u/ronyarmon)\
**Replies:** 1\
**Last updated:** [February 13, 2019, 8:53am UTC](https://discuss.elastic.co/t/indexing-pdf-and-word-files/168163 "2019-02-13T08:53:05Z")

</div>

Hello, I know it was asked before but I still need your advice about indexing word documents and pdfs. I read the tutorial and installed the Attachment Processor Plugin but I can't figure out from the tutorial how to l…

---

## [Intelligent Tiering & Snapshots](https://discuss.elastic.co/t/intelligent-tiering-snapshots/167510)

<div class="topic-metadata">

**Author:** [@ogg](https://discuss.elastic.co/u/ogg)\
**Replies:** 3\
**Last updated:** [February 13, 2019, 8:45am UTC](https://discuss.elastic.co/t/intelligent-tiering-snapshots/167510 "2019-02-13T08:45:57Z")

</div>

I have some questions regarding snapshots to s3 and Intelligent Tiering, we are seeking to save some $$ on our snapshot storage, however, If the snapshot process needs to access past snapshots to create the new snapshots…

---

## [How to use elastic search repository through docker](https://discuss.elastic.co/t/how-to-use-elastic-search-repository-through-docker/168154)

<div class="topic-metadata">

**Author:** [@bhagyakopparala](https://discuss.elastic.co/u/bhagyakopparala)\
**Replies:** 1\
**Last updated:** [February 13, 2019, 7:04am UTC](https://discuss.elastic.co/t/how-to-use-elastic-search-repository-through-docker/168154 "2019-02-13T07:04:12Z")

</div>

how to configure elastic search repository through docker

---

## [Malformed date field to populate into new field in elasticsearch](https://discuss.elastic.co/t/malformed-date-field-to-populate-into-new-field-in-elasticsearch/168155)

<div class="topic-metadata">

**Author:** [@Ram18](https://discuss.elastic.co/u/Ram18)\
**Replies:** 0\
**Last updated:** [February 13, 2019, 6:40am UTC](https://discuss.elastic.co/t/malformed-date-field-to-populate-into-new-field-in-elasticsearch/168155 "2019-02-13T06:40:25Z")

</div>

I have created a index in elasticsearch with multiple date field and formatted the column as "yyyy-mm-dd HH:mm:ss". Eventually I found the date is malformed and was populating wrong data into the fields. The index has mo…

---

## [Setup AD authentication](https://discuss.elastic.co/t/setup-ad-authentication/168103)

<div class="topic-metadata">

**Author:** [@mbarker](https://discuss.elastic.co/u/mbarker)\
**Replies:** 1\
**Last updated:** [February 13, 2019, 6:11am UTC](https://discuss.elastic.co/t/setup-ad-authentication/168103 "2019-02-13T06:11:36Z")

</div>

I am new to ELK, I am trying to setup AD authentication but has run into issues. I am seeing the following error in my log. failed to parse role \[admin\]. skipping role... failed to parse role \[power\_user\]. skipping rol…

---

## [Information disclosure issue with ES 5.6.9](https://discuss.elastic.co/t/information-disclosure-issue-with-es-5-6-9/167900)

<div class="topic-metadata">

**Author:** [@sss](https://discuss.elastic.co/u/sss)\
**Replies:** 1\
**Last updated:** [February 13, 2019, 2:30am UTC](https://discuss.elastic.co/t/information-disclosure-issue-with-es-5-6-9/167900 "2019-02-13T02:30:48Z")

</div>

HI, I have looked at the below post https://discuss.elastic.co/t/es-vulnerability-cve-2018-3831/153883 and it appears that X-pack is vulnerable since it stores secrets into cluster state ? Apart from x-Pack do what oth…

---

## [Reindex Change Field Type](https://discuss.elastic.co/t/reindex-change-field-type/168127)

<div class="topic-metadata">

**Author:** [@rudyamid](https://discuss.elastic.co/u/rudyamid)\
**Replies:** 0\
**Last updated:** [February 12, 2019, 11:52pm UTC](https://discuss.elastic.co/t/reindex-change-field-type/168127 "2019-02-12T23:52:02Z")

</div>

With ECS-GA coming our way, it was advised that we have to start using index templates to standardize on the correct field names & types. To prepare for this, I've started the exercise to reindex my firewall logs: Cr…

---

## [Trouble configuring Gmail SMTP with Watcher](https://discuss.elastic.co/t/trouble-configuring-gmail-smtp-with-watcher/168119)

<div class="topic-metadata">

**Author:** [@cbril](https://discuss.elastic.co/u/cbril)\
**Replies:** 3\
**Last updated:** [February 12, 2019, 10:55pm UTC](https://discuss.elastic.co/t/trouble-configuring-gmail-smtp-with-watcher/168119 "2019-02-12T22:55:34Z")

</div>

I have been going in circles for the past few hours trying to set up alerting with Watcher in Elasticsearch. I would greatly appreciate if someone could help me troubleshoot. There is an error at the time that Elasticsea…

---

## [Elastic 6.6 Objects in Arrays](https://discuss.elastic.co/t/elastic-6-6-objects-in-arrays/168102)

<div class="topic-metadata">

**Author:** [@rklingaman](https://discuss.elastic.co/u/rklingaman)\
**Replies:** 0\
**Last updated:** [February 12, 2019, 7:38pm UTC](https://discuss.elastic.co/t/elastic-6-6-objects-in-arrays/168102 "2019-02-12T19:38:31Z")

</div>

I've started pulling in Okta System log into ElasticSearch using this plugin: I have all that working and now I've been creating a template so that fields are getting formatted correctly. What I'm struggling with is h…

---

## [Multiple coordinating nodes](https://discuss.elastic.co/t/multiple-coordinating-nodes/168071)

<div class="topic-metadata">

**Author:** [@jwlee](https://discuss.elastic.co/u/jwlee)\
**Replies:** 1\
**Last updated:** [February 12, 2019, 7:43pm UTC](https://discuss.elastic.co/t/multiple-coordinating-nodes/168071 "2019-02-12T19:43:59Z")

</div>

Quick question on the multiple coordinating nodes. Based on the document any nodes that are set to false to the node.master, node.data and node.ingest become the coordinating nodes. If you have multiple coordinating nod…

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1395)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1397)
