# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1326

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1327

---

## [Trouble with Active D authentication settings](https://discuss.elastic.co/t/trouble-with-active-d-authentication-settings/176691)

<div class="topic-metadata">

**Author:** [@bigdamhero](https://discuss.elastic.co/u/bigdamhero)\
**Replies:** 4\
**Last updated:** [April 19, 2019, 1:30pm UTC](https://discuss.elastic.co/t/trouble-with-active-d-authentication-settings/176691 "2019-04-19T13:30:40Z")

</div>

Trying to set up ver 7 and some of the new settings in the yml are confusing. xpack.security.authc.realms: native.realm1: order: 0 enabled: true active\_directory.realm2: dhp\_ad: order: 1 enabled: tru…

---

## [ElasticSearch Java API re-connect](https://discuss.elastic.co/t/elasticsearch-java-api-re-connect/177620)

<div class="topic-metadata">

**Author:** [@GUBENDRAN\_LAKSHMANAN](https://discuss.elastic.co/u/GUBENDRAN_LAKSHMANAN)\
**Replies:** 0\
**Last updated:** [April 19, 2019, 1:06pm UTC](https://discuss.elastic.co/t/elasticsearch-java-api-re-connect/177620 "2019-04-19T13:06:28Z")

</div>

We are having springboot application with yaml configuration configured with ElasticSEarch URL. In our application we started getting error "Caused by: org.elasticsearch.client.transport.NoNodeAvailableException: None of…

---

## [What are the rules to follow for a quick search response from Elasticsearch?](https://discuss.elastic.co/t/what-are-the-rules-to-follow-for-a-quick-search-response-from-elasticsearch/177619)

<div class="topic-metadata">

**Author:** [@Aswini\_Kumar\_Rout](https://discuss.elastic.co/u/Aswini_Kumar_Rout)\
**Replies:** 0\
**Last updated:** [April 19, 2019, 12:43pm UTC](https://discuss.elastic.co/t/what-are-the-rules-to-follow-for-a-quick-search-response-from-elasticsearch/177619 "2019-04-19T12:43:31Z")

</div>

I am using HIgh level Java Rest client and I am getting the search response in average of 2.34 seconds for the 1st time when I search for a keyword after the 1st search because of caching I am getting response in 600 or …

---

## [Delete indexes and indexes pattern is forbidden](https://discuss.elastic.co/t/delete-indexes-and-indexes-pattern-is-forbidden/177606)

<div class="topic-metadata">

**Author:** [@guidoilbaldo](https://discuss.elastic.co/u/guidoilbaldo)\
**Replies:** 0\
**Last updated:** [April 19, 2019, 10:40am UTC](https://discuss.elastic.co/t/delete-indexes-and-indexes-pattern-is-forbidden/177606 "2019-04-19T10:40:13Z")

</div>

Hello, I just set up a new ELK cluster made by: 3 master/data nodes, 2 coordinating nodes and 1 kibana node, version 6.7. I have some filebeats sending data to logstash, then logstash sends data to elasticsearch. I tri…

---

## [Elasticsearch index mapping of datetime fields](https://discuss.elastic.co/t/elasticsearch-index-mapping-of-datetime-fields/177561)

<div class="topic-metadata">

**Author:** [@mkain](https://discuss.elastic.co/u/mkain)\
**Replies:** 6\
**Last updated:** [April 19, 2019, 10:18am UTC](https://discuss.elastic.co/t/elasticsearch-index-mapping-of-datetime-fields/177561 "2019-04-19T10:18:42Z")

</div>

Hi, I am inserting some messages into elasticsearch via fluendd (using fuentd REST method). message object has two datetime fields (START\_DATETIME and END\_DATETIME) which when inserted are mapped as string. My index c…

---

## [Elastic 2.4.2 support ubuntu 16.04](https://discuss.elastic.co/t/elastic-2-4-2-support-ubuntu-16-04/177592)

<div class="topic-metadata">

**Author:** [@pribal](https://discuss.elastic.co/u/pribal)\
**Replies:** 1\
**Last updated:** [April 19, 2019, 10:09am UTC](https://discuss.elastic.co/t/elastic-2-4-2-support-ubuntu-16-04/177592 "2019-04-19T10:09:25Z")

</div>

Need one info regrading elastic 2.4.2 .Is elastic 2.4.2 support ubuntu 16.04

---

## [Filebeat unable to send system error logs to elasticsearch](https://discuss.elastic.co/t/filebeat-unable-to-send-system-error-logs-to-elasticsearch/177558)

<div class="topic-metadata">

**Author:** [@suryaaccen](https://discuss.elastic.co/u/suryaaccen)\
**Replies:** 2\
**Last updated:** [April 19, 2019, 9:56am UTC](https://discuss.elastic.co/t/filebeat-unable-to-send-system-error-logs-to-elasticsearch/177558 "2019-04-19T09:56:55Z")

</div>

Filebeat unable to send system error logs to elasticsearch. Below conf file of filebeat and eleasticsearch. Also let me know how to change default index pattern. ####### Filebeat Configuration Example # This file is an…

---

## [Metrics from Aggregation results across two different buckets](https://discuss.elastic.co/t/metrics-from-aggregation-results-across-two-different-buckets/177510)

<div class="topic-metadata">

**Author:** [@Ankit\_Pradhan](https://discuss.elastic.co/u/Ankit_Pradhan)\
**Replies:** 2\
**Last updated:** [April 19, 2019, 9:03am UTC](https://discuss.elastic.co/t/metrics-from-aggregation-results-across-two-different-buckets/177510 "2019-04-19T09:03:32Z")

</div>

Plesse help Index has data like below {ID:ID1, Status:Status1, timeStamp:Timestamp1} {ID1 - Status2 - Timestamp 2} {ID1 - Status3 - Timestamp 3} {ID2 - Status 1 - Timestamp 2} {ID2 - Status 2 - Timestamp 3} {ID3 -…

---

## [The security token included in the request is invalid. (Service: AmazonDynamoDBv2)](https://discuss.elastic.co/t/the-security-token-included-in-the-request-is-invalid-service-amazondynamodbv2/177576)

<div class="topic-metadata">

**Author:** [@lvthillo](https://discuss.elastic.co/u/lvthillo)\
**Replies:** 0\
**Last updated:** [April 19, 2019, 7:12am UTC](https://discuss.elastic.co/t/the-security-token-included-in-the-request-is-invalid-service-amazondynamodbv2/177576 "2019-04-19T07:12:05Z")

</div>

I've setup logstash on an EC2 using an instance profile (role). As input we have filebeat, cloudwatch and kinesis. Filebeat and cloudwatch are working fine and are proving the instance profile is working. Also when I u…

---

## [Spark import es join type](https://discuss.elastic.co/t/spark-import-es-join-type/177574)

<div class="topic-metadata">

**Author:** [@001kulou](https://discuss.elastic.co/u/001kulou)\
**Replies:** 0\
**Last updated:** [April 19, 2019, 7:03am UTC](https://discuss.elastic.co/t/spark-import-es-join-type/177574 "2019-04-19T07:03:28Z")

</div>

es6.X version URL：https://cloud.tencent.com/developer/article/1106756 This is a join type mapping "mappings":{ "business1":{ "properties":{ "my\_join\_field":{ "type":"join", "relations":{ "company":\[ "sharehold…

---

## [Elasticsearch Upgrade from 6.7 to 7.0 on Kubernetes](https://discuss.elastic.co/t/elasticsearch-upgrade-from-6-7-to-7-0-on-kubernetes/177560)

<div class="topic-metadata">

**Author:** [@peterlee0127](https://discuss.elastic.co/u/peterlee0127)\
**Replies:** 0\
**Last updated:** [April 19, 2019, 3:46am UTC](https://discuss.elastic.co/t/elasticsearch-upgrade-from-6-7-to-7-0-on-kubernetes/177560 "2019-04-19T03:46:42Z")

</div>

Hi , I have some question about upgrade ELK from 6.x to 7.0. Nodes: elasticsearch-0, elasticsearch-1 Part of Elasticsearch 6.7.0 yaml spec: containers: - env: #- name: cluster.initial\_master\_nodes # va…

---

## [How to set Elasticsearch shards and replica](https://discuss.elastic.co/t/how-to-set-elasticsearch-shards-and-replica/177539)

<div class="topic-metadata">

**Author:** [@flash](https://discuss.elastic.co/u/flash)\
**Replies:** 1\
**Last updated:** [April 19, 2019, 2:49am UTC](https://discuss.elastic.co/t/how-to-set-elasticsearch-shards-and-replica/177539 "2019-04-19T02:49:57Z")

</div>

We are using Amazon Elasticsearch. There's a question raised for scaling and query performance. As we are adding more and more fields/document, do we need to customize our own number of shards or replicas? Is there a g…

---

## [\[Filter Context\] terms query vs should query](https://discuss.elastic.co/t/filter-context-terms-query-vs-should-query/177557)

<div class="topic-metadata">

**Author:** [@anirudh\_bharadwaj](https://discuss.elastic.co/u/anirudh_bharadwaj)\
**Replies:** 0\
**Last updated:** [April 19, 2019, 2:31am UTC](https://discuss.elastic.co/t/filter-context-terms-query-vs-should-query/177557 "2019-04-19T02:31:58Z")

</div>

I want to know the difference in query performance of a terms query vs a should query in filter context. i.e, Approach 1 Result = (myField in \['A1', 'A2'\] AND condition-1) OR (myField in \['B1', 'B2'\] AND condition-…

---

## [Could not find a version that satisfies the requirement MarkupSafe\>=0.23 (from Jinja2==2.9.5-\>esrally==1.0.4) (from versions: ) No matching distribution found for MarkupSafe\>=0.23 (from Jinja2==2.9.5-\>esrally==1.0.4)](https://discuss.elastic.co/t/could-not-find-a-version-that-satisfies-the-requirement-markupsafe-0-23-from-jinja2-2-9-5-esrally-1-0-4-from-versions-no-matching-distribution-found-for-markupsafe-0-23-from-jinja2-2-9-5-esrally-1-0-4/176889)

<div class="topic-metadata">

**Author:** [@swapnali](https://discuss.elastic.co/u/swapnali)\
**Replies:** 4\
**Last updated:** [April 19, 2019, 1:56am UTC](https://discuss.elastic.co/t/could-not-find-a-version-that-satisfies-the-requirement-markupsafe-0-23-from-jinja2-2-9-5-esrally-1-0-4-from-versions-no-matching-distribution-found-for-markupsafe-0-23-from-jinja2-2-9-5-esrally-1-0-4/176889 "2019-04-19T01:56:17Z")

</div>

Hello, I am Trying to install rally (Offline) i have installed python version 3.6 and pip 9.10 i am getting the below error kindly help me for this " Could not find a version that satisfies the requirement MarkupSafe\>=…

---

## [Upgrade elk 7 ，start elasticsearch failed](https://discuss.elastic.co/t/upgrade-elk-7-start-elasticsearch-failed/177394)

<div class="topic-metadata">

**Author:** [@shaonbean](https://discuss.elastic.co/u/shaonbean)\
**Replies:** 4\
**Last updated:** [April 18, 2019, 11:58pm UTC](https://discuss.elastic.co/t/upgrade-elk-7-start-elasticsearch-failed/177394 "2019-04-18T23:58:03Z")

</div>

\[2019-04-18T10:22:34,929\]\[WARN \]\[o.e.c.c.ClusterFormationFailureHelper\] \[es-1\] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and \[cluster.initial\_master\_nodes\] is empty on t…

---

## [Grok Processor Custom Patterns](https://discuss.elastic.co/t/grok-processor-custom-patterns/177543)

<div class="topic-metadata">

**Author:** [@Ryne\_Keel](https://discuss.elastic.co/u/Ryne_Keel)\
**Replies:** 2\
**Last updated:** [April 18, 2019, 10:16pm UTC](https://discuss.elastic.co/t/grok-processor-custom-patterns/177543 "2019-04-18T22:16:32Z")

</div>

I am trying to find out how to add new patterns to GET \_ingest/processor/grok I would like to do this so I can use filebeat to send a few extra log types to elasticsearch. Currently I am sending a few things directly t…

---

## [Cluster configuration - logstash and Kibana](https://discuss.elastic.co/t/cluster-configuration-logstash-and-kibana/177495)

<div class="topic-metadata">

**Author:** [@leoberbert](https://discuss.elastic.co/u/leoberbert)\
**Replies:** 0\
**Last updated:** [April 18, 2019, 2:58pm UTC](https://discuss.elastic.co/t/cluster-configuration-logstash-and-kibana/177495 "2019-04-18T14:58:16Z")

</div>

Dear Friends, I have 1 cluster with 3 data nodes and 1 master node. In the configuration of my logstash should I send the information only to the data nodes? Or should I send to the master node too? Another doubt I have…

---

## [Upgraded java to 1.8.0\_191 "\\Common was unexpected at this time." error trying to bring up elasticsearch. Why is this happening?](https://discuss.elastic.co/t/upgraded-java-to-1-8-0-191-common-was-unexpected-at-this-time-error-trying-to-bring-up-elasticsearch-why-is-this-happening/177536)

<div class="topic-metadata">

**Author:** [@mgolubov55](https://discuss.elastic.co/u/mgolubov55)\
**Replies:** 0\
**Last updated:** [April 18, 2019, 8:27pm UTC](https://discuss.elastic.co/t/upgraded-java-to-1-8-0-191-common-was-unexpected-at-this-time-error-trying-to-bring-up-elasticsearch-why-is-this-happening/177536 "2019-04-18T20:27:54Z")

</div>

I have been running Elasticsearch/Kibana/Logstash etc in Windows 7 and just upgraded Java to version 1.8.0\_191. When attempting to bring up elasticsearch I get the "\\Common was unexpected at this time." error. How c…

---

## [MLT Query Not Showing in Serialized JSON Output](https://discuss.elastic.co/t/mlt-query-not-showing-in-serialized-json-output/177522)

<div class="topic-metadata">

**Author:** [@tandasima](https://discuss.elastic.co/u/tandasima)\
**Replies:** 0\
**Last updated:** [April 18, 2019, 5:59pm UTC](https://discuss.elastic.co/t/mlt-query-not-showing-in-serialized-json-output/177522 "2019-04-18T17:59:53Z")

</div>

I am trying to create an Elasticsearch MLT query using NEST's object initializer syntax. However, the final query when serialized, is ONLY missing the MLT part of it. Every other query is present though. When inspecting…

---

## [Huge performance degradation during bulk indexing](https://discuss.elastic.co/t/huge-performance-degradation-during-bulk-indexing/175924)

<div class="topic-metadata">

**Author:** [@cfeenstra67](https://discuss.elastic.co/u/cfeenstra67)\
**Replies:** 7\
**Last updated:** [April 18, 2019, 6:32pm UTC](https://discuss.elastic.co/t/huge-performance-degradation-during-bulk-indexing/175924 "2019-04-18T18:32:02Z")

</div>

Details about our usage: We use ElasticSearch purely as an aggregation engine. Aggregations are almost always done across a limited time range. We use a single index with about 200 million time-based documents totaling…

---

## [Design question regarding document expiration](https://discuss.elastic.co/t/design-question-regarding-document-expiration/177507)

<div class="topic-metadata">

**Author:** [@jbalaguero](https://discuss.elastic.co/u/jbalaguero)\
**Replies:** 1\
**Last updated:** [April 18, 2019, 5:38pm UTC](https://discuss.elastic.co/t/design-question-regarding-document-expiration/177507 "2019-04-18T17:38:44Z")

</div>

We started to work with ES2.4 in our project to index the content of a xml cache. This cache has an eviction process (that triggers every 30s) that removes expired documents from the index (thousands of them). To avoid u…

---

## [Index mapping from Java client](https://discuss.elastic.co/t/index-mapping-from-java-client/177508)

<div class="topic-metadata">

**Author:** [@thebuleon29](https://discuss.elastic.co/u/thebuleon29)\
**Replies:** 0\
**Last updated:** [April 18, 2019, 4:02pm UTC](https://discuss.elastic.co/t/index-mapping-from-java-client/177508 "2019-04-18T16:02:44Z")

</div>

Hi, I want to use ElasticSearch as a Time Series Database and need to declare the timestamp as a date to plot the data in Grafana. I am stuck at the index creation because Java keeps throwing the same exception : org.e…

---

## [Distributed Requests from Rally](https://discuss.elastic.co/t/distributed-requests-from-rally/177361)

<div class="topic-metadata">

**Author:** [@rocksnslopes](https://discuss.elastic.co/u/rocksnslopes)\
**Replies:** 2\
**Last updated:** [April 18, 2019, 3:54pm UTC](https://discuss.elastic.co/t/distributed-requests-from-rally/177361 "2019-04-18T15:54:58Z")

</div>

Hi - I have slightly modified the percolator challenge to something like this: ... "parallel": { "tasks": \[ { "operation": "percolator\_with\_content\_president\_bush", "clients": 100, "warmup-iterations": 100, "ite…

---

## [Optimizing Percolator queries with no text fields](https://discuss.elastic.co/t/optimizing-percolator-queries-with-no-text-fields/177503)

<div class="topic-metadata">

**Author:** [@jbalaguero](https://discuss.elastic.co/u/jbalaguero)\
**Replies:** 0\
**Last updated:** [April 18, 2019, 3:48pm UTC](https://discuss.elastic.co/t/optimizing-percolator-queries-with-no-text-fields/177503 "2019-04-18T15:48:55Z")

</div>

I'm trying to find out if, in my use case, it is worth to try to optimize the percolator queries in ES 6.4. In these queries we only have dates, integers or keywords (no text fields). And we only use range and term. Bel…

---

## [Keyword Type](https://discuss.elastic.co/t/keyword-type/177360)

<div class="topic-metadata">

**Author:** [@aniaks](https://discuss.elastic.co/u/aniaks)\
**Replies:** 2\
**Last updated:** [April 18, 2019, 2:57pm UTC](https://discuss.elastic.co/t/keyword-type/177360 "2019-04-18T14:57:09Z")

</div>

I have a application where we are going to do only the aggregations and no search functionality at all. Hence thinking if making all the fields of type keyword instead of text would help me reduce the disk space. Current…

---

## [How elasticlogs-querying.json workload works](https://discuss.elastic.co/t/how-elasticlogs-querying-json-workload-works/177269)

<div class="topic-metadata">

**Author:** [@suvarna](https://discuss.elastic.co/u/suvarna)\
**Replies:** 1\
**Last updated:** [April 18, 2019, 2:45pm UTC](https://discuss.elastic.co/t/how-elasticlogs-querying-json-workload-works/177269 "2019-04-18T14:45:05Z")

</div>

Hi , I am using https://github.com/elastic/rally-eventdata-track track. Can anyone explain what elasticlogs-querying does. For querying what terms it will use.

---

## [Using Elasticsearch with Red Hat Open Shift (Kubernetes)](https://discuss.elastic.co/t/using-elasticsearch-with-red-hat-open-shift-kubernetes/177490)

<div class="topic-metadata">

**Author:** [@ea1987](https://discuss.elastic.co/u/ea1987)\
**Replies:** 0\
**Last updated:** [April 18, 2019, 2:36pm UTC](https://discuss.elastic.co/t/using-elasticsearch-with-red-hat-open-shift-kubernetes/177490 "2019-04-18T14:36:54Z")

</div>

Hi Guys! Has someone ever tried to set up a RedHat Open Shif infrastructure? If yes, can you please share opinions, suggestions, advices? Any recommendation will be really appreciated. Thanks!

---

## [Master election takes too long](https://discuss.elastic.co/t/master-election-takes-too-long/177305)

<div class="topic-metadata">

**Author:** [@Alex\_Davidovich](https://discuss.elastic.co/u/Alex_Davidovich)\
**Replies:** 19\
**Last updated:** [April 18, 2019, 2:15pm UTC](https://discuss.elastic.co/t/master-election-takes-too-long/177305 "2019-04-18T14:15:21Z")

</div>

I am using 5.4.1 version. I see in the logs \[2019-04-16T21:42:40,996\]\[INFO \]\[o.e.d.z.ZenDiscovery \] \[node-2\] master\_left \[{node-1}{Nuzkh0bnRw6LPnqkO-KUDg}{wxOLyucfTDqZUSfspSh5PQ}{172.20.67.236}{172.20.67.236:9300}\]…

---

## [Bug? Elasticsearch 7 (after upgrade from 6.7) slow search during 3-5 seconds every 60 seconds](https://discuss.elastic.co/t/bug-elasticsearch-7-after-upgrade-from-6-7-slow-search-during-3-5-seconds-every-60-seconds/177017)

<div class="topic-metadata">

**Author:** [@Nenad](https://discuss.elastic.co/u/Nenad)\
**Replies:** 36\
**Last updated:** [April 18, 2019, 1:10pm UTC](https://discuss.elastic.co/t/bug-elasticsearch-7-after-upgrade-from-6-7-slow-search-during-3-5-seconds-every-60-seconds/177017 "2019-04-18T13:10:27Z")

</div>

This post is regarding my Github Issue: https://github.com/elastic/elasticsearch/issues/41231 Elasticsearch Version: 7.0.0 OpenJDK Runtime Environment (build 1.8.0\_201-b09) Centos 7 Linux 3.10.0-957.5.1.el7.x86\_64 Af…

---

## [ES node remained green on VM although underlying disk failed](https://discuss.elastic.co/t/es-node-remained-green-on-vm-although-underlying-disk-failed/177452)

<div class="topic-metadata">

**Author:** [@A\_B](https://discuss.elastic.co/u/A_B)\
**Replies:** 6\
**Last updated:** [April 18, 2019, 12:56pm UTC](https://discuss.elastic.co/t/es-node-remained-green-on-vm-although-underlying-disk-failed/177452 "2019-04-18T12:56:40Z")

</div>

Hello, I faced a situation today where ES health checks remained green although one node had definite problems (which caused Logstash to block, etc). The scenario All my ES nodes run as libvirt guest VMs. Each VM has …

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1325)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1327)
