# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1385

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1386

---

## [Shard Allocation Forced Awareness](https://discuss.elastic.co/t/shard-allocation-forced-awareness/169572)

<div class="topic-metadata">

**Author:** [@franktex](https://discuss.elastic.co/u/franktex)\
**Replies:** 4\
**Last updated:** [February 22, 2019, 2:49pm UTC](https://discuss.elastic.co/t/shard-allocation-forced-awareness/169572 "2019-02-22T14:49:07Z")

</div>

Hi everyone, want to get a bit more understanding on Shard Allocation Forced Awareness. If the nodes housing the primary shards in zone1 go down, will the replica shards in zone2 become primary and not create replicas u…

---

## [Delete data matching query on Elasticsearch](https://discuss.elastic.co/t/delete-data-matching-query-on-elasticsearch/169594)

<div class="topic-metadata">

**Author:** [@espogian](https://discuss.elastic.co/u/espogian)\
**Replies:** 1\
**Last updated:** [February 22, 2019, 2:43pm UTC](https://discuss.elastic.co/t/delete-data-matching-query-on-elasticsearch/169594 "2019-02-22T14:43:42Z")

</div>

Hi, I have multiple indexes on ES and I would like to delete some documents matching a particular query. Index name is like logstash-YYYY.MM.dd and each document has a field named fieldname I would like to delete all …

---

## [Elk stack and certificates](https://discuss.elastic.co/t/elk-stack-and-certificates/169427)

<div class="topic-metadata">

**Author:** [@happycampo](https://discuss.elastic.co/u/happycampo)\
**Replies:** 4\
**Last updated:** [February 22, 2019, 2:33pm UTC](https://discuss.elastic.co/t/elk-stack-and-certificates/169427 "2019-02-22T14:33:24Z")

</div>

Hello, I'm new to ELK and I recently upgraded the 6.0.0 ELK stack to 6.6.1. Everything went pretty okay but for some reason all the certificates stopped working. I'm using docker containers and this all worked before.…

---

## [Field not analyzed by standard analyzer](https://discuss.elastic.co/t/field-not-analyzed-by-standard-analyzer/169593)

<div class="topic-metadata">

**Author:** [@Antanas\_Maseiva](https://discuss.elastic.co/u/Antanas_Maseiva)\
**Replies:** 0\
**Last updated:** [February 22, 2019, 2:26pm UTC](https://discuss.elastic.co/t/field-not-analyzed-by-standard-analyzer/169593 "2019-02-22T14:26:01Z")

</div>

Hi, Have a question, has somebody found the way of getting documents having field not analyzed due to non standard charset ?

---

## [ClusterBlockException:blocked by: \[SERVICE\_UNAVAILABLE/1/state not recovered /initialized\]](https://discuss.elastic.co/t/clusterblockexception-blocked-by-service-unavailable-1-state-not-recovered-initialized/169535)

<div class="topic-metadata">

**Author:** [@vincentduan](https://discuss.elastic.co/u/vincentduan)\
**Replies:** 1\
**Last updated:** [February 22, 2019, 2:13pm UTC](https://discuss.elastic.co/t/clusterblockexception-blocked-by-service-unavailable-1-state-not-recovered-initialized/169535 "2019-02-22T14:13:06Z")

</div>

I have 12nodes (include 3 master nodes and 9 data nodes). I use Elasticsearch 6.2.3 , ubuntu desktop 512G Memory, about 1000shards in cluster. Yesterday, the cluster status got red , because one of my data nodes crashe…

---

## [Is it possible to use query.ids with other conditions such as should or must?](https://discuss.elastic.co/t/is-it-possible-to-use-query-ids-with-other-conditions-such-as-should-or-must/169587)

<div class="topic-metadata">

**Author:** [@Raimon\_Bosch](https://discuss.elastic.co/u/Raimon_Bosch)\
**Replies:** 0\
**Last updated:** [February 22, 2019, 1:56pm UTC](https://discuss.elastic.co/t/is-it-possible-to-use-query-ids-with-other-conditions-such-as-should-or-must/169587 "2019-02-22T13:56:40Z")

</div>

Hi, Is it possible to use query.ids in combination with other conditions such as should or must? https://www.elastic.co/guide/en/elasticsearch/reference/current/query-dsl-ids-query.html Thanks in advance,

---

## [Impact of bulk operation errors failing to replicate - PR#30244](https://discuss.elastic.co/t/impact-of-bulk-operation-errors-failing-to-replicate-pr-30244/165794)

<div class="topic-metadata">

**Author:** [@vigyas](https://discuss.elastic.co/u/vigyas)\
**Replies:** 5\
**Last updated:** [February 22, 2019, 1:46pm UTC](https://discuss.elastic.co/t/impact-of-bulk-operation-errors-failing-to-replicate-pr-30244/165794 "2019-02-22T13:46:46Z")

</div>

Have a quick question around the impact of issue addressed by PR#30244 for ES 6.2 -- "Bulk operation fail to replicate operations when a mapping update times out" Is it specific to operations that need a mapping update,…

---

## [Keyword mapping is not working](https://discuss.elastic.co/t/keyword-mapping-is-not-working/169286)

<div class="topic-metadata">

**Author:** [@clrnd](https://discuss.elastic.co/u/clrnd)\
**Replies:** 2\
**Last updated:** [February 22, 2019, 1:46pm UTC](https://discuss.elastic.co/t/keyword-mapping-is-not-working/169286 "2019-02-22T13:46:29Z")

</div>

Hi! First of all thanks to everyone in the community, so far I'm very pleased with the stack! Now, I'm having an issue which is just driving me mad. I have this index template: GET /\_template/filebeat-6.5.4 { "filebe…

---

## [Top average list of terms](https://discuss.elastic.co/t/top-average-list-of-terms/169041)

<div class="topic-metadata">

**Author:** [@YvorL](https://discuss.elastic.co/u/YvorL)\
**Replies:** 3\
**Last updated:** [February 22, 2019, 1:45pm UTC](https://discuss.elastic.co/t/top-average-list-of-terms/169041 "2019-02-22T13:45:10Z")

</div>

I have a large daily index (150-200GB) which has several shards on different nodes. I want to check which terms have on average the largest values. However, when I run a terms aggregation ordered by the average aggregati…

---

## [Does the length of join key in parent/child can effect the speed of queries?](https://discuss.elastic.co/t/does-the-length-of-join-key-in-parent-child-can-effect-the-speed-of-queries/168993)

<div class="topic-metadata">

**Author:** [@sambodhi](https://discuss.elastic.co/u/sambodhi)\
**Replies:** 2\
**Last updated:** [February 22, 2019, 1:42pm UTC](https://discuss.elastic.co/t/does-the-length-of-join-key-in-parent-child-can-effect-the-speed-of-queries/168993 "2019-02-22T13:42:14Z")

</div>

We are on elasticsearch 6, we are using parent/child joins and it is currently based on ids which are (like '7C9F1FBF-0ACF-473D-A8CE-343968E981F6'), wondering if the length of these id or changing them to number (like '1…

---

## [Reindex from remote to cloud fails "Connection reset by peer"](https://discuss.elastic.co/t/reindex-from-remote-to-cloud-fails-connection-reset-by-peer/169459)

<div class="topic-metadata">

**Author:** [@dao](https://discuss.elastic.co/u/dao)\
**Replies:** 1\
**Last updated:** [February 22, 2019, 1:08pm UTC](https://discuss.elastic.co/t/reindex-from-remote-to-cloud-fails-connection-reset-by-peer/169459 "2019-02-22T13:08:42Z")

</div>

Hello, I try to reindex from a remote cluster to my elastic cloud cluster like this: POST \_reindex { "conflicts": "proceed", "source": { "remote": { "host": "http://aaa.mysite.com:9200", "username":…

---

## [Null values in AfterKey of Composite Aggregation are ignored in NEST 6.3.0 - 6.5.0](https://discuss.elastic.co/t/null-values-in-afterkey-of-composite-aggregation-are-ignored-in-nest-6-3-0-6-5-0/169532)

<div class="topic-metadata">

**Author:** [@leslie.ido](https://discuss.elastic.co/u/leslie.ido)\
**Replies:** 0\
**Last updated:** [February 22, 2019, 8:35am UTC](https://discuss.elastic.co/t/null-values-in-afterkey-of-composite-aggregation-are-ignored-in-nest-6-3-0-6-5-0/169532 "2019-02-22T08:35:43Z")

</div>

Hi guys, I'm using Composite Aggregation to summarize data. Since some fields may be missing, I set missing\_bucket = true, so the returned after\_key may contain key-value pairs with null values, like "after\_key" : { …

---

## [Elasticsearch ODBC Driver Version Conflict](https://discuss.elastic.co/t/elasticsearch-odbc-driver-version-conflict/169488)

<div class="topic-metadata">

**Author:** [@spithawk](https://discuss.elastic.co/u/spithawk)\
**Replies:** 1\
**Last updated:** [February 22, 2019, 12:36pm UTC](https://discuss.elastic.co/t/elasticsearch-odbc-driver-version-conflict/169488 "2019-02-22T12:36:57Z")

</div>

I was trying to use the ODBC driver to run queries using Power BI, but, when configuring the DSN, I get the following error message: "Version mismatch between server and driver" the version on the server is 6.4.3 and …

---

## [ERROR pipeline/output.go:121 Failed to publish events: temporary bulk send failure](https://discuss.elastic.co/t/error-pipeline-output-go-121-failed-to-publish-events-temporary-bulk-send-failure/169361)

<div class="topic-metadata">

**Author:** [@Sharad\_Ananth](https://discuss.elastic.co/u/Sharad_Ananth)\
**Replies:** 13\
**Last updated:** [February 22, 2019, 12:23pm UTC](https://discuss.elastic.co/t/error-pipeline-output-go-121-failed-to-publish-events-temporary-bulk-send-failure/169361 "2019-02-22T12:23:48Z")

</div>

I am getting the error whenever I try ingesting data into elasticsearch using filebeat. 2019-02-21T07:57:02.190Z INFO elasticsearch/client.go:721 Connected to Elasticsearch version 6.5.4 2019-02-21T07:57:0…

---

## [While executing a search on preloaded data in elasticsearch, the error occurs](https://discuss.elastic.co/t/while-executing-a-search-on-preloaded-data-in-elasticsearch-the-error-occurs/169571)

<div class="topic-metadata">

**Author:** [@Kushagra\_Makharia](https://discuss.elastic.co/u/Kushagra_Makharia)\
**Replies:** 0\
**Last updated:** [February 22, 2019, 11:50am UTC](https://discuss.elastic.co/t/while-executing-a-search-on-preloaded-data-in-elasticsearch-the-error-occurs/169571 "2019-02-22T11:50:33Z")

</div>

GET /sample/\_search \[status:406 request:0.001s\] TransportError Traceback (most recent call last) in ----\> 1 search\_results = search\_now(text) 2 synonyms = 3 def check(search\_results): 4…

---

## [Scoring and sort by entering one array into another](https://discuss.elastic.co/t/scoring-and-sort-by-entering-one-array-into-another/169565)

<div class="topic-metadata">

**Author:** [@Behemo1h](https://discuss.elastic.co/u/Behemo1h)\
**Replies:** 0\
**Last updated:** [February 22, 2019, 11:19am UTC](https://discuss.elastic.co/t/scoring-and-sort-by-entering-one-array-into-another/169565 "2019-02-22T11:19:21Z")

</div>

Hi guys. I have the following task. Example. I have objects obj1 \[ 'id':123, 'arrayField':\[ 1, 2, 3 \] \], obj2 \[ 'id':321, 'arrayField':\[ 10, 25, 3 \] \] So, i have array for search searchArray = \[7,9,12,…

---

## [ES rejecting bulk messages when writing to indices with 40 shards](https://discuss.elastic.co/t/es-rejecting-bulk-messages-when-writing-to-indices-with-40-shards/169234)

<div class="topic-metadata">

**Author:** [@antcas](https://discuss.elastic.co/u/antcas)\
**Replies:** 11\
**Last updated:** [February 22, 2019, 10:41am UTC](https://discuss.elastic.co/t/es-rejecting-bulk-messages-when-writing-to-indices-with-40-shards/169234 "2019-02-22T10:41:44Z")

</div>

Hi all. tl;dr: We had a weird issue in our ES cluster (v6.5.1) this week: bulk messages were being rejected when ES was writing to an index with 40 shards, and the problem was solved by creating a new index with only 5…

---

## [Elasticsearch as a Billing System Backend](https://discuss.elastic.co/t/elasticsearch-as-a-billing-system-backend/169552)

<div class="topic-metadata">

**Author:** [@nuwancs](https://discuss.elastic.co/u/nuwancs)\
**Replies:** 1\
**Last updated:** [February 22, 2019, 10:37am UTC](https://discuss.elastic.co/t/elasticsearch-as-a-billing-system-backend/169552 "2019-02-22T10:37:26Z")

</div>

We are in the process of designing a Billing system for our product. Now we are in the look for the data store to be used. Elasticsearch is one we considered, do you recommend using it in a system like billing has some c…

---

## [Cross cluster search](https://discuss.elastic.co/t/cross-cluster-search/168870)

<div class="topic-metadata">

**Author:** [@amitavmohanty01](https://discuss.elastic.co/u/amitavmohanty01)\
**Replies:** 1\
**Last updated:** [February 22, 2019, 10:35am UTC](https://discuss.elastic.co/t/cross-cluster-search/168870 "2019-02-22T10:35:36Z")

</div>

Please help me understand how each node operates in an cross cluster setup. Is the following representation right? LD -\> Local datacenter RD -\> Remote datacenter The idea here is that a query comes from Kibana to th…

---

## [From Hive to ES :EsHadoopException: Could not write all entries for bulk operation](https://discuss.elastic.co/t/from-hive-to-es-could-not-write-all-entries-for-bulk-operation/169554)

<div class="topic-metadata">

**Author:** [@shivakumar\_kasha](https://discuss.elastic.co/u/shivakumar_kasha)\
**Replies:** 0\
**Last updated:** [February 22, 2019, 10:30am UTC](https://discuss.elastic.co/t/from-hive-to-es-could-not-write-all-entries-for-bulk-operation/169554 "2019-02-22T10:30:41Z")

</div>

Hi we are trying to load data from hive to elasticsearch through es hadoop integration but we are facing some issues: The process which we followed is : First create an index manually in elasticsearch through curl com…

---

## [Controlling Elastic memory inside docker](https://discuss.elastic.co/t/controlling-elastic-memory-inside-docker/168368)

<div class="topic-metadata">

**Author:** [@Tobias\_Eriksson](https://discuss.elastic.co/u/Tobias_Eriksson)\
**Replies:** 4\
**Last updated:** [February 22, 2019, 10:26am UTC](https://discuss.elastic.co/t/controlling-elastic-memory-inside-docker/168368 "2019-02-22T10:26:26Z")

</div>

I am running Elastic 6.2.3 in a Docker container But do not understand how the RAM used by the process goes way beyond the limits set Container is configured "Memory": 34225520640, "CpusetMems": "", "KernelMemory":…

---

## [Hardware spec](https://discuss.elastic.co/t/hardware-spec/169549)

<div class="topic-metadata">

**Author:** [@csetzkorn](https://discuss.elastic.co/u/csetzkorn)\
**Replies:** 0\
**Last updated:** [February 22, 2019, 9:59am UTC](https://discuss.elastic.co/t/hardware-spec/169549 "2019-02-22T09:59:56Z")

</div>

I am using some C# code (NEST) to ingest 1.4 million documents. This run fine over night (chunk size 10 documents) but now stalled again after the ingestion of 228000-ish documents. I am getting: \[2019-02-22T09:36:30,94…

---

## [Thread\_pool settings have strange defaults in es v6.2.4](https://discuss.elastic.co/t/thread-pool-settings-have-strange-defaults-in-es-v6-2-4/169419)

<div class="topic-metadata">

**Author:** [@ndtreviv](https://discuss.elastic.co/u/ndtreviv)\
**Replies:** 5\
**Last updated:** [February 22, 2019, 9:50am UTC](https://discuss.elastic.co/t/thread-pool-settings-have-strange-defaults-in-es-v6-2-4/169419 "2019-02-22T09:50:25Z")

</div>

In the elasticsearch.yml config I'm setting the search thread\_pool size to be 4200, like so: thread\_pool.search.queue\_size: 4200 But the other day I received the following error: ElasticsearchStatusException\[Elasticse…

---

## [Disable indexing for all fields by default](https://discuss.elastic.co/t/disable-indexing-for-all-fields-by-default/169342)

<div class="topic-metadata">

**Author:** [@Praneet\_Khandelwal](https://discuss.elastic.co/u/Praneet_Khandelwal)\
**Replies:** 2\
**Last updated:** [February 22, 2019, 9:47am UTC](https://discuss.elastic.co/t/disable-indexing-for-all-fields-by-default/169342 "2019-02-22T09:47:47Z")

</div>

I have a mapping for the index I want to create in ElasticSearch. I want to disable indexing for all the fields in the mapping and enable only for a few fields which I can specify. Any suggestions for which mapping param…

---

## [Date math in a query string is affected by analyzer](https://discuss.elastic.co/t/date-math-in-a-query-string-is-affected-by-analyzer/169366)

<div class="topic-metadata">

**Author:** [@yraber](https://discuss.elastic.co/u/yraber)\
**Replies:** 8\
**Last updated:** [February 22, 2019, 9:19am UTC](https://discuss.elastic.co/t/date-math-in-a-query-string-is-affected-by-analyzer/169366 "2019-02-22T09:19:58Z")

</div>

It seems that a query\_string with date math gets modified by the analyzer, and despite having read all the doc and searched everywhere, I can't find a way around it. Here is a very basic example : PUT twitter/\_doc/1 { …

---

## [No such index while adding elaticsearch datasource in grafana](https://discuss.elastic.co/t/no-such-index-while-adding-elaticsearch-datasource-in-grafana/169520)

<div class="topic-metadata">

**Author:** [@Nexio](https://discuss.elastic.co/u/Nexio)\
**Replies:** 1\
**Last updated:** [February 22, 2019, 8:44am UTC](https://discuss.elastic.co/t/no-such-index-while-adding-elaticsearch-datasource-in-grafana/169520 "2019-02-22T08:44:33Z")

</div>

Hello Everyone, i am new to elasticsearch and grafana, i have installed grafana and elastic search on the same server but while adding datasource of elasticsearch on grafana using elasticsearch plugin, there is a secti…

---

## [Fielddata is disabled on text fields by default error](https://discuss.elastic.co/t/fielddata-is-disabled-on-text-fields-by-default-error/169528)

<div class="topic-metadata">

**Author:** [@shaonbean](https://discuss.elastic.co/u/shaonbean)\
**Replies:** 2\
**Last updated:** [February 22, 2019, 8:15am UTC](https://discuss.elastic.co/t/fielddata-is-disabled-on-text-fields-by-default-error/169528 "2019-02-22T08:15:49Z")

</div>

Fielddata is disabled on text fields by default. Set fielddata=true on \[system.network.name\] in order to load fielddata in memory by uninverting the inverted index. elk 6.6.1

---

## [Moving data to new index with more shards (Elasticsearch 1.7)](https://discuss.elastic.co/t/moving-data-to-new-index-with-more-shards-elasticsearch-1-7/169227)

<div class="topic-metadata">

**Author:** [@Roy\_Olsen](https://discuss.elastic.co/u/Roy_Olsen)\
**Replies:** 2\
**Last updated:** [February 22, 2019, 7:49am UTC](https://discuss.elastic.co/t/moving-data-to-new-index-with-more-shards-elasticsearch-1-7/169227 "2019-02-22T07:49:37Z")

</div>

We seem to be running out of shards on some of our larger indices on Elasticsearch 1.7. In order to utilize larger clusters with more nodes, I'm hoping that we can create new indices with more shards, and copy the data …

---

## [SQL like in elastic](https://discuss.elastic.co/t/sql-like-in-elastic/169410)

<div class="topic-metadata">

**Author:** [@Suren](https://discuss.elastic.co/u/Suren)\
**Replies:** 5\
**Last updated:** [February 22, 2019, 7:34am UTC](https://discuss.elastic.co/t/sql-like-in-elastic/169410 "2019-02-22T07:34:01Z")

</div>

Is it possible to search in elastic like "SQL LIKE" works ?? I have tried to search with wildcard but it is not working if there are spaces in word. Can I somehow adjust the wildcard usage to that case?

---

## [Accessing \_score in the filter of aggregations](https://discuss.elastic.co/t/accessing-score-in-the-filter-of-aggregations/166877)

<div class="topic-metadata">

**Author:** [@eddig](https://discuss.elastic.co/u/eddig)\
**Replies:** 3\
**Last updated:** [February 22, 2019, 7:11am UTC](https://discuss.elastic.co/t/accessing-score-in-the-filter-of-aggregations/166877 "2019-02-22T07:11:34Z")

</div>

There is an unexpected situation in how the filter aggregation works with the \_score of a document. It seems that the \_score is not accessible in the script inside of filter aggregation but in the same time, ES doesn't p…

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1384)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1386)
