# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1330

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1331

---

## [SPARK-ES issue](https://discuss.elastic.co/t/spark-es-issue/177025)

<div class="topic-metadata">

**Author:** [@allami](https://discuss.elastic.co/u/allami)\
**Replies:** 0\
**Last updated:** [April 16, 2019, 8:24am UTC](https://discuss.elastic.co/t/spark-es-issue/177025 "2019-04-16T08:24:10Z")

</div>

Hello, i've this error while using "org.elasticsearch" % "elasticsearch-spark-20\_2.11" % "6.3.0" could you please help me resolve that: scala.MatchError: Buffer(00205215) (of class scala.collection.convert.Wrappers$JL…

---

## [When using the pattern, regular expressions do not work with Cyrillic](https://discuss.elastic.co/t/when-using-the-pattern-regular-expressions-do-not-work-with-cyrillic/177019)

<div class="topic-metadata">

**Author:** [@f2f6661b1f32a0f914ea](https://discuss.elastic.co/u/f2f6661b1f32a0f914ea)\
**Replies:** 0\
**Last updated:** [April 16, 2019, 8:04am UTC](https://discuss.elastic.co/t/when-using-the-pattern-regular-expressions-do-not-work-with-cyrillic/177019 "2019-04-16T08:04:54Z")

</div>

When creating Tokenizers, I want to use the following pattern: @Tokenizers(tokenizers =\> tokenizers.Pattern("nuget-id-tokenizer", p =\> p.Pattern(@"\\wа-яА-Я+")) But it doesn't work, although it works great in an online …

---

## [Extremely large translog files per shard in Elasticsearch 6.2.4](https://discuss.elastic.co/t/extremely-large-translog-files-per-shard-in-elasticsearch-6-2-4/174041)

<div class="topic-metadata">

**Author:** [@bsarkar](https://discuss.elastic.co/u/bsarkar)\
**Replies:** 6\
**Last updated:** [April 16, 2019, 8:01am UTC](https://discuss.elastic.co/t/extremely-large-translog-files-per-shard-in-elasticsearch-6-2-4/174041 "2019-04-16T08:01:48Z")

</div>

After upgrading all our production clusters to ES 6.2.4 from ES 5.6.10, we have on two instances on two separate clusters seen translog files for a shard grow much more than the configured 512MB. Interestingly this has o…

---

## [Es 7 and docker single node cluster](https://discuss.elastic.co/t/es-7-and-docker-single-node-cluster/176585)

<div class="topic-metadata">

**Author:** [@jillesvangurp](https://discuss.elastic.co/u/jillesvangurp)\
**Replies:** 3\
**Last updated:** [April 16, 2019, 7:16am UTC](https://discuss.elastic.co/t/es-7-and-docker-single-node-cluster/176585 "2019-04-16T07:16:56Z")

</div>

I'm trying to get a single node docker node up and running for testing. It seems things have changed since 6.7 and it now aborts with a "the default discovery settings are unsuitable for production use; at least one of \[…

---

## [Bulk import does nothing](https://discuss.elastic.co/t/bulk-import-does-nothing/176893)

<div class="topic-metadata">

**Author:** [@thebuleon29](https://discuss.elastic.co/u/thebuleon29)\
**Replies:** 5\
**Last updated:** [April 16, 2019, 6:56am UTC](https://discuss.elastic.co/t/bulk-import-does-nothing/176893 "2019-04-16T06:56:28Z")

</div>

Hi, I am trying to import a NDJSON file in ElasticSearch but it does absolutly nothing. Here is an sample of the file : { "create" : { "\_index" : "benchmark", "\_type" : "doc", "\_id" : "1" }} { "timestamp" : 15163671926…

---

## [Setting up cluster within same physical server which is divided into four VM's](https://discuss.elastic.co/t/setting-up-cluster-within-same-physical-server-which-is-divided-into-four-vms/176922)

<div class="topic-metadata">

**Author:** [@Abhinaw](https://discuss.elastic.co/u/Abhinaw)\
**Replies:** 13\
**Last updated:** [April 16, 2019, 6:55am UTC](https://discuss.elastic.co/t/setting-up-cluster-within-same-physical-server-which-is-divided-into-four-vms/176922 "2019-04-16T06:55:19Z")

</div>

HI, I have a 64GB physical server, i have converted this into 4 VM's , how do i create a cluster with 1 master node and 2 data node, as local ip will be same for all the servers, i don't want to allow access of data out…

---

## [Kibana Dashboard Tracking](https://discuss.elastic.co/t/kibana-dashboard-tracking/177000)

<div class="topic-metadata">

**Author:** [@Ashok2](https://discuss.elastic.co/u/Ashok2)\
**Replies:** 3\
**Last updated:** [April 16, 2019, 6:21am UTC](https://discuss.elastic.co/t/kibana-dashboard-tracking/177000 "2019-04-16T06:21:36Z")

</div>

Hi, Is there a way to track Kibana dashboard usage (i.e. number of times a particular user opens a dashboard)? I want to know the customers who is actively using the dashboard.

---

## [Load and CPU is high on few nodes](https://discuss.elastic.co/t/load-and-cpu-is-high-on-few-nodes/176969)

<div class="topic-metadata">

**Author:** [@surya2](https://discuss.elastic.co/u/surya2)\
**Replies:** 1\
**Last updated:** [April 16, 2019, 5:35am UTC](https://discuss.elastic.co/t/load-and-cpu-is-high-on-few-nodes/176969 "2019-04-16T05:35:17Z")

</div>

Hello, I have a 5node cluster all data, client and master and node 1,2,3 are on 6.3.1 version and node 4 and 5 are on 6.5.1 version. All nodes are 16cpu, 64gb ram, 32 gb heap and 500gb disk. Load and cpu on nodes 1,2 a…

---

## ["failed to process cluster event (put-mapping) within 30s" for first few requests to ingest into new index](https://discuss.elastic.co/t/failed-to-process-cluster-event-put-mapping-within-30s-for-first-few-requests-to-ingest-into-new-index/176831)

<div class="topic-metadata">

**Author:** [@markryall](https://discuss.elastic.co/u/markryall)\
**Replies:** 5\
**Last updated:** [April 16, 2019, 5:24am UTC](https://discuss.elastic.co/t/failed-to-process-cluster-event-put-mapping-within-30s-for-first-few-requests-to-ingest-into-new-index/176831 "2019-04-16T05:24:25Z")

</div>

Hi Everyone! We are ingesting documents into a new elasticsearch index using 40 separate processes. We're experiencing an issue which seems to only occur during the first few requests. We receive the following remote …

---

## [I get error when i try to parse json to elastic search](https://discuss.elastic.co/t/i-get-error-when-i-try-to-parse-json-to-elastic-search/176840)

<div class="topic-metadata">

**Author:** [@ridwan\_syarifudin1](https://discuss.elastic.co/u/ridwan_syarifudin1)\
**Replies:** 7\
**Last updated:** [April 16, 2019, 4:08am UTC](https://discuss.elastic.co/t/i-get-error-when-i-try-to-parse-json-to-elastic-search/176840 "2019-04-16T04:08:55Z")

</div>

when i use the curl command to parse json to elastic with this curl command: while read f1 do curl -XPOST 'http://localhost:9200/master\_product\_info/message?pipeline=parse\_master\_produk\_pipeline' -H "Content-Type: app…

---

## [Evaluate all elements in array \[array\_compare\]](https://discuss.elastic.co/t/evaluate-all-elements-in-array-array-compare/176401)

<div class="topic-metadata">

**Author:** [@Jesus\_Rodrigo](https://discuss.elastic.co/u/Jesus_Rodrigo)\
**Replies:** 2\
**Last updated:** [April 16, 2019, 3:52am UTC](https://discuss.elastic.co/t/evaluate-all-elements-in-array-array-compare/176401 "2019-04-16T03:52:44Z")

</div>

Hi, I'm trying do a watcher that examines a array with a certain value, which in turn is in another vector. It will be, compare "dp\_avg.value" with "dp\_actual.buckets.key". "buckets" : \[ { "doc\_count" : 4, "dp\_avg"…

---

## [\[Reindex in Java API\] how to reindex subset of fields](https://discuss.elastic.co/t/reindex-in-java-api-how-to-reindex-subset-of-fields/176991)

<div class="topic-metadata">

**Author:** [@amCharlie](https://discuss.elastic.co/u/amCharlie)\
**Replies:** 0\
**Last updated:** [April 16, 2019, 3:45am UTC](https://discuss.elastic.co/t/reindex-in-java-api-how-to-reindex-subset-of-fields/176991 "2019-04-16T03:45:50Z")

</div>

In Rest API, there's a function to reindex only a subset of the fields from the original documents by using source POST \_reindex { "source": { "index": "twitter", "\_source": \["user", "\_doc"\] }, "dest": { "index"…

---

## [Get different total number of returning result every time when using scroll search](https://discuss.elastic.co/t/get-different-total-number-of-returning-result-every-time-when-using-scroll-search/176988)

<div class="topic-metadata">

**Author:** [@Cherry\_Zhang](https://discuss.elastic.co/u/Cherry_Zhang)\
**Replies:** 0\
**Last updated:** [April 16, 2019, 3:18am UTC](https://discuss.elastic.co/t/get-different-total-number-of-returning-result-every-time-when-using-scroll-search/176988 "2019-04-16T03:18:14Z")

</div>

Hi, I've used the scroll search to get all the records I want, but every time, I get different number of records, sometimes around 40000, sometimes around 20000, sometimes around 70000, I set the size of returning rec…

---

## [Why is my curl not working properly?](https://discuss.elastic.co/t/why-is-my-curl-not-working-properly/176827)

<div class="topic-metadata">

**Author:** [@Ridwan\_Syarifudin](https://discuss.elastic.co/u/Ridwan_Syarifudin)\
**Replies:** 2\
**Last updated:** [April 16, 2019, 2:31am UTC](https://discuss.elastic.co/t/why-is-my-curl-not-working-properly/176827 "2019-04-16T02:31:07Z")

</div>

please help me, i think i got my pipelines and template correctly build but my curl its not working at all my template: PUT \_template/product\_template { "index\_patterns": \[ "master\_product\*" \], "settings": { "num…

---

## [Detecting user's intent from the query](https://discuss.elastic.co/t/detecting-users-intent-from-the-query/176983)

<div class="topic-metadata">

**Author:** [@mkural](https://discuss.elastic.co/u/mkural)\
**Replies:** 0\
**Last updated:** [April 15, 2019, 11:28pm UTC](https://discuss.elastic.co/t/detecting-users-intent-from-the-query/176983 "2019-04-15T23:28:06Z")

</div>

Folks, I am new to the elasticsearch world, but i have been around enterprise search for a while and one feature that I am very used to is the ability to detect the user's intent through some regular matching pattern and…

---

## [Hot to get all document \_id of an elasticsearch index](https://discuss.elastic.co/t/hot-to-get-all-document-id-of-an-elasticsearch-index/176297)

<div class="topic-metadata">

**Author:** [@telebh](https://discuss.elastic.co/u/telebh)\
**Replies:** 2\
**Last updated:** [April 15, 2019, 10:01pm UTC](https://discuss.elastic.co/t/hot-to-get-all-document-id-of-an-elasticsearch-index/176297 "2019-04-15T22:01:16Z")

</div>

I am trying to pull list of all doc\_ids in Elasticsearch index. the index contains 15 million docs, I am only interested in doc\_id. I have set search query in java by setting "size" parameter to 15 million, but i got exc…

---

## [Does enabling hash on datatype ip - speed up response on cardinality aggr?](https://discuss.elastic.co/t/does-enabling-hash-on-datatype-ip-speed-up-response-on-cardinality-aggr/176676)

<div class="topic-metadata">

**Author:** [@Anindya\_Roy](https://discuss.elastic.co/u/Anindya_Roy)\
**Replies:** 3\
**Last updated:** [April 15, 2019, 9:21pm UTC](https://discuss.elastic.co/t/does-enabling-hash-on-datatype-ip-speed-up-response-on-cardinality-aggr/176676 "2019-04-15T21:21:13Z")

</div>

It makes sense to turn on hash on fields whose datatype is string, to speed up response time of cardinality aggr as per https://www.elastic.co/guide/en/elasticsearch/plugins/current/mapper-murmur3.html Wondering if ther…

---

## [Can ElasticSearch ignore pages that are status 301 and 404?](https://discuss.elastic.co/t/can-elasticsearch-ignore-pages-that-are-status-301-and-404/176068)

<div class="topic-metadata">

**Author:** [@rangerlike](https://discuss.elastic.co/u/rangerlike)\
**Replies:** 3\
**Last updated:** [April 15, 2019, 7:51pm UTC](https://discuss.elastic.co/t/can-elasticsearch-ignore-pages-that-are-status-301-and-404/176068 "2019-04-15T19:51:13Z")

</div>

We have duplicate pages showing up in our results. If we 301 redirect these, will that solve the issue? Thank you.

---

## [Query\_string + ngrams - problem with multiple words search (v6.2)](https://discuss.elastic.co/t/query-string-ngrams-problem-with-multiple-words-search-v6-2/176963)

<div class="topic-metadata">

**Author:** [@whittssg](https://discuss.elastic.co/u/whittssg)\
**Replies:** 0\
**Last updated:** [April 15, 2019, 7:19pm UTC](https://discuss.elastic.co/t/query-string-ngrams-problem-with-multiple-words-search-v6-2/176963 "2019-04-15T19:19:56Z")

</div>

Hello, I have a field setup with the analyzer and search analyzer set to an NGRAM, all other fields are just text. In my js app i am using query\_string (no default fields or specific fields set). When i search using th…

---

## [Change a type in the index](https://discuss.elastic.co/t/change-a-type-in-the-index/176634)

<div class="topic-metadata">

**Author:** [@WarriorHarb](https://discuss.elastic.co/u/WarriorHarb)\
**Replies:** 3\
**Last updated:** [April 15, 2019, 7:13pm UTC](https://discuss.elastic.co/t/change-a-type-in-the-index/176634 "2019-04-15T19:13:08Z")

</div>

Hello, I'm a beginner at ElasticSearch. I'm having a big confusion. I have got log lines, i parsed them via grok filter. the Date type in index was string. I asked how to chage it to date. i was told to reindex it. i …

---

## [Transport client connections frequently closed in Kubernetes?](https://discuss.elastic.co/t/transport-client-connections-frequently-closed-in-kubernetes/176951)

<div class="topic-metadata">

**Author:** [@Chris\_Gatihi](https://discuss.elastic.co/u/Chris_Gatihi)\
**Replies:** 0\
**Last updated:** [April 15, 2019, 6:03pm UTC](https://discuss.elastic.co/t/transport-client-connections-frequently-closed-in-kubernetes/176951 "2019-04-15T18:03:36Z")

</div>

Hi, We recently moved to kubernetes our running services that use the Transport client to connect to ES . Our code keeps our transport client connection open unless we have a specific reason to close it (e.g. NoNodeAva…

---

## [Elasticsearch reporting unhealty status](https://discuss.elastic.co/t/elasticsearch-reporting-unhealty-status/176382)

<div class="topic-metadata">

**Author:** [@Luis\_Pereira1](https://discuss.elastic.co/u/Luis_Pereira1)\
**Replies:** 2\
**Last updated:** [April 15, 2019, 5:56pm UTC](https://discuss.elastic.co/t/elasticsearch-reporting-unhealty-status/176382 "2019-04-15T17:56:14Z")

</div>

hi, Im having an issue after upgrading my elastic stack from version 6.7 to 7.0 the elasticsearch is reporting unhealthy status but the container is up. Things i tried to get it working again, create a new network, d…

---

## [Javadoc of some classes unaccessible](https://discuss.elastic.co/t/javadoc-of-some-classes-unaccessible/175724)

<div class="topic-metadata">

**Author:** [@key](https://discuss.elastic.co/u/key)\
**Replies:** 1\
**Last updated:** [April 15, 2019, 5:53pm UTC](https://discuss.elastic.co/t/javadoc-of-some-classes-unaccessible/175724 "2019-04-15T17:53:36Z")

</div>

i was on this page of the javadoc : https://artifacts.elastic.co/javadoc/org/elasticsearch/client/elasticsearch-rest-high-level-client/6.7.1/org/elasticsearch/client/RestHighLevelClient.html and couldn't access the doc…

---

## [ILM : illegal\_argument\_exception: source alias \[elastiflow-3.4.1-alias\] does not point to a write index](https://discuss.elastic.co/t/ilm-illegal-argument-exception-source-alias-elastiflow-3-4-1-alias-does-not-point-to-a-write-index/174288)

<div class="topic-metadata">

**Author:** [@mayer](https://discuss.elastic.co/u/mayer)\
**Replies:** 1\
**Last updated:** [April 15, 2019, 3:20pm UTC](https://discuss.elastic.co/t/ilm-illegal-argument-exception-source-alias-elastiflow-3-4-1-alias-does-not-point-to-a-write-index/174288 "2019-04-15T15:20:34Z")

</div>

Dear All, My environment: ELK 6.6.1 with elastiflow 3.4.1 As disk space is limited I tried to setup an Index Lifecycle Policy. Initially I failed with the following type of error. illegal\_argument\_exception: index.lif…

---

## [Plugin:elasticsearch@6.2.4 Service Unavailable](https://discuss.elastic.co/t/plugin-elasticsearch-6-2-4-service-unavailable/176930)

<div class="topic-metadata">

**Author:** [@Hazimlarhlimi](https://discuss.elastic.co/u/Hazimlarhlimi)\
**Replies:** 0\
**Last updated:** [April 15, 2019, 3:08pm UTC](https://discuss.elastic.co/t/plugin-elasticsearch-6-2-4-service-unavailable/176930 "2019-04-15T15:08:27Z")

</div>

Hi, I am a new user of ELK, and i have a problem with elasticsearch. Actually, when i run kibana on my browser, i found a problem with elasticsearch, it is down (red) Could you help me to solve the problem ? Thank yo…

---

## [\[Springboot\]Rest High Level Client 7.0 can't use search method, missing org.elasticsearch.action.search.SearchRequest](https://discuss.elastic.co/t/springboot-rest-high-level-client-7-0-cant-use-search-method-missing-org-elasticsearch-action-search-searchrequest/176898)

<div class="topic-metadata">

**Author:** [@LinJIngYun](https://discuss.elastic.co/u/LinJIngYun)\
**Replies:** 2\
**Last updated:** [April 15, 2019, 2:59pm UTC](https://discuss.elastic.co/t/springboot-rest-high-level-client-7-0-cant-use-search-method-missing-org-elasticsearch-action-search-searchrequest/176898 "2019-04-15T14:59:13Z")

</div>

I use Elasticsearch 7.0 (Latest Release) fresh new installing scratch without any upgrade from previous version. But I confront the problem when I try to use searching method. It said that can't find org.elasticsearc…

---

## [Transport client throwing NPE when closing](https://discuss.elastic.co/t/transport-client-throwing-npe-when-closing/176648)

<div class="topic-metadata">

**Author:** [@Chris\_Gatihi](https://discuss.elastic.co/u/Chris_Gatihi)\
**Replies:** 8\
**Last updated:** [April 15, 2019, 2:46pm UTC](https://discuss.elastic.co/t/transport-client-throwing-npe-when-closing/176648 "2019-04-15T14:46:52Z")

</div>

Hi, I'm using ES and Transport 5.5.2 and getting an NPE thrown when closing the transport client: // Shut down existing client if open if (client != null) { logger.info("Detected open Transport client - closi…

---

## [Question about the index action in a watch](https://discuss.elastic.co/t/question-about-the-index-action-in-a-watch/173886)

<div class="topic-metadata">

**Author:** [@MalfuncEddie](https://discuss.elastic.co/u/MalfuncEddie)\
**Replies:** 5\
**Last updated:** [April 15, 2019, 2:18pm UTC](https://discuss.elastic.co/t/question-about-the-index-action-in-a-watch/173886 "2019-04-15T14:18:16Z")

</div>

Hi, I want to monitor when the number of filebeat agents changes. I prefer that instead of a log action or a mail action that it is indexed to the nagios index. I have a script that reads out the nagios index and then m…

---

## [\[error\] All shards failed after migration to 6.7.1](https://discuss.elastic.co/t/error-all-shards-failed-after-migration-to-6-7-1/176872)

<div class="topic-metadata">

**Author:** [@Ludovic9](https://discuss.elastic.co/u/Ludovic9)\
**Replies:** 4\
**Last updated:** [April 15, 2019, 2:12pm UTC](https://discuss.elastic.co/t/error-all-shards-failed-after-migration-to-6-7-1/176872 "2019-04-15T14:12:34Z")

</div>

Hi I have done this morning an upgrade of my elk stack, to 6.3.0 to 6.7.0 here the steps disable shards allocation update elasticserach when the "active\_shards\_percent\_as\_number" was 50% (yellow state) update logst…

---

## [Full cluster restart upgrade : Stop indexing and perform a synced flush](https://discuss.elastic.co/t/full-cluster-restart-upgrade-stop-indexing-and-perform-a-synced-flush/176914)

<div class="topic-metadata">

**Author:** [@ShilpaT](https://discuss.elastic.co/u/ShilpaT)\
**Replies:** 3\
**Last updated:** [April 15, 2019, 2:05pm UTC](https://discuss.elastic.co/t/full-cluster-restart-upgrade-stop-indexing-and-perform-a-synced-flush/176914 "2019-04-15T14:05:52Z")

</div>

I am trying to do an update Elasticsearch from 5.6.3 to 7.0.0. I am referring to the following guide for it: https://www.elastic.co/guide/en/elasticsearch/reference/current/restart-upgrade.html The browser is throwing …

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1329)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1331)
