# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1463

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1464

---

## [Implement full-text fuzzy prefix search in Elastic search](https://discuss.elastic.co/t/implement-full-text-fuzzy-prefix-search-in-elastic-search/158990)

<div class="topic-metadata">

**Author:** [@ndakotabai](https://discuss.elastic.co/u/ndakotabai)\
**Replies:** 2\
**Last updated:** [December 4, 2018, 9:38pm UTC](https://discuss.elastic.co/t/implement-full-text-fuzzy-prefix-search-in-elastic-search/158990 "2018-12-04T21:38:22Z")

</div>

I understand that Elasticsearch tries to avoid using Fuzzy search with prefix matching, and this is also why it doesn't natively support such feature due to its complexity. However, we have a directory search system that…

---

## [Can't shrink, how to debug curator?](https://discuss.elastic.co/t/cant-shrink-how-to-debug-curator/159294)

<div class="topic-metadata">

**Author:** [@DPattee](https://discuss.elastic.co/u/DPattee)\
**Replies:** 5\
**Last updated:** [December 4, 2018, 9:20pm UTC](https://discuss.elastic.co/t/cant-shrink-how-to-debug-curator/159294 "2018-12-04T21:20:27Z")

</div>

Working on a test stack, elasticsearch and curator running on a single node, kibana running on a separate node, indexes set to zero repls, beat indexs set to the default 'daily index'... Experimenting with curator shrink…

---

## [Design patterns in elasticsearch](https://discuss.elastic.co/t/design-patterns-in-elasticsearch/159407)

<div class="topic-metadata">

**Author:** [@15hawai15](https://discuss.elastic.co/u/15hawai15)\
**Replies:** 5\
**Last updated:** [December 4, 2018, 8:51pm UTC](https://discuss.elastic.co/t/design-patterns-in-elasticsearch/159407 "2018-12-04T20:51:08Z")

</div>

Can someone please help me find 2 design patterns in elasticsearch code ?

---

## [DebugSqlSpec and integration tests](https://discuss.elastic.co/t/debugsqlspec-and-integration-tests/159219)

<div class="topic-metadata">

**Author:** [@cbismuth](https://discuss.elastic.co/u/cbismuth)\
**Replies:** 8\
**Last updated:** [December 4, 2018, 4:24pm UTC](https://discuss.elastic.co/t/debugsqlspec-and-integration-tests/159219 "2018-12-04T16:24:36Z")

</div>

Hi, I can't make the DebugSqlSpec test class work. When I run an Elasticsearch local server (./gradlew run --debug-jvm -Drun.license\_type=trial -Dxpack.security.enabled=false) and then run an empty implementation of th…

---

## [Could not find java; set JAVA\_HOME or ensure java is in PATH](https://discuss.elastic.co/t/could-not-find-java-set-java-home-or-ensure-java-is-in-path/158646)

<div class="topic-metadata">

**Author:** [@hiteshsharma](https://discuss.elastic.co/u/hiteshsharma)\
**Replies:** 2\
**Last updated:** [December 4, 2018, 4:16pm UTC](https://discuss.elastic.co/t/could-not-find-java-set-java-home-or-ensure-java-is-in-path/158646 "2018-12-04T16:16:31Z")

</div>

The Elastic search stopped working on my system all of a sudden. I was throwing out an error "could not find java; set JAVA\_HOME or ensure java is in PATH" I have JAVA\_HOME set to "C:\\Program Files\\Java\\jdk11.0.1" yet …

---

## [How to get the first inserted record from same group of records?](https://discuss.elastic.co/t/how-to-get-the-first-inserted-record-from-same-group-of-records/159253)

<div class="topic-metadata">

**Author:** [@sudhakar\_katakara](https://discuss.elastic.co/u/sudhakar_katakara)\
**Replies:** 2\
**Last updated:** [December 4, 2018, 3:50pm UTC](https://discuss.elastic.co/t/how-to-get-the-first-inserted-record-from-same-group-of-records/159253 "2018-12-04T15:50:46Z")

</div>

we have monitoring the servers with different tools and get the events when any server is down from all monitoring tools. we are inserting all these event as records doc type in elastic-search. we need to write query to…

---

## [\[No handler for type \[geo\_shape\] declared on field \[mapped\_geo\_shape\]\] AbstractQueryTestCase](https://discuss.elastic.co/t/no-handler-for-type-geo-shape-declared-on-field-mapped-geo-shape-abstractquerytestcase/156851)

<div class="topic-metadata">

**Author:** [@vgindin](https://discuss.elastic.co/u/vgindin)\
**Replies:** 8\
**Last updated:** [December 4, 2018, 3:02pm UTC](https://discuss.elastic.co/t/no-handler-for-type-geo-shape-declared-on-field-mapped-geo-shape-abstractquerytestcase/156851 "2018-12-04T15:02:56Z")

</div>

I have a plugin with a custom query and QueryBuilder. I've written the test extending it from org.elasticsearch.test.AbstractQueryTestCase. When I'm running it I got the following error: Caused by: MapperParsingExceptio…

---

## [Semantic Search Enablement](https://discuss.elastic.co/t/semantic-search-enablement/159377)

<div class="topic-metadata">

**Author:** [@aa1811](https://discuss.elastic.co/u/aa1811)\
**Replies:** 1\
**Last updated:** [December 4, 2018, 2:38pm UTC](https://discuss.elastic.co/t/semantic-search-enablement/159377 "2018-12-04T14:38:46Z")

</div>

Is there a plugin or support available for elasticsearch to enable semantic search and to provide integration with sparql, some of the similar functionalities of semantic search that are provided by solr are missing on e…

---

## [PipelineAction::Create/pipeline\_id:main, :exception=\>"LogStash::ConfigurationError", :message=\>"Expected one of #, {, ,, \] at line 4, column 36 (byte 99)](https://discuss.elastic.co/t/pipelineaction-create-pipeline-id-main-exception-logstash-configurationerror-message-expected-one-of-at-line-4-column-36-byte-99/159312)

<div class="topic-metadata">

**Author:** [@lungelo\_zondo](https://discuss.elastic.co/u/lungelo_zondo)\
**Replies:** 7\
**Last updated:** [December 4, 2018, 2:26pm UTC](https://discuss.elastic.co/t/pipelineaction-create-pipeline-id-main-exception-logstash-configurationerror-message-expected-one-of-at-line-4-column-36-byte-99/159312 "2018-12-04T14:26:21Z")

</div>

Hi, Can anyone please help with this issue, I am running CMD : :\\Users\\zondol\\logstash-6.5.1\\bin\>logstash -f /Users/zondol/data/logstash.config And below is my config file. input { file { path =\> "C:\\Users\\zondol\\da…

---

## [Azure discovery plugin deprecated](https://discuss.elastic.co/t/azure-discovery-plugin-deprecated/159379)

<div class="topic-metadata">

**Author:** [@Ofer\_Velich](https://discuss.elastic.co/u/Ofer_Velich)\
**Replies:** 0\
**Last updated:** [December 4, 2018, 2:16pm UTC](https://discuss.elastic.co/t/azure-discovery-plugin-deprecated/159379 "2018-12-04T14:16:29Z")

</div>

wondering when discovery-azure plugin should be available? seems like its still missing and that there is a PR open what should I do for discovery if I'm running elasticsearch on azure arm instances in the meantime? …

---

## [GCP services support of Elasticsearch 6.5.x and 5.6.x](https://discuss.elastic.co/t/gcp-services-support-of-elasticsearch-6-5-x-and-5-6-x/159374)

<div class="topic-metadata">

**Author:** [@aa1811](https://discuss.elastic.co/u/aa1811)\
**Replies:** 0\
**Last updated:** [December 4, 2018, 2:02pm UTC](https://discuss.elastic.co/t/gcp-services-support-of-elasticsearch-6-5-x-and-5-6-x/159374 "2018-12-04T14:02:41Z")

</div>

What are the different ways of indexing elasticsearch efficiently on GCP and AWS environments using pubsub, kinesis, kafka, or the like? Anyone used dataflow on GCP and does it now support elasticsearch 6.5. Google click…

---

## [Index is not creating?](https://discuss.elastic.co/t/index-is-not-creating/159363)

<div class="topic-metadata">

**Author:** [@inandi](https://discuss.elastic.co/u/inandi)\
**Replies:** 1\
**Last updated:** [December 4, 2018, 1:54pm UTC](https://discuss.elastic.co/t/index-is-not-creating/159363 "2018-12-04T13:54:44Z")

</div>

WARNING: Could not find logstash.yml which is typically located in $LS\_HOME/config or /etc/logstash. You can specify the path using --path.settings. Continuing using the defaults Could not find log4j2 configuration at pa…

---

## [Restoring indexes with curator](https://discuss.elastic.co/t/restoring-indexes-with-curator/158925)

<div class="topic-metadata">

**Author:** [@Dmytro\_Kulyk](https://discuss.elastic.co/u/Dmytro_Kulyk)\
**Replies:** 10\
**Last updated:** [December 4, 2018, 1:31pm UTC](https://discuss.elastic.co/t/restoring-indexes-with-curator/158925 "2018-12-04T13:31:41Z")

</div>

Hi, I have a problem with restoring indexes from one cluster to another. I'm using curator tool with actionfile: \> actions: \> 1: \> action: close \> options: \> delete\_aliases: False \> …

---

## [Node restart - initializing state](https://discuss.elastic.co/t/node-restart-initializing-state/159317)

<div class="topic-metadata">

**Author:** [@HugoP](https://discuss.elastic.co/u/HugoP)\
**Replies:** 1\
**Last updated:** [December 4, 2018, 1:18pm UTC](https://discuss.elastic.co/t/node-restart-initializing-state/159317 "2018-12-04T13:18:27Z")

</div>

Hi, I have a question about the recovery mechanism of a shard following a node restart. Before restarting a node, I always disable the allocation (cluster.routing.allocation.enable = none). I noticed that when the nod…

---

## [Log custom plugin classes and read it with docker logs](https://discuss.elastic.co/t/log-custom-plugin-classes-and-read-it-with-docker-logs/159354)

<div class="topic-metadata">

**Author:** [@Uiidoi12](https://discuss.elastic.co/u/Uiidoi12)\
**Replies:** 0\
**Last updated:** [December 4, 2018, 12:19pm UTC](https://discuss.elastic.co/t/log-custom-plugin-classes-and-read-it-with-docker-logs/159354 "2018-12-04T12:19:09Z")

</div>

Hi, I have Elasticsearch v6.5 in Docker and would like to know whether there is some specific rule I need to set to configure the log4j2.properties file in order to see logs from classes of a custom plugin I have built …

---

## [Date filed type](https://discuss.elastic.co/t/date-filed-type/159347)

<div class="topic-metadata">

**Author:** [@adzdrz](https://discuss.elastic.co/u/adzdrz)\
**Replies:** 0\
**Last updated:** [December 4, 2018, 11:39am UTC](https://discuss.elastic.co/t/date-filed-type/159347 "2018-12-04T11:39:50Z")

</div>

Is it possible to somehow map long date field(or convert, filter or configure in kibana/logstash) in existing index to formated date time?

---

## [How to create a mapping that apply to index with dynamic name like "index-%{YYYYMMDD}"](https://discuss.elastic.co/t/how-to-create-a-mapping-that-apply-to-index-with-dynamic-name-like-index-yyyymmdd/159345)

<div class="topic-metadata">

**Author:** [@guibarati](https://discuss.elastic.co/u/guibarati)\
**Replies:** 1\
**Last updated:** [December 4, 2018, 11:32am UTC](https://discuss.elastic.co/t/how-to-create-a-mapping-that-apply-to-index-with-dynamic-name-like-index-yyyymmdd/159345 "2018-12-04T11:32:29Z")

</div>

I'm using logstash to create new indices every day using the current date, but every time it does, the new index create new fields considering everything as "string". How can I configure my mapping, so when a new index …

---

## [Performance issue when searching data in a large array](https://discuss.elastic.co/t/performance-issue-when-searching-data-in-a-large-array/159182)

<div class="topic-metadata">

**Author:** [@DexinLi](https://discuss.elastic.co/u/DexinLi)\
**Replies:** 1\
**Last updated:** [December 4, 2018, 11:29am UTC](https://discuss.elastic.co/t/performance-issue-when-searching-data-in-a-large-array/159182 "2018-12-04T11:29:48Z")

</div>

Hello, We have an ES index of 14.2GB with 880,000+ docs。 Each doc has structure like this: { "\_index": "xxx", "\_type": "playlist", "\_id": "xxx", "\_score": 0, "\_source": { "id": 660369572158…

---

## [RAM usage and numeric fields with a limited amount of values and a lot of documents (KD Tree ?)](https://discuss.elastic.co/t/ram-usage-and-numeric-fields-with-a-limited-amount-of-values-and-a-lot-of-documents-kd-tree/159344)

<div class="topic-metadata">

**Author:** [@LeMic](https://discuss.elastic.co/u/LeMic)\
**Replies:** 0\
**Last updated:** [December 4, 2018, 11:18am UTC](https://discuss.elastic.co/t/ram-usage-and-numeric-fields-with-a-limited-amount-of-values-and-a-lot-of-documents-kd-tree/159344 "2018-12-04T11:18:07Z")

</div>

Hi, I want to understand why a field indexed as a keyword consume a constant amount of memory (RAM) while the same field indexed as a numeric datatype consumes memory in proportion to the number of documents in the inde…

---

## [Remove/Unmap a field alias](https://discuss.elastic.co/t/remove-unmap-a-field-alias/159258)

<div class="topic-metadata">

**Author:** [@GBP](https://discuss.elastic.co/u/GBP)\
**Replies:** 2\
**Last updated:** [December 4, 2018, 11:13am UTC](https://discuss.elastic.co/t/remove-unmap-a-field-alias/159258 "2018-12-04T11:13:59Z")

</div>

Hi, I am using Elasticsearch 6.5 to create alias datatypes to fields (https://www.elastic.co/guide/en/elasticsearch/reference/current/alias.html). For e.g. I have this mapping { "mappings": { "\_doc": { "pr…

---

## [Index.data\_path support](https://discuss.elastic.co/t/index-data-path-support/159341)

<div class="topic-metadata">

**Author:** [@coolkrishnan](https://discuss.elastic.co/u/coolkrishnan)\
**Replies:** 0\
**Last updated:** [December 4, 2018, 10:51am UTC](https://discuss.elastic.co/t/index-data-path-support/159341 "2018-12-04T10:51:24Z")

</div>

In ES 6.2, I wanted to store the data of a particular index in its own directory. To do it, I tried creating a mapping: PUT kings { "settings" : { "index" : { "number\_of\_shards" : 3, …

---

## [Field\_value\_factor on nested field with dynamic mapping](https://discuss.elastic.co/t/field-value-factor-on-nested-field-with-dynamic-mapping/158501)

<div class="topic-metadata">

**Author:** [@inversive](https://discuss.elastic.co/u/inversive)\
**Replies:** 2\
**Last updated:** [December 4, 2018, 10:13am UTC](https://discuss.elastic.co/t/field-value-factor-on-nested-field-with-dynamic-mapping/158501 "2018-12-04T10:13:51Z")

</div>

I'm trying to boost the \_score of documents by using the value (double) that is present in a dynamic field in a nested structure. This is (part of) my mapping: { "\_doc": { ... "dynamic": "strict",…

---

## [Snapshot failed, all data cannot be restored](https://discuss.elastic.co/t/snapshot-failed-all-data-cannot-be-restored/159286)

<div class="topic-metadata">

**Author:** [@Richardms](https://discuss.elastic.co/u/Richardms)\
**Replies:** 6\
**Last updated:** [December 4, 2018, 10:09am UTC](https://discuss.elastic.co/t/snapshot-failed-all-data-cannot-be-restored/159286 "2018-12-04T10:09:35Z")

</div>

I have 3 nodes, lets say node1, node1, and node3 i have succesfully restored the data from my nodes, but the data decrease fro, 380k data to 77k data. this is what i get from backup data "hits": { "total": 76908, "…

---

## [Losing documents while Reindex](https://discuss.elastic.co/t/losing-documents-while-reindex/158131)

<div class="topic-metadata">

**Author:** [@smogami](https://discuss.elastic.co/u/smogami)\
**Replies:** 12\
**Last updated:** [December 4, 2018, 9:12am UTC](https://discuss.elastic.co/t/losing-documents-while-reindex/158131 "2018-12-04T09:12:31Z")

</div>

Elasticsearch: 6.2 Hello. I am trying to update the mapping of an existing index, by the operations described below. This operation works well for the index if number of documents are relatively small (e.g. 1,000). …

---

## [UnknownHostException while installing license plugin windows](https://discuss.elastic.co/t/unknownhostexception-while-installing-license-plugin-windows/159303)

<div class="topic-metadata">

**Author:** [@Dhiral\_Kaniya](https://discuss.elastic.co/u/Dhiral_Kaniya)\
**Replies:** 6\
**Last updated:** [December 4, 2018, 9:11am UTC](https://discuss.elastic.co/t/unknownhostexception-while-installing-license-plugin-windows/159303 "2018-12-04T09:11:57Z")

</div>

Hi Team, I have installed ELK stack on windows server 2016 with metricbeats. Now I want to install watcher for configuring some alert on a specific scenario. I have gone through with watcher link. I came to know that …

---

## [Elasticsearch - Sort of Date fields using epoch\_millis](https://discuss.elastic.co/t/elasticsearch-sort-of-date-fields-using-epoch-millis/159213)

<div class="topic-metadata">

**Author:** [@Nikesh](https://discuss.elastic.co/u/Nikesh)\
**Replies:** 2\
**Last updated:** [December 4, 2018, 8:18am UTC](https://discuss.elastic.co/t/elasticsearch-sort-of-date-fields-using-epoch-millis/159213 "2018-12-04T08:18:18Z")

</div>

Hi all, I have stored date fields in Epoch\_millis format but as a string eg. { "date" : "1543257000000" } Will this affect my sort query? "sort" : \[ { "Date" : {"order" : "desc"}} \]

---

## [How to speed up date\_range aggregation with multiple ranges](https://discuss.elastic.co/t/how-to-speed-up-date-range-aggregation-with-multiple-ranges/159305)

<div class="topic-metadata">

**Author:** [@Ha\_Truong](https://discuss.elastic.co/u/Ha_Truong)\
**Replies:** 0\
**Last updated:** [December 4, 2018, 7:39am UTC](https://discuss.elastic.co/t/how-to-speed-up-date-range-aggregation-with-multiple-ranges/159305 "2018-12-04T07:39:45Z")

</div>

We are using date\_range aggregation where we have 30 date ranges in query, and we also need to do aggregation in each range, please see detail of query as below. This is taking about 6sec against data set where we have …

---

## [Indexmapping @timestamp fails](https://discuss.elastic.co/t/indexmapping-timestamp-fails/159306)

<div class="topic-metadata">

**Author:** [@mortenb123](https://discuss.elastic.co/u/mortenb123)\
**Replies:** 0\
**Last updated:** [December 4, 2018, 7:41am UTC](https://discuss.elastic.co/t/indexmapping-timestamp-fails/159306 "2018-12-04T07:41:48Z")

</div>

Usually my @timestamp index looks like: "@timestamp": { "type": "date", "format": "yyyy-MM-dd HH:mm:ss.SSS" }, But I find indexes where it looks like this: "@timestamp": { "type": "text", "fields": { "keyword": …

---

## [How to map unstructured data in elastic](https://discuss.elastic.co/t/how-to-map-unstructured-data-in-elastic/159256)

<div class="topic-metadata">

**Author:** [@Lucyj](https://discuss.elastic.co/u/Lucyj)\
**Replies:** 4\
**Last updated:** [December 4, 2018, 7:22am UTC](https://discuss.elastic.co/t/how-to-map-unstructured-data-in-elastic/159256 "2018-12-04T07:22:13Z")

</div>

Hi, I’m new to elastic and was wondering how elastic handles/deals with unstructured data and if their was a way to have it so that if there was a phone number in the following format, 0412 345 678, that it will take it …

---

## [Problem with painless script](https://discuss.elastic.co/t/problem-with-painless-script/159298)

<div class="topic-metadata">

**Author:** [@Calvin\_Zhang](https://discuss.elastic.co/u/Calvin_Zhang)\
**Replies:** 1\
**Last updated:** [December 4, 2018, 7:16am UTC](https://discuss.elastic.co/t/problem-with-painless-script/159298 "2018-12-04T07:16:50Z")

</div>

I was executing a bulk upsert with script when an error occurred. Here is the error message: "error": { "type": "illegal\_argument\_exception", "reason": "failed to execute script", "caused\_by": { "type": "script\_exc…

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1462)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1464)
