# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1610

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1611

---

## [Autocomplete with text in documents](https://discuss.elastic.co/t/autocomplete-with-text-in-documents/140900)

<div class="topic-metadata">

**Author:** [@edoardo.zanon](https://discuss.elastic.co/u/edoardo.zanon)\
**Replies:** 0\
**Last updated:** [July 20, 2018, 1:27pm UTC](https://discuss.elastic.co/t/autocomplete-with-text-in-documents/140900 "2018-07-20T13:27:26Z")

</div>

Hi, I need to make an autocomplete in the text of documents. Example: Text -\> "Hi, I'm ciccio an developer. bla bla" Text -\> "Hi, I'm ciccio an boy. bla bla" Text -\> "Hi, I'm ciccio bad boy. bla bla" If someone sear…

---

## [Reindexed Index Still not Working in ES 5.6](https://discuss.elastic.co/t/reindexed-index-still-not-working-in-es-5-6/140898)

<div class="topic-metadata">

**Author:** [@syedtaha](https://discuss.elastic.co/u/syedtaha)\
**Replies:** 0\
**Last updated:** [July 20, 2018, 1:24pm UTC](https://discuss.elastic.co/t/reindexed-index-still-not-working-in-es-5-6/140898 "2018-07-20T13:24:56Z")

</div>

I have re indexed the index created in elastic search 1.1 in elastic search 2.x taken a snapshot then and then tried to restore it in elastic search 5.6. It showed error that it should be reindexed in elastic search 2.…

---

## [Extract timestamp from log message](https://discuss.elastic.co/t/extract-timestamp-from-log-message/140892)

<div class="topic-metadata">

**Author:** [@g.myznikov.tinkoff](https://discuss.elastic.co/u/g.myznikov.tinkoff)\
**Replies:** 0\
**Last updated:** [July 20, 2018, 12:57pm UTC](https://discuss.elastic.co/t/extract-timestamp-from-log-message/140892 "2018-07-20T12:57:10Z")

</div>

I get log messages like this one: Jul 20 14:15:29 ... and I want to use grok filter (INGEST NODE in ElasticSearch) to extract timestamp (time and date) from this log in format like @timestamp (not string) . It necessary…

---

## [Consider recent documents when querying?](https://discuss.elastic.co/t/consider-recent-documents-when-querying/140182)

<div class="topic-metadata">

**Author:** [@ESCoder](https://discuss.elastic.co/u/ESCoder)\
**Replies:** 1\
**Last updated:** [July 20, 2018, 12:45pm UTC](https://discuss.elastic.co/t/consider-recent-documents-when-querying/140182 "2018-07-20T12:45:35Z")

</div>

Hi, i was wondering if you guys can help me, we are using ES 6 version and NEST for queries. Our document structure has a recently modified date. In NEST, is there a way we can tell the query to consider more recent d…

---

## [Store text with hiphens and dot](https://discuss.elastic.co/t/store-text-with-hiphens-and-dot/140622)

<div class="topic-metadata">

**Author:** [@shashank123hr](https://discuss.elastic.co/u/shashank123hr)\
**Replies:** 1\
**Last updated:** [July 20, 2018, 12:37pm UTC](https://discuss.elastic.co/t/store-text-with-hiphens-and-dot/140622 "2018-07-20T12:37:26Z")

</div>

I am trying to come up with a query for elastic search to search for strings with hiphen and dots example : "PN-8100.0500-070, PN-8100.0500, PN-8100.0500-180". The search should be able to match exact strings like "PN-81…

---

## [Filter context strange results on ElasticSearch 6.3.0](https://discuss.elastic.co/t/filter-context-strange-results-on-elasticsearch-6-3-0/140886)

<div class="topic-metadata">

**Author:** [@cluengo](https://discuss.elastic.co/u/cluengo)\
**Replies:** 0\
**Last updated:** [July 20, 2018, 12:05pm UTC](https://discuss.elastic.co/t/filter-context-strange-results-on-elasticsearch-6-3-0/140886 "2018-07-20T12:05:31Z")

</div>

Hi all, I was checking why a terms query inside a nested query was taking so long, and realized that I got some strange results with 'profile'. The way I understand it, the "build\_scorer" field in the breakdown results …

---

## [Is Terms included in the remaining heap after the GC?](https://discuss.elastic.co/t/is-terms-included-in-the-remaining-heap-after-the-gc/140880)

<div class="topic-metadata">

**Author:** [@YuWatanabe](https://discuss.elastic.co/u/YuWatanabe)\
**Replies:** 0\
**Last updated:** [July 20, 2018, 11:18am UTC](https://discuss.elastic.co/t/is-terms-included-in-the-remaining-heap-after-the-gc/140880 "2018-07-20T11:18:01Z")

</div>

Hello. I would like to ask question about the heap memory. I am trying to free up heap memory by closing old indices. When I look at the chart of heap usage there is always some left overs after each old gc . In below…

---

## [Elastic Common Schema (ECS)](https://discuss.elastic.co/t/elastic-common-schema-ecs/140876)

<div class="topic-metadata">

**Author:** [@vikas\_gopal](https://discuss.elastic.co/u/vikas_gopal)\
**Replies:** 0\
**Last updated:** [July 20, 2018, 10:55am UTC](https://discuss.elastic.co/t/elastic-common-schema-ecs/140876 "2018-07-20T10:55:24Z")

</div>

Hi Experts, I was reading Elastic Common Schema (ECS) on Github. This is exactly I was about to ask as I am from Splunk Background . I am aware that it is still under development but I need to understand how it works , …

---

## [What is difference between BASIC, Gold, Platinum Enterprise 'Elasticsearch'](https://discuss.elastic.co/t/what-is-difference-between-basic-gold-platinum-enterprise-elasticsearch/140872)

<div class="topic-metadata">

**Author:** [@katiyar](https://discuss.elastic.co/u/katiyar)\
**Replies:** 3\
**Last updated:** [July 20, 2018, 10:50am UTC](https://discuss.elastic.co/t/what-is-difference-between-basic-gold-platinum-enterprise-elasticsearch/140872 "2018-07-20T10:50:45Z")

</div>

What is difference between BASIC, Gold, Platinum Enterprise 'Elasticsearch' ?

---

## [Elastic Cloud create trial deployment not working](https://discuss.elastic.co/t/elastic-cloud-create-trial-deployment-not-working/140725)

<div class="topic-metadata">

**Author:** [@Henr1k](https://discuss.elastic.co/u/Henr1k)\
**Replies:** 3\
**Last updated:** [July 20, 2018, 10:15am UTC](https://discuss.elastic.co/t/elastic-cloud-create-trial-deployment-not-working/140725 "2018-07-20T10:15:58Z")

</div>

I have created a account for Elastic Cloud and it says "Trial started" in the top corner. However when I try to create a deployment it says "Your trial period has expired." Anyone else experiencing this?

---

## [AWS Elasticsearch with Java High Level Rest Client](https://discuss.elastic.co/t/aws-elasticsearch-with-java-high-level-rest-client/139997)

<div class="topic-metadata">

**Author:** [@ashenoy1](https://discuss.elastic.co/u/ashenoy1)\
**Replies:** 1\
**Last updated:** [July 20, 2018, 10:00am UTC](https://discuss.elastic.co/t/aws-elasticsearch-with-java-high-level-rest-client/139997 "2018-07-20T10:00:50Z")

</div>

Hi I'm trying to make queries using Java HighLevelRestClient to AWS ElasticSearch. Both are versions 6.0.1. As I try to connected I'm getting a: org.apache.http.ConnectionClosedException: Connection closed Is this some…

---

## [Filter out documents before indexing in Elasticsearch based on certain condition](https://discuss.elastic.co/t/filter-out-documents-before-indexing-in-elasticsearch-based-on-certain-condition/139772)

<div class="topic-metadata">

**Author:** [@Ali\_Nazemian](https://discuss.elastic.co/u/Ali_Nazemian)\
**Replies:** 1\
**Last updated:** [July 20, 2018, 9:32am UTC](https://discuss.elastic.co/t/filter-out-documents-before-indexing-in-elasticsearch-based-on-certain-condition/139772 "2018-07-20T09:32:49Z")

</div>

I was wondering if I could filter our documents before indexing in Elasticsearch based on specific condition. For example, let's say I would like to drop a document from being index if field1="something". Is this somethi…

---

## [Can't get GeoIp data in Elasticsearch/Fluentd](https://discuss.elastic.co/t/cant-get-geoip-data-in-elasticsearch-fluentd/140500)

<div class="topic-metadata">

**Author:** [@mprzygrodzki](https://discuss.elastic.co/u/mprzygrodzki)\
**Replies:** 2\
**Last updated:** [July 20, 2018, 9:32am UTC](https://discuss.elastic.co/t/cant-get-geoip-data-in-elasticsearch-fluentd/140500 "2018-07-20T09:32:26Z")

</div>

Hello, i'm using Fluentd to push logs into Elasticsearch. The main goal is to have nginx-ingress logs published into Elasticsearch with geoip location so I can visualize metrics on dashboard with map based on IP's. I'm u…

---

## [Disk Size and RAM size for each data node and master node](https://discuss.elastic.co/t/disk-size-and-ram-size-for-each-data-node-and-master-node/140833)

<div class="topic-metadata">

**Author:** [@Tek\_Chand](https://discuss.elastic.co/u/Tek_Chand)\
**Replies:** 4\
**Last updated:** [July 20, 2018, 9:28am UTC](https://discuss.elastic.co/t/disk-size-and-ram-size-for-each-data-node-and-master-node/140833 "2018-07-20T09:28:18Z")

</div>

Hello All, I want to setup elastic search cluster with 3 node. One node will be master node and other 2 node will be data node. I have around 20 GB data per day i.e 600 GB for one month. Can you please help me to decide…

---

## [Query filter not working in ES 5.3](https://discuss.elastic.co/t/query-filter-not-working-in-es-5-3/139733)

<div class="topic-metadata">

**Author:** [@weiishann](https://discuss.elastic.co/u/weiishann)\
**Replies:** 1\
**Last updated:** [July 20, 2018, 9:23am UTC](https://discuss.elastic.co/t/query-filter-not-working-in-es-5-3/139733 "2018-07-20T09:23:30Z")

</div>

Hi all! I'm currently using Elasticsearch 5.3. The query filter doesn't seem to work for me. If I understand correctly, the query below should return all documents with only the specified terms. However, I'm getting ba…

---

## [Shard replication/recovery going slow](https://discuss.elastic.co/t/shard-replication-recovery-going-slow/140846)

<div class="topic-metadata">

**Author:** [@Ant](https://discuss.elastic.co/u/Ant)\
**Replies:** 1\
**Last updated:** [July 20, 2018, 8:06am UTC](https://discuss.elastic.co/t/shard-replication-recovery-going-slow/140846 "2018-07-20T08:06:33Z")

</div>

I recently had a node fail completely and had to rebuild it, there are only 3 nodes in the cluster and it took 5 days for the cluster to get back to a status of green. There are some indexes which are a few MB and others…

---

## [Is elastic search the right technology for this task?](https://discuss.elastic.co/t/is-elastic-search-the-right-technology-for-this-task/139068)

<div class="topic-metadata">

**Author:** [@BinaryIsPrimary](https://discuss.elastic.co/u/BinaryIsPrimary)\
**Replies:** 3\
**Last updated:** [July 20, 2018, 7:43am UTC](https://discuss.elastic.co/t/is-elastic-search-the-right-technology-for-this-task/139068 "2018-07-20T07:43:34Z")

</div>

I have a project where I have JSON documents which are like social media posts. They have tags, title, author, medias, location, etc. This is a concrete example of how the document could look like: { "id": "5af825…

---

## [Source for min eggs](https://discuss.elastic.co/t/source-for-min-eggs/140168)

<div class="topic-metadata">

**Author:** [@lebilien](https://discuss.elastic.co/u/lebilien)\
**Replies:** 1\
**Last updated:** [July 20, 2018, 7:21am UTC](https://discuss.elastic.co/t/source-for-min-eggs/140168 "2018-07-20T07:21:32Z")

</div>

hi i want to know the date of my min and max value i have this aggs "aggs": { "infodate": { "date\_histogram": { "field": "datecreation", "interval": "month" }, "aggs": { "moyenneposition": { "…

---

## [X-pack Access control](https://discuss.elastic.co/t/x-pack-access-control/140820)

<div class="topic-metadata">

**Author:** [@sreejiths](https://discuss.elastic.co/u/sreejiths)\
**Replies:** 2\
**Last updated:** [July 20, 2018, 7:14am UTC](https://discuss.elastic.co/t/x-pack-access-control/140820 "2018-07-20T07:14:45Z")

</div>

Is there any way in which i can control access of specific user set (for eg : from a specific ldap group) using x-pack to have access limited resources in Kibana . I dont want them to access management TAB & Developer to…

---

## [How can I compress my elasticsearch logs data?](https://discuss.elastic.co/t/how-can-i-compress-my-elasticsearch-logs-data/140828)

<div class="topic-metadata">

**Author:** [@sfrogit96](https://discuss.elastic.co/u/sfrogit96)\
**Replies:** 2\
**Last updated:** [July 20, 2018, 7:08am UTC](https://discuss.elastic.co/t/how-can-i-compress-my-elasticsearch-logs-data/140828 "2018-07-20T07:08:00Z")

</div>

Hi there, I'm new in elasticsearch and I have an issue. I created 2 indexes "test1" and "test2" to test log storage in elasticsaerch, I used this for test1, and default for test2: PUT /test1/\_settings {"index":{"codec":…

---

## [Display more than 10k records in sense plugin and elasticsearch-sql plugin](https://discuss.elastic.co/t/display-more-than-10k-records-in-sense-plugin-and-elasticsearch-sql-plugin/140670)

<div class="topic-metadata">

**Author:** [@sistla](https://discuss.elastic.co/u/sistla)\
**Replies:** 5\
**Last updated:** [July 20, 2018, 6:48am UTC](https://discuss.elastic.co/t/display-more-than-10k-records-in-sense-plugin-and-elasticsearch-sql-plugin/140670 "2018-07-20T06:48:06Z")

</div>

Hi, We are using Elasticsearch 2.4.6 , logstash 2.2 and kibana 4.1.6 and installed two plugins to query in the elastic search . But we are able to display only 10,000 records among the existing 1 million records . Her…

---

## [.raw fields not showing up for measurements field in local Elasticsearch index](https://discuss.elastic.co/t/raw-fields-not-showing-up-for-measurements-field-in-local-elasticsearch-index/139011)

<div class="topic-metadata">

**Author:** [@preranathm](https://discuss.elastic.co/u/preranathm)\
**Replies:** 9\
**Last updated:** [July 20, 2018, 6:35am UTC](https://discuss.elastic.co/t/raw-fields-not-showing-up-for-measurements-field-in-local-elasticsearch-index/139011 "2018-07-20T06:35:34Z")

</div>

Hi, I have created a local Elasticsearch index and I am using the following mapping: "docs": { "properties": { "dates": {"type": "nested","properties": {"count": {"type": "long"},"name": {"type": "long"}}}, "entities": …

---

## [Bug with field mappings?](https://discuss.elastic.co/t/bug-with-field-mappings/139735)

<div class="topic-metadata">

**Author:** [@peter-ponzel](https://discuss.elastic.co/u/peter-ponzel)\
**Replies:** 3\
**Last updated:** [July 20, 2018, 6:31am UTC](https://discuss.elastic.co/t/bug-with-field-mappings/139735 "2018-07-20T06:31:22Z")

</div>

hello, I just came across a strange behavior regarding field mappings and wanted to ask the professional, if that is really intended. I indexed a document to a newly created index that didn't had any mappings. Then of…

---

## [ELK index field comparison](https://discuss.elastic.co/t/elk-index-field-comparison/140687)

<div class="topic-metadata">

**Author:** [@vinu89](https://discuss.elastic.co/u/vinu89)\
**Replies:** 2\
**Last updated:** [July 20, 2018, 4:17am UTC](https://discuss.elastic.co/t/elk-index-field-comparison/140687 "2018-07-20T04:17:00Z")

</div>

Hello all, I have two indexes one index contains the list of malicious domains(index:malicious index) and other index has the logs from my DNS server(indexname:DNSindex) i need to compare whether the field(domainname) w…

---

## [How can i use elasticsearch query for exact match?](https://discuss.elastic.co/t/how-can-i-use-elasticsearch-query-for-exact-match/140799)

<div class="topic-metadata">

**Author:** [@Shrimp-Fried-Rice](https://discuss.elastic.co/u/Shrimp-Fried-Rice)\
**Replies:** 2\
**Last updated:** [July 20, 2018, 3:12am UTC](https://discuss.elastic.co/t/how-can-i-use-elasticsearch-query-for-exact-match/140799 "2018-07-20T03:12:26Z")

</div>

i have web app, where iam trying to move more and more queries from mysql to elasticsearch, even the ones which are not Full text search, to lower the system load. there are one type of queries which i need to match exa…

---

## [Migration from ES1.5.4 TO ES 6.3 HDD performance issue](https://discuss.elastic.co/t/migration-from-es1-5-4-to-es-6-3-hdd-performance-issue/140749)

<div class="topic-metadata">

**Author:** [@Denis\_Shilov](https://discuss.elastic.co/u/Denis_Shilov)\
**Replies:** 4\
**Last updated:** [July 20, 2018, 2:28am UTC](https://discuss.elastic.co/t/migration-from-es1-5-4-to-es-6-3-hdd-performance-issue/140749 "2018-07-20T02:28:36Z")

</div>

Hi. We run our db ES 1.5.4 and decide to move it to 6.3. Few words about environment: Everywhere we use same SATA HDD, for each version of ES we use cluster with 2 servers 32Gb RAM. We tried different RAID settings. …

---

## [Elasticsearch for master data management](https://discuss.elastic.co/t/elasticsearch-for-master-data-management/140816)

<div class="topic-metadata">

**Author:** [@Stefan\_van\_der\_Wel](https://discuss.elastic.co/u/Stefan_van_der_Wel)\
**Replies:** 0\
**Last updated:** [July 19, 2018, 11:43pm UTC](https://discuss.elastic.co/t/elasticsearch-for-master-data-management/140816 "2018-07-19T23:43:14Z")

</div>

Hi all Has anyone had experience using Elastic search for performing entity matching activities? Would be interested in understanding a bit more about the solution. My understanding is elastic search can define compari…

---

## [Elasticsearch Version Conflicts When Deleting Data](https://discuss.elastic.co/t/elasticsearch-version-conflicts-when-deleting-data/140413)

<div class="topic-metadata">

**Author:** [@yanwang](https://discuss.elastic.co/u/yanwang)\
**Replies:** 3\
**Last updated:** [July 19, 2018, 9:30pm UTC](https://discuss.elastic.co/t/elasticsearch-version-conflicts-when-deleting-data/140413 "2018-07-19T21:30:31Z")

</div>

Hi, We are now using DeleteByQueryRequestBuilder to do the batch deletion of data. But in the process I see the VersionConflictEngineException \[type\]\[id\]: version conflict, current version \[-1\] is different than the one…

---

## [My elasticsearch fatal error in thread](https://discuss.elastic.co/t/my-elasticsearch-fatal-error-in-thread/140645)

<div class="topic-metadata">

**Author:** [@chenzilong444](https://discuss.elastic.co/u/chenzilong444)\
**Replies:** 10\
**Last updated:** [July 19, 2018, 9:20pm UTC](https://discuss.elastic.co/t/my-elasticsearch-fatal-error-in-thread/140645 "2018-07-19T21:20:25Z")

</div>

that is log \[2018-07-19T10:08:09,453\]\[ERROR\]\[o.e.b.ElasticsearchUncaughtExceptionHandler\] \[\] fatal error in thread \[elasticsearch\[cvhieo8\]\[management\]\[T#1848\]\], exiting java.lang.OutOfMemoryError: Java heap space Heap…

---

## [Elasticsearch primary and replica shards not sync after bulk load](https://discuss.elastic.co/t/elasticsearch-primary-and-replica-shards-not-sync-after-bulk-load/140302)

<div class="topic-metadata">

**Author:** [@yanwang](https://discuss.elastic.co/u/yanwang)\
**Replies:** 6\
**Last updated:** [July 19, 2018, 9:17pm UTC](https://discuss.elastic.co/t/elasticsearch-primary-and-replica-shards-not-sync-after-bulk-load/140302 "2018-07-19T21:17:04Z")

</div>

Hi Guys, My team has been using the elasticsearch on aws ec2 for searching for about 2 years. We are always bothered by the out-of-sync issue between primary and replica shards. In our elasticsearch cluster we have main…

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1609)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1611)
