# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1674

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1675

---

## [Elasticsearch not able to use persistent Volume](https://discuss.elastic.co/t/elasticsearch-not-able-to-use-persistent-volume/133390)

<div class="topic-metadata">

**Author:** [@viggunayak](https://discuss.elastic.co/u/viggunayak)\
**Replies:** 1\
**Last updated:** [May 29, 2018, 4:42am UTC](https://discuss.elastic.co/t/elasticsearch-not-able-to-use-persistent-volume/133390 "2018-05-29T04:42:15Z")

</div>

I m trying to setup an elastic search cluster using a persistent Volume as storage in a kubernetes cluster. I have a NFS mount acting as a persistent volume. I read in the documentation that elastic search uses elastic…

---

## [Elasticsearch does not index all documents](https://discuss.elastic.co/t/elasticsearch-does-not-index-all-documents/133558)

<div class="topic-metadata">

**Author:** [@AlexisC](https://discuss.elastic.co/u/AlexisC)\
**Replies:** 3\
**Last updated:** [May 29, 2018, 4:09am UTC](https://discuss.elastic.co/t/elasticsearch-does-not-index-all-documents/133558 "2018-05-29T04:09:38Z")

</div>

Hello, I tried to index a CSV document of 10 000 000 of lines in Elasticsearch via Bulk API. I succeed in and it works. But, in the CSV file, I have several duplicates. So, I decided to put myself the \_id of each docum…

---

## [Need to Send JSON log on Elatic](https://discuss.elastic.co/t/need-to-send-json-log-on-elatic/133450)

<div class="topic-metadata">

**Author:** [@ankit2122](https://discuss.elastic.co/u/ankit2122)\
**Replies:** 4\
**Last updated:** [May 29, 2018, 3:55am UTC](https://discuss.elastic.co/t/need-to-send-json-log-on-elatic/133450 "2018-05-29T03:55:53Z")

</div>

ddadadadadadad

---

## [Max\_result\_window ignored](https://discuss.elastic.co/t/max-result-window-ignored/133329)

<div class="topic-metadata">

**Author:** [@ney](https://discuss.elastic.co/u/ney)\
**Replies:** 1\
**Last updated:** [May 29, 2018, 2:47am UTC](https://discuss.elastic.co/t/max-result-window-ignored/133329 "2018-05-29T02:47:58Z")

</div>

I'm using Elasticsearch 2.4.6. I've changed index.max\_result\_window to a lower number, but ES keeps returning everything that matches. Is there another way to limit the number of results?

---

## [What is the maximum size of an array of objects?](https://discuss.elastic.co/t/what-is-the-maximum-size-of-an-array-of-objects/133595)

<div class="topic-metadata">

**Author:** [@vflopes](https://discuss.elastic.co/u/vflopes)\
**Replies:** 0\
**Last updated:** [May 28, 2018, 11:57pm UTC](https://discuss.elastic.co/t/what-is-the-maximum-size-of-an-array-of-objects/133595 "2018-05-28T23:57:16Z")

</div>

I have a project using Elasticsearch as "primary database" (I know, some people will disagree with it) and we need ACL control per document, including document search visibility. We find the best way to do this by creati…

---

## [Collection of logs](https://discuss.elastic.co/t/collection-of-logs/133590)

<div class="topic-metadata">

**Author:** [@abhat](https://discuss.elastic.co/u/abhat)\
**Replies:** 3\
**Last updated:** [May 28, 2018, 11:21pm UTC](https://discuss.elastic.co/t/collection-of-logs/133590 "2018-05-28T23:21:13Z")

</div>

Hi Team, We are moving to containers and getting whole logs out of container is bit hectic. Kibana is proving helpful by displaying the logs from last n hours. So as of now I can see that Kibana can only display the l…

---

## [Log Filtering in ELK Stack](https://discuss.elastic.co/t/log-filtering-in-elk-stack/133588)

<div class="topic-metadata">

**Author:** [@abhat](https://discuss.elastic.co/u/abhat)\
**Replies:** 4\
**Last updated:** [May 28, 2018, 11:01pm UTC](https://discuss.elastic.co/t/log-filtering-in-elk-stack/133588 "2018-05-28T23:01:40Z")

</div>

Hi Team, I am new to ELK stack and I just setup an ELK stack which collects logs from tomcat log directory. My requirement is it should only capture SEVERE AND ERROR messages in the log files present in the log directo…

---

## [Convert MySQL query to Elasticsearch query](https://discuss.elastic.co/t/convert-mysql-query-to-elasticsearch-query/133509)

<div class="topic-metadata">

**Author:** [@newnewb](https://discuss.elastic.co/u/newnewb)\
**Replies:** 1\
**Last updated:** [May 28, 2018, 5:52pm UTC](https://discuss.elastic.co/t/convert-mysql-query-to-elasticsearch-query/133509 "2018-05-28T17:52:25Z")

</div>

Heello, We're considering moving to ELK, so I just started learning ES and I need to convert our MySQL query into Elasticsearch so we can benchmark the performance of both, but everything's still a bit confusing.. Can …

---

## [Few questions around ELK Stack](https://discuss.elastic.co/t/few-questions-around-elk-stack/133570)

<div class="topic-metadata">

**Author:** [@abhat](https://discuss.elastic.co/u/abhat)\
**Replies:** 2\
**Last updated:** [May 28, 2018, 10:24pm UTC](https://discuss.elastic.co/t/few-questions-around-elk-stack/133570 "2018-05-28T22:24:54Z")

</div>

Hi Team, Can you please help me answer below questions - what is the use of elastic.co key (rpm --import https://artifacts.elastic.co/GPG-KEY-elasticsearch) what does bootstrap.memory\_lock: true (elasticsearch.y…

---

## [Bulk index from .bat](https://discuss.elastic.co/t/bulk-index-from-bat/133484)

<div class="topic-metadata">

**Author:** [@delly.set](https://discuss.elastic.co/u/delly.set)\
**Replies:** 1\
**Last updated:** [May 28, 2018, 9:12pm UTC](https://discuss.elastic.co/t/bulk-index-from-bat/133484 "2018-05-28T21:12:08Z")

</div>

Hi, i want to run bulk index API from .bat file. The .bat file will run with Windows Task Scheduler under domain user which has 'superuser' role in the elasticsearch. So that I do not need to mentioned '--user : ' in t…

---

## [Aggregate geo shapes](https://discuss.elastic.co/t/aggregate-geo-shapes/133544)

<div class="topic-metadata">

**Author:** [@Malte\_Grosse](https://discuss.elastic.co/u/Malte_Grosse)\
**Replies:** 1\
**Last updated:** [May 28, 2018, 8:53pm UTC](https://discuss.elastic.co/t/aggregate-geo-shapes/133544 "2018-05-28T20:53:00Z")

</div>

Hi, i couldnt find any solution to aggregate all geo\_shape points of one index. example mapping would be like: { "weather-index": { "mappings": { "doc": { "properties": { "atmospheric\_pressure": { "type": "float" }, "…

---

## [Getting Unknown BaseAggregationBuilder exception when trying to get percentiles of daily average of documents per users](https://discuss.elastic.co/t/getting-unknown-baseaggregationbuilder-exception-when-trying-to-get-percentiles-of-daily-average-of-documents-per-users/133580)

<div class="topic-metadata">

**Author:** [@EtienneDemers](https://discuss.elastic.co/u/EtienneDemers)\
**Replies:** 0\
**Last updated:** [May 28, 2018, 6:23pm UTC](https://discuss.elastic.co/t/getting-unknown-baseaggregationbuilder-exception-when-trying-to-get-percentiles-of-daily-average-of-documents-per-users/133580 "2018-05-28T18:23:00Z")

</div>

Hi all, i have a rather large index of documents with a UID field to identify the users, the @timestamp field ans some other irrelevant fields for what i'm trying to do i'm trying to get the 25th, 50th and 75th percent…

---

## [CircuitBreakingException internal:index/shard/recovery/start\_recovery](https://discuss.elastic.co/t/circuitbreakingexception-internal-index-shard-recovery-start-recovery/133581)

<div class="topic-metadata">

**Author:** [@SKumarMN](https://discuss.elastic.co/u/SKumarMN)\
**Replies:** 0\
**Last updated:** [May 28, 2018, 6:30pm UTC](https://discuss.elastic.co/t/circuitbreakingexception-internal-index-shard-recovery-start-recovery/133581 "2018-05-28T18:30:19Z")

</div>

Hi All, I am running a few nodes of ES 5.6.5 with HEAP set to 30G and indices.breaker.total.limit to 20% . Some of my shards are unassigned and i tried to restart and once the ES is started I still see some of the shar…

---

## [Question about best practices - should I create a separate index when objects can within a document be in the thousands](https://discuss.elastic.co/t/question-about-best-practices-should-i-create-a-separate-index-when-objects-can-within-a-document-be-in-the-thousands/133527)

<div class="topic-metadata">

**Author:** [@Dave\_Clissold](https://discuss.elastic.co/u/Dave_Clissold)\
**Replies:** 0\
**Last updated:** [May 28, 2018, 11:32am UTC](https://discuss.elastic.co/t/question-about-best-practices-should-i-create-a-separate-index-when-objects-can-within-a-document-be-in-the-thousands/133527 "2018-05-28T11:32:33Z")

</div>

I am working with a combination of Neo4J and ES in a recommendation engine, I have an algorithm that generates a score between user and product, in Neo4J. I also want to add 3 similar product objects , similar1, similar2…

---

## [Automate bulk index](https://discuss.elastic.co/t/automate-bulk-index/133565)

<div class="topic-metadata">

**Author:** [@delly.set](https://discuss.elastic.co/u/delly.set)\
**Replies:** 0\
**Last updated:** [May 28, 2018, 3:22pm UTC](https://discuss.elastic.co/t/automate-bulk-index/133565 "2018-05-28T15:22:22Z")

</div>

hi possible to run 'bulk index' API using CURL via windows task scheduler? I want to do bulk index every hourly. but how to secure my the username and password (--user uname:pwd) in the curl command ? my Elasticsearch …

---

## [Elasticsearch red status after restart](https://discuss.elastic.co/t/elasticsearch-red-status-after-restart/133505)

<div class="topic-metadata">

**Author:** [@wassel\_benbettaieb](https://discuss.elastic.co/u/wassel_benbettaieb)\
**Replies:** 1\
**Last updated:** [May 28, 2018, 3:16pm UTC](https://discuss.elastic.co/t/elasticsearch-red-status-after-restart/133505 "2018-05-28T15:16:36Z")

</div>

Hello , After restarting my elasticsearch , i can't recover any things and the status is red . is there anyone who can help me with this ? \[el\]

---

## [How to get the max timestamp of an elastic search index?](https://discuss.elastic.co/t/how-to-get-the-max-timestamp-of-an-elastic-search-index/133513)

<div class="topic-metadata">

**Author:** [@ranganath\_nangineni](https://discuss.elastic.co/u/ranganath_nangineni)\
**Replies:** 3\
**Last updated:** [May 28, 2018, 2:16pm UTC](https://discuss.elastic.co/t/how-to-get-the-max-timestamp-of-an-elastic-search-index/133513 "2018-05-28T14:16:25Z")

</div>

Hi, I have this requirement to verify the gap between logstash and elasticsearch processing . For this , I need to get the max timestamp of the recent index entry. Any input from the community regrading this ?

---

## [Filter percolators by attributes](https://discuss.elastic.co/t/filter-percolators-by-attributes/133550)

<div class="topic-metadata">

**Author:** [@Inventorix](https://discuss.elastic.co/u/Inventorix)\
**Replies:** 0\
**Last updated:** [May 28, 2018, 1:26pm UTC](https://discuss.elastic.co/t/filter-percolators-by-attributes/133550 "2018-05-28T13:26:53Z")

</div>

Hello together, I would like to filter my percolators by attributes like category . Example I tried: POST /test/test { "query" : { "match" : { "message" : "buy" } }, "category": "Sales" } GET /test/test/\_sear…

---

## [Convert the long datatype field to string](https://discuss.elastic.co/t/convert-the-long-datatype-field-to-string/131692)

<div class="topic-metadata">

**Author:** [@rajesnal](https://discuss.elastic.co/u/rajesnal)\
**Replies:** 4\
**Last updated:** [May 28, 2018, 1:25pm UTC](https://discuss.elastic.co/t/convert-the-long-datatype-field-to-string/131692 "2018-05-28T13:25:42Z")

</div>

I am looking for an example, to convert the data type of field in the document from long to string. could you anyone please help me on this.

---

## [Nodes maximum storage size](https://discuss.elastic.co/t/nodes-maximum-storage-size/133542)

<div class="topic-metadata">

**Author:** [@gourmax](https://discuss.elastic.co/u/gourmax)\
**Replies:** 1\
**Last updated:** [May 28, 2018, 1:06pm UTC](https://discuss.elastic.co/t/nodes-maximum-storage-size/133542 "2018-05-28T13:06:28Z")

</div>

Is there any way to configure a maximum storage size to attribute to each nodes of my cluster ? I have three nodes server some index with 3 shards other with 2 shards. I would like to attribute a maximum storage size i…

---

## [Coordinator node and logstash](https://discuss.elastic.co/t/coordinator-node-and-logstash/133540)

<div class="topic-metadata">

**Author:** [@mkemalm](https://discuss.elastic.co/u/mkemalm)\
**Replies:** 0\
**Last updated:** [May 28, 2018, 12:48pm UTC](https://discuss.elastic.co/t/coordinator-node-and-logstash/133540 "2018-05-28T12:48:12Z")

</div>

Hello, the common usage of coordinator node is with kibana, is it a good way to use it with logstash? I mean assigning only coordinator node in logstash confs in a multi-node setup.

---

## [Unknown tokenizer type \[kuromoji\_tokenizer\]](https://discuss.elastic.co/t/unknown-tokenizer-type-kuromoji-tokenizer/133523)

<div class="topic-metadata">

**Author:** [@qihu](https://discuss.elastic.co/u/qihu)\
**Replies:** 1\
**Last updated:** [May 28, 2018, 11:50am UTC](https://discuss.elastic.co/t/unknown-tokenizer-type-kuromoji-tokenizer/133523 "2018-05-28T11:50:43Z")

</div>

I just followed the toturial of kuromoji plugin, and tried to use the demo to check if it works. However, when I was trying to create an index using kuromoji\_tokenizer, it cannot be found. (I have restart Elasticsearch a…

---

## [Cluster\_block\_exception](https://discuss.elastic.co/t/cluster-block-exception/133525)

<div class="topic-metadata">

**Author:** [@Aviyoosh](https://discuss.elastic.co/u/Aviyoosh)\
**Replies:** 2\
**Last updated:** [May 28, 2018, 11:41am UTC](https://discuss.elastic.co/t/cluster-block-exception/133525 "2018-05-28T11:41:29Z")

</div>

Hi, When trying to add documents to index : put my\_index\_name/doc/5 i get this error: { "error": { "root\_cause": \[ { "type": "cluster\_block\_exception", "reason": "blocked by: \[FORBIDDEN/12/index read-only / allo…

---

## [Elasticsearch.Net Library for .NET Core with Docker linux container not working](https://discuss.elastic.co/t/elasticsearch-net-library-for-net-core-with-docker-linux-container-not-working/131070)

<div class="topic-metadata">

**Author:** [@Bikash\_Behuria](https://discuss.elastic.co/u/Bikash_Behuria)\
**Replies:** 6\
**Last updated:** [May 28, 2018, 10:57am UTC](https://discuss.elastic.co/t/elasticsearch-net-library-for-net-core-with-docker-linux-container-not-working/131070 "2018-05-28T10:57:21Z")

</div>

Hi , I am not sure if anyone reported the following issue. When using ASP.NET Core with Linux Docker container , \_bulk api is not working however same works fine if we run same code using Visual Studio. Below are my …

---

## [Grokparsefailure in logstash](https://discuss.elastic.co/t/grokparsefailure-in-logstash/132558)

<div class="topic-metadata">

**Author:** [@aarthinim](https://discuss.elastic.co/u/aarthinim)\
**Replies:** 2\
**Last updated:** [May 28, 2018, 10:45am UTC](https://discuss.elastic.co/t/grokparsefailure-in-logstash/132558 "2018-05-28T10:45:07Z")

</div>

In filebeat my file format is "2018-05-19 11:00:11,044 (default task-551) 329.0 user1 ip1 twKtby8RnvKWV4hq5nyJ4Dru4Ah1XuZLi9dR9\_0S.lrpv2-testing VPL-tbl-btnTblExportinput " In logstash My logstash.conf file is { beats…

---

## [Hithighlighting boolean query including exact phrase words](https://discuss.elastic.co/t/hithighlighting-boolean-query-including-exact-phrase-words/133518)

<div class="topic-metadata">

**Author:** [@Hardik.hbs](https://discuss.elastic.co/u/Hardik.hbs)\
**Replies:** 0\
**Last updated:** [May 28, 2018, 10:36am UTC](https://discuss.elastic.co/t/hithighlighting-boolean-query-including-exact-phrase-words/133518 "2018-05-28T10:36:37Z")

</div>

Hi, We are using ElasticSearch with version 2.4. When we do search in a field for query as below in a field, it is not highlighting the complete phrase word. (Google OR Bing) AND "SQL Developer" The above query gives…

---

## [Incompatible Lucene versions between neo4j and ElasticSearch](https://discuss.elastic.co/t/incompatible-lucene-versions-between-neo4j-and-elasticsearch/131249)

<div class="topic-metadata">

**Author:** [@Aishwarya\_S](https://discuss.elastic.co/u/Aishwarya_S)\
**Replies:** 5\
**Last updated:** [May 28, 2018, 10:33am UTC](https://discuss.elastic.co/t/incompatible-lucene-versions-between-neo4j-and-elasticsearch/131249 "2018-05-28T10:33:53Z")

</div>

Hi. We are facing issues while upgrading Neo4j from 3.1 to 3.3 due to incompatible Lucene versions used by Neo4j and ElasticSearch. We are using Rest based client provided by ES to query data. Please find the maven dep…

---

## [How to make old data effect when change mapping filed?](https://discuss.elastic.co/t/how-to-make-old-data-effect-when-change-mapping-filed/133460)

<div class="topic-metadata">

**Author:** [@xuanyetouci](https://discuss.elastic.co/u/xuanyetouci)\
**Replies:** 1\
**Last updated:** [May 28, 2018, 10:24am UTC](https://discuss.elastic.co/t/how-to-make-old-data-effect-when-change-mapping-filed/133460 "2018-05-28T10:24:22Z")

</div>

suppose old mapping like this: "resources": { "type": "object", "enabled": false } then es has some data if I change mapping like this: "resources": { "type": "object", "properties": { "st…

---

## [Painless scripting - Using match\_phrase along with must\_not.exists](https://discuss.elastic.co/t/painless-scripting-using-match-phrase-along-with-must-not-exists/133498)

<div class="topic-metadata">

**Author:** [@Suhas\_K](https://discuss.elastic.co/u/Suhas_K)\
**Replies:** 2\
**Last updated:** [May 28, 2018, 10:05am UTC](https://discuss.elastic.co/t/painless-scripting-using-match-phrase-along-with-must-not-exists/133498 "2018-05-28T10:05:37Z")

</div>

Hi, I am currently using painless scripting to parse through a message field, extract the required information and create a new field consisting of only that information. The issue I'm facing is that if the query is hit…

---

## [Getting item of a a given index from an array inside an indexed document](https://discuss.elastic.co/t/getting-item-of-a-a-given-index-from-an-array-inside-an-indexed-document/133494)

<div class="topic-metadata">

**Author:** [@cboptakn](https://discuss.elastic.co/u/cboptakn)\
**Replies:** 3\
**Last updated:** [May 28, 2018, 10:01am UTC](https://discuss.elastic.co/t/getting-item-of-a-a-given-index-from-an-array-inside-an-indexed-document/133494 "2018-05-28T10:01:57Z")

</div>

For an indexed JSON document with a key representing a JSON document X, I need to get a given element of the array given the index. So, for example this is the document: { "myKey" : \["A", "B", "C"\] } I need to get t…

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1673)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1675)
