# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1446

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1447

---

## [Painless script unable to recognize special chars in String](https://discuss.elastic.co/t/painless-script-unable-to-recognize-special-chars-in-string/160820)

<div class="topic-metadata">

**Author:** [@vchang](https://discuss.elastic.co/u/vchang)\
**Replies:** 1\
**Last updated:** [December 20, 2018, 8:45pm UTC](https://discuss.elastic.co/t/painless-script-unable-to-recognize-special-chars-in-string/160820 "2018-12-20T20:45:40Z")

</div>

Hi Everyone, PLEASE HELP!! Kibana 5.4 My team and I are trying to do a simple task: Given a string, extract a specific part of a URL. For example if my string is "GET path="/social/holiday-gift-guide/..." we want to…

---

## [Not able to sort date](https://discuss.elastic.co/t/not-able-to-sort-date/161444)

<div class="topic-metadata">

**Author:** [@PK1210](https://discuss.elastic.co/u/PK1210)\
**Replies:** 3\
**Last updated:** [December 20, 2018, 8:18pm UTC](https://discuss.elastic.co/t/not-able-to-sort-date/161444 "2018-12-20T20:18:31Z")

</div>

https://www.elastic.co/guide/en/elasticsearch/reference/current/date.html I have been trying to sort my posts on basis of createDate but it does not seem to be working Index - "createDate":{ "type":"date", "format":…

---

## [Executing Windows Script within Watch](https://discuss.elastic.co/t/executing-windows-script-within-watch/161149)

<div class="topic-metadata">

**Author:** [@johncam](https://discuss.elastic.co/u/johncam)\
**Replies:** 1\
**Last updated:** [December 20, 2018, 8:09pm UTC](https://discuss.elastic.co/t/executing-windows-script-within-watch/161149 "2018-12-20T20:09:23Z")

</div>

I have a .vbs script that I should like to incorporate as part of a watch, with the alert triggered when the errorlevel exceeds a defined threshold. Is it possible to execute script files in this fashion, or should I be…

---

## [Checking for missing date fields in painless script](https://discuss.elastic.co/t/checking-for-missing-date-fields-in-painless-script/161743)

<div class="topic-metadata">

**Author:** [@vicpav](https://discuss.elastic.co/u/vicpav)\
**Replies:** 2\
**Last updated:** [December 20, 2018, 7:37pm UTC](https://discuss.elastic.co/t/checking-for-missing-date-fields-in-painless-script/161743 "2018-12-20T19:37:00Z")

</div>

Elasticsearch 6.4.3 I have an index file synced from PostgreSQL with the original timestamp created\_at configured as date type. At some later moment, a new timestamp event\_timestamp (also date type) has been introduces …

---

## [Difference between various pagination APIs](https://discuss.elastic.co/t/difference-between-various-pagination-apis/161349)

<div class="topic-metadata">

**Author:** [@mrunmayi](https://discuss.elastic.co/u/mrunmayi)\
**Replies:** 1\
**Last updated:** [December 20, 2018, 5:37pm UTC](https://discuss.elastic.co/t/difference-between-various-pagination-apis/161349 "2018-12-20T17:37:44Z")

</div>

Hi, I was evaluating the performance of various pagination options. The ones that were considered were: Scroll API Search After API from,size fields I carried out the test for a set of 1000 documents. And analyzed th…

---

## [Issue(Data might be incomplete because your request timed out)](https://discuss.elastic.co/t/issue-data-might-be-incomplete-because-your-request-timed-out/161274)

<div class="topic-metadata">

**Author:** [@yang-l](https://discuss.elastic.co/u/yang-l)\
**Replies:** 5\
**Last updated:** [December 20, 2018, 3:56pm UTC](https://discuss.elastic.co/t/issue-data-might-be-incomplete-because-your-request-timed-out/161274 "2018-12-20T15:56:11Z")

</div>

I migrated data to elastic-cloud recently, but Kibana can not complete my request. It always says "Data might be incomplete because your request timed out" when I set time range over 24hours. I checked the request statis…

---

## [ES 5.2 log files not being written](https://discuss.elastic.co/t/es-5-2-log-files-not-being-written/161585)

<div class="topic-metadata">

**Author:** [@kwstx14](https://discuss.elastic.co/u/kwstx14)\
**Replies:** 2\
**Last updated:** [December 20, 2018, 3:40pm UTC](https://discuss.elastic.co/t/es-5-2-log-files-not-being-written/161585 "2018-12-20T15:40:45Z")

</div>

Logging is not working for us on Elasticsearch 5.2.0, and I can't find any documentation on the web that addresses the issue. Salient points: log4j2.properties makes use of a couple of "exposed" variables that weren't …

---

## [Export Index and structure](https://discuss.elastic.co/t/export-index-and-structure/161700)

<div class="topic-metadata">

**Author:** [@Tom28](https://discuss.elastic.co/u/Tom28)\
**Replies:** 3\
**Last updated:** [December 20, 2018, 3:28pm UTC](https://discuss.elastic.co/t/export-index-and-structure/161700 "2018-12-20T15:28:15Z")

</div>

Hi I have currently a very old installation of Elasticsearch on a node with 3 indexes and maybe about 1000 documents. I have now installed a the newest version and would import all of the current environment to the new…

---

## [Sort Alphabetically Ignoring Numbers & Special Characters](https://discuss.elastic.co/t/sort-alphabetically-ignoring-numbers-special-characters/161712)

<div class="topic-metadata">

**Author:** [@shoutadnan](https://discuss.elastic.co/u/shoutadnan)\
**Replies:** 1\
**Last updated:** [December 20, 2018, 3:23pm UTC](https://discuss.elastic.co/t/sort-alphabetically-ignoring-numbers-special-characters/161712 "2018-12-20T15:23:41Z")

</div>

How to sort a text field alphabetically, ignoring the special characters & numbers? By default, the special characters come first followed by numbers and alphabets. What I need is alphabets should be sorted and appear f…

---

## [Can I update a field (e.g. timestamp) whenever an update is not a noop?](https://discuss.elastic.co/t/can-i-update-a-field-e-g-timestamp-whenever-an-update-is-not-a-noop/161711)

<div class="topic-metadata">

**Author:** [@jdmcalee](https://discuss.elastic.co/u/jdmcalee)\
**Replies:** 0\
**Last updated:** [December 20, 2018, 2:51pm UTC](https://discuss.elastic.co/t/can-i-update-a-field-e-g-timestamp-whenever-an-update-is-not-a-noop/161711 "2018-12-20T14:51:26Z")

</div>

I have a set of data files that get uploaded by clients periodically. Each file is a complete collection of items, some of which may have changed since the last upload. However, the data does not include any kind of last…

---

## [Authentication against Active Directory (referral error)](https://discuss.elastic.co/t/authentication-against-active-directory-referral-error/161566)

<div class="topic-metadata">

**Author:** [@drkbg](https://discuss.elastic.co/u/drkbg)\
**Replies:** 2\
**Last updated:** [December 20, 2018, 2:17pm UTC](https://discuss.elastic.co/t/authentication-against-active-directory-referral-error/161566 "2018-12-20T14:17:26Z")

</div>

Hello, I am using following config to connect to Active Directory but I am getting refferal error. Any ideas what is wrong with my configuration? I am getting following error: Authentication to realm active\_directory …

---

## [Find out if started transaction successfully ended with painless script in elastic search](https://discuss.elastic.co/t/find-out-if-started-transaction-successfully-ended-with-painless-script-in-elastic-search/161693)

<div class="topic-metadata">

**Author:** [@Sanjeev7](https://discuss.elastic.co/u/Sanjeev7)\
**Replies:** 1\
**Last updated:** [December 20, 2018, 2:09pm UTC](https://discuss.elastic.co/t/find-out-if-started-transaction-successfully-ended-with-painless-script-in-elastic-search/161693 "2018-12-20T14:09:24Z")

</div>

i have below requirement not sure if its possible with painless please help me its very urgent requirement Please find below log response . in response json if we have txnname (published ) , txnNum and txnstatus . h…

---

## [Painless: check length field in each object of array](https://discuss.elastic.co/t/painless-check-length-field-in-each-object-of-array/161699)

<div class="topic-metadata">

**Author:** [@ErikvdVen](https://discuss.elastic.co/u/ErikvdVen)\
**Replies:** 1\
**Last updated:** [December 20, 2018, 1:09pm UTC](https://discuss.elastic.co/t/painless-check-length-field-in-each-object-of-array/161699 "2018-12-20T13:09:39Z")

</div>

I want to filter my search results by using a script filter, to make sure all documents with a specific phonenumber field length are not showed up in the results: "query": { "bool": { "filter": { …

---

## [Wildcard inside nested query and a value match](https://discuss.elastic.co/t/wildcard-inside-nested-query-and-a-value-match/161551)

<div class="topic-metadata">

**Author:** [@Nedko\_Georgiev](https://discuss.elastic.co/u/Nedko_Georgiev)\
**Replies:** 1\
**Last updated:** [December 20, 2018, 12:43pm UTC](https://discuss.elastic.co/t/wildcard-inside-nested-query-and-a-value-match/161551 "2018-12-20T12:43:06Z")

</div>

I'm trying to migrate from ES 0.90 to 6.5 and I have the following query: { "query": { "bool": { "should": \[ { "multi\_match": { "query": "field Value", "fields": "fi…

---

## [Elasticsearch aliases not visible in Kibana Dashboard-xpack by normal user](https://discuss.elastic.co/t/elasticsearch-aliases-not-visible-in-kibana-dashboard-xpack-by-normal-user/161179)

<div class="topic-metadata">

**Author:** [@praboosingh](https://discuss.elastic.co/u/praboosingh)\
**Replies:** 11\
**Last updated:** [December 20, 2018, 11:43am UTC](https://discuss.elastic.co/t/elasticsearch-aliases-not-visible-in-kibana-dashboard-xpack-by-normal-user/161179 "2018-12-20T11:43:58Z")

</div>

Dear Team, I have ELK version - 6.3.1 and installed xpack trial version to check rules and privileges for normal user and admin user. So I have created an user (user1) with only one indices aliases(event\_aliases01), wh…

---

## [Return documents that nested object count greather than zero](https://discuss.elastic.co/t/return-documents-that-nested-object-count-greather-than-zero/161660)

<div class="topic-metadata">

**Author:** [@irajchardoli](https://discuss.elastic.co/u/irajchardoli)\
**Replies:** 1\
**Last updated:** [December 20, 2018, 11:18am UTC](https://discuss.elastic.co/t/return-documents-that-nested-object-count-greather-than-zero/161660 "2018-12-20T11:18:40Z")

</div>

Hi , Please let me know ,how to return documents that nested object count is greater than zero. i want first filter nested object then return documents that have nested object number greather than zero. products:\[ { i…

---

## [6.4 xpack.security.audit.logfile.events.ignore\_filters.\*.realms broken?](https://discuss.elastic.co/t/6-4-xpack-security-audit-logfile-events-ignore-filters-realms-broken/159758)

<div class="topic-metadata">

**Author:** [@mmisztal1980](https://discuss.elastic.co/u/mmisztal1980)\
**Replies:** 8\
**Last updated:** [December 20, 2018, 11:10am UTC](https://discuss.elastic.co/t/6-4-xpack-security-audit-logfile-events-ignore-filters-realms-broken/159758 "2018-12-20T11:10:49Z")

</div>

In our cluster, we have added the following snippet to our elasticsearch.yaml across all nodes: xpack.security.audit.enabled: true xpack.security.audit.outputs: \[ index \] xpack.security.audit.index.events.emit\_request\_b…

---

## [404 - missing repository error when trying to restore snapshot](https://discuss.elastic.co/t/404-missing-repository-error-when-trying-to-restore-snapshot/161474)

<div class="topic-metadata">

**Author:** [@Eva](https://discuss.elastic.co/u/Eva)\
**Replies:** 11\
**Last updated:** [December 20, 2018, 10:40am UTC](https://discuss.elastic.co/t/404-missing-repository-error-when-trying-to-restore-snapshot/161474 "2018-12-20T10:40:38Z")

</div>

Hello there I have an ES cluster with 2 nodes and i'm now switching to AWS ES domain and trying to migrate existing ELK logs to new AWS domain. I have registered a repo and also taken a snapshot of existing ES cluster b…

---

## [Indexing documents](https://discuss.elastic.co/t/indexing-documents/161655)

<div class="topic-metadata">

**Author:** [@Apul\_Kudale](https://discuss.elastic.co/u/Apul_Kudale)\
**Replies:** 1\
**Last updated:** [December 20, 2018, 10:38am UTC](https://discuss.elastic.co/t/indexing-documents/161655 "2018-12-20T10:38:16Z")

</div>

i have created elasticsearch service on amazon s3 and have server on ec2 So want to create indexing on elasticsearch service using php from my ec2 server. its just working fine on curl bt not on php i did sethosts e…

---

## [Recovery is not mentioned in "\_cat/recovery"](https://discuss.elastic.co/t/recovery-is-not-mentioned-in-cat-recovery/161633)

<div class="topic-metadata">

**Author:** [@Yehonatan](https://discuss.elastic.co/u/Yehonatan)\
**Replies:** 0\
**Last updated:** [December 20, 2018, 7:09am UTC](https://discuss.elastic.co/t/recovery-is-not-mentioned-in-cat-recovery/161633 "2018-12-20T07:09:14Z")

</div>

Hello, Yesterday I had to restart my server. After loading I checked that elastic-search is running and found that 4 of are "INITIALIZING" stat. My configuration is built with: Elastic search version 2.3 5 shards hos…

---

## [Elasticsearch: Handling fuzziness](https://discuss.elastic.co/t/elasticsearch-handling-fuzziness/161653)

<div class="topic-metadata">

**Author:** [@rahulnama](https://discuss.elastic.co/u/rahulnama)\
**Replies:** 0\
**Last updated:** [December 20, 2018, 10:01am UTC](https://discuss.elastic.co/t/elasticsearch-handling-fuzziness/161653 "2018-12-20T10:01:33Z")

</div>

Hi Team I've indexed few pdf files and using custom analyzer to removes stop words and to lowercase the letters. Query: GET testindex/\_search { "explain": true, "\_source" : "url", "query": { "match…

---

## [Dev Tools search with a "/" works, but in a query doesn't - How to fix](https://discuss.elastic.co/t/dev-tools-search-with-a-works-but-in-a-query-doesnt-how-to-fix/161652)

<div class="topic-metadata">

**Author:** [@nlh](https://discuss.elastic.co/u/nlh)\
**Replies:** 0\
**Last updated:** [December 20, 2018, 9:51am UTC](https://discuss.elastic.co/t/dev-tools-search-with-a-works-but-in-a-query-doesnt-how-to-fix/161652 "2018-12-20T09:51:14Z")

</div>

Hi Raised this on Kibana and realised makes more sense here. Running Elastic 6.2.2. Relatively new to Kibana and queries. I have a string in process.cwd along the lines of /PTC/merge/code/CodeDrop\_2017\_12\_18/AST-expan…

---

## [Elasticsearch - backup a cluster](https://discuss.elastic.co/t/elasticsearch-backup-a-cluster/161561)

<div class="topic-metadata">

**Author:** [@genseb](https://discuss.elastic.co/u/genseb)\
**Replies:** 2\
**Last updated:** [December 20, 2018, 9:45am UTC](https://discuss.elastic.co/t/elasticsearch-backup-a-cluster/161561 "2018-12-20T09:45:50Z")

</div>

Hi, I have a 5 nodes cluster, behind a load balancer, that I want to backup. I have 2 questions: -Do I have to run my backup command (curl -XPUT "http://localhost:9200/\_snapshot/s3\_repository/snap1?wait\_for\_completio…

---

## [Fields are not visible in machine learning job](https://discuss.elastic.co/t/fields-are-not-visible-in-machine-learning-job/161079)

<div class="topic-metadata">

**Author:** [@Sripal](https://discuss.elastic.co/u/Sripal)\
**Replies:** 13\
**Last updated:** [December 20, 2018, 8:57am UTC](https://discuss.elastic.co/t/fields-are-not-visible-in-machine-learning-job/161079 "2018-12-20T08:57:02Z")

</div>

Hi All, I am new to Machine learning jobs in kibana. I've tried to create a single metric job using my data available in elasticsearch. But my field are not visible in filters Aggregation. Except for the aggregatio…

---

## [How to display role names only](https://discuss.elastic.co/t/how-to-display-role-names-only/161361)

<div class="topic-metadata">

**Author:** [@prabhakar\_talari](https://discuss.elastic.co/u/prabhakar_talari)\
**Replies:** 2\
**Last updated:** [December 20, 2018, 8:33am UTC](https://discuss.elastic.co/t/how-to-display-role-names-only/161361 "2018-12-20T08:33:48Z")

</div>

Hi All, Could any one suggest me best command to get list of roles, i am using command (GET \_xpack/security/role) but it is giving the result in JSON format, but i would like to display only role names thanks in advanc…

---

## [ClusterBlockException SERVICE\_UNAVAILABLE/1/state not recovered](https://discuss.elastic.co/t/clusterblockexception-service-unavailable-1-state-not-recovered/161521)

<div class="topic-metadata">

**Author:** [@Bukhtawar\_Khan](https://discuss.elastic.co/u/Bukhtawar_Khan)\
**Replies:** 16\
**Last updated:** [December 20, 2018, 7:59am UTC](https://discuss.elastic.co/t/clusterblockexception-service-unavailable-1-state-not-recovered/161521 "2018-12-20T07:59:11Z")

</div>

\[2018-12-19T05:10:26,684\]\[DEBUG\]\[o.e.a.a.i.c.TransportCreateIndexAction\] \[epcvLK5\] #\[org.elasticsearch.cluster.block.ClusterBlockException\]#timed out while retrying \[indices:admin/create\] after failure (timeout \[30s\]) …

---

## [Index size in bytes is not updated even after \_refresh and \_flush/synced](https://discuss.elastic.co/t/index-size-in-bytes-is-not-updated-even-after-refresh-and-flush-synced/161634)

<div class="topic-metadata">

**Author:** [@bsarkar](https://discuss.elastic.co/u/bsarkar)\
**Replies:** 0\
**Last updated:** [December 20, 2018, 7:33am UTC](https://discuss.elastic.co/t/index-size-in-bytes-is-not-updated-even-after-refresh-and-flush-synced/161634 "2018-12-20T07:33:26Z")

</div>

We have some tests which query the index size from Elasticsearch and perform some validations on it. This validation is flaky - it does not pass always. Below is the reproduction: Execute all commands below in one go: …

---

## [Deleting documents using terms query](https://discuss.elastic.co/t/deleting-documents-using-terms-query/161319)

<div class="topic-metadata">

**Author:** [@prasad.ram1431](https://discuss.elastic.co/u/prasad.ram1431)\
**Replies:** 2\
**Last updated:** [December 20, 2018, 6:22am UTC](https://discuss.elastic.co/t/deleting-documents-using-terms-query/161319 "2018-12-20T06:22:18Z")

</div>

Hi All, I have scenario explained below, We need to delete multiple documents from Elasticsearch based on a given field which contains unique values. So, in this I wanted to use terms query where we can provide multipl…

---

## [Help! deleted .kibana index](https://discuss.elastic.co/t/help-deleted-kibana-index/161608)

<div class="topic-metadata">

**Author:** [@Malachi](https://discuss.elastic.co/u/Malachi)\
**Replies:** 3\
**Last updated:** [December 20, 2018, 1:36am UTC](https://discuss.elastic.co/t/help-deleted-kibana-index/161608 "2018-12-20T01:36:59Z")

</div>

After upgrading to 6.5.3 Kibana would not start with message "Kibana is not yet ready", optimizing wasn't finishing and eventually kibana was eating up all resources and crashing. In the course of troubleshooting, I del…

---

## [Write exceptions are flooding the logs](https://discuss.elastic.co/t/write-exceptions-are-flooding-the-logs/161601)

<div class="topic-metadata">

**Author:** [@amitavmohanty01](https://discuss.elastic.co/u/amitavmohanty01)\
**Replies:** 0\
**Last updated:** [December 19, 2018, 11:01pm UTC](https://discuss.elastic.co/t/write-exceptions-are-flooding-the-logs/161601 "2018-12-19T23:01:41Z")

</div>

I am getting a flood of the following messages. at org.elasticsearch.common.io.stream.StreamOutput.writeException(StreamOutput.java:942) ~\[elasticsearch-6.4.2.jar:6.4.2\] at org.elasticsearch.common.io.stream.StreamOutp…

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1445)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1447)
