# Elasticsearch **URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1150 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1151 --- ## [Import only arrays that match conditions in Elastic Search](https://discuss.elastic.co/t/import-only-arrays-that-match-conditions-in-elastic-search/199899)
**Author:** [@111211](https://discuss.elastic.co/u/111211)\ **Replies:** 2\ **Last updated:** [September 20, 2019, 1:24am UTC](https://discuss.elastic.co/t/import-only-arrays-that-match-conditions-in-elastic-search/199899 "2019-09-20T01:24:07Z")
I'm dealing with nested nested data in ElasticSearch. I want it to work like a SELECT \* from where in an RDBMS. If you have the following data POST test-stack/test/1234\_5678 { "Id" : 1234, "availables":\[ { … --- ## [How to update elasticsearch.yml if I am using Elastic cloud?](https://discuss.elastic.co/t/how-to-update-elasticsearch-yml-if-i-am-using-elastic-cloud/200291)
**Author:** [@EZprogramming](https://discuss.elastic.co/u/EZprogramming)\ **Replies:** 4\ **Last updated:** [September 20, 2019, 12:40am UTC](https://discuss.elastic.co/t/how-to-update-elasticsearch-yml-if-i-am-using-elastic-cloud/200291 "2019-09-20T00:40:58Z")
I am trying to set up Slack notification using the following reference: https://www.elastic.co/guide/en/elastic-stack-overview/current/actions-slack.html However, in order to send those notifications, I need to set up … --- ## [Pass percentile aggregation bucket values as params to a function\_score/script\_score filter](https://discuss.elastic.co/t/pass-percentile-aggregation-bucket-values-as-params-to-a-function-score-script-score-filter/200290)
**Author:** [@Julian\_Gore](https://discuss.elastic.co/u/Julian_Gore)\ **Replies:** 0\ **Last updated:** [September 19, 2019, 6:34pm UTC](https://discuss.elastic.co/t/pass-percentile-aggregation-bucket-values-as-params-to-a-function-score-script-score-filter/200290 "2019-09-19T18:34:19Z")
Hey, am looking for a way to pass values from a percentile aggregation to a function\_score filter as a param in the script\_score field, is this possible? Something like this: aggs: { query\_percentiles: { percentil… --- ## [Term query not working](https://discuss.elastic.co/t/term-query-not-working/200277)
**Author:** [@Ramesh\_Kanakarajan](https://discuss.elastic.co/u/Ramesh_Kanakarajan)\ **Replies:** 0\ **Last updated:** [September 19, 2019, 5:12pm UTC](https://discuss.elastic.co/t/term-query-not-working/200277 "2019-09-19T17:12:40Z")
I am trying to get data through term query, but it not returning any data. I searched in Google...came to know, need to append "keyword" in search variable when we have "text" and "keyword" defined for a field in mappi… --- ## [Limited indexing rate from one host](https://discuss.elastic.co/t/limited-indexing-rate-from-one-host/199151)
**Author:** [@Dmitry1](https://discuss.elastic.co/u/Dmitry1)\ **Replies:** 4\ **Last updated:** [September 19, 2019, 5:12pm UTC](https://discuss.elastic.co/t/limited-indexing-rate-from-one-host/199151 "2019-09-19T17:12:07Z")
Hello, i see strange ES behavior on my test cluster. Cluster has one node and has only one index for logs that have 10 primary shards no replicas. Some tuning of this index: "index.refresh\_interval": "30s", "index.tran… --- ## [Fscrawler Exception in thread "main" com.fasterxml.jackson.databind.JsonMappingException: Unrecognized character escape 'U'](https://discuss.elastic.co/t/fscrawler-exception-in-thread-main-com-fasterxml-jackson-databind-jsonmappingexception-unrecognized-character-escape-u/199868)
**Author:** [@vstevenson](https://discuss.elastic.co/u/vstevenson)\ **Replies:** 2\ **Last updated:** [September 19, 2019, 5:09pm UTC](https://discuss.elastic.co/t/fscrawler-exception-in-thread-main-com-fasterxml-jackson-databind-jsonmappingexception-unrecognized-character-escape-u/199868 "2019-09-19T17:09:01Z")
Hi, I'm trying to use fscrawler to index pdf files. When I try to run it, I get the following error message: C:\\Users\\vincent.stevenson\\Desktop\\fscrawler-2.5\\fscrawler-2.5\>bin\\fscrawler --config\_dir .\\config books Exce… --- ## [Elastic Node failure observations](https://discuss.elastic.co/t/elastic-node-failure-observations/199874)
**Author:** [@Parvez](https://discuss.elastic.co/u/Parvez)\ **Replies:** 10\ **Last updated:** [September 19, 2019, 4:19pm UTC](https://discuss.elastic.co/t/elastic-node-failure-observations/199874 "2019-09-19T16:19:42Z")
We recently conducted a Node failure test in our test environment. we have , Nodes: 3 Indices: 14 Total Shards: 94 Unassigned Shards:0 Questions: When one of the node which is a master node was brought down we st… --- ## [Query that finds duplicate log lines and their respective count](https://discuss.elastic.co/t/query-that-finds-duplicate-log-lines-and-their-respective-count/199937)
**Author:** [@AndriesN](https://discuss.elastic.co/u/AndriesN)\ **Replies:** 3\ **Last updated:** [September 19, 2019, 3:21pm UTC](https://discuss.elastic.co/t/query-that-finds-duplicate-log-lines-and-their-respective-count/199937 "2019-09-19T15:21:25Z")
Hi all, I am doing a school project where I am using your product for a log management system. I have lots of data and I want to know which log lines are duplicate and how many duplicates there are for that particular … --- ## [Group by time interval](https://discuss.elastic.co/t/group-by-time-interval/200246)
**Author:** [@Akhil\_M\_S](https://discuss.elastic.co/u/Akhil_M_S)\ **Replies:** 0\ **Last updated:** [September 19, 2019, 3:05pm UTC](https://discuss.elastic.co/t/group-by-time-interval/200246 "2019-09-19T15:05:43Z")
I have a one hour data in my index.I want to get group the data by its time field ('logged\_time\_unix').here is my query \[aggs\] =\> Array ( \[viewTimeBy\] =\> Array ( \[terms\] =\> Array ( \[field\] =\> logged\_time\_unix \[si… --- ## [Failed to create alias: \](https://discuss.elastic.co/t/failed-to-create-alias-doctype-html-public-ietf-dtd-html-2-0-en/200226)
**Author:** [@jaiganesh06](https://discuss.elastic.co/u/jaiganesh06)\ **Replies:** 0\ **Last updated:** [September 19, 2019, 2:18pm UTC](https://discuss.elastic.co/t/failed-to-create-alias-doctype-html-public-ietf-dtd-html-2-0-en/200226 "2019-09-19T14:18:23Z")
Hi All, Version - 7.3.x I have ES behind Apache 2.4 reverse proxy. At first instance, when no index is created in ES, I am getting below error from filebeat 2019-09-19T19:35:53.281+0530 ERROR pipeline/output.go:100 Fa… --- ## [Physical Cores vs Logical Cores for ES nodes capacity planning](https://discuss.elastic.co/t/physical-cores-vs-logical-cores-for-es-nodes-capacity-planning/200211)
**Author:** [@ParashB](https://discuss.elastic.co/u/ParashB)\ **Replies:** 0\ **Last updated:** [September 19, 2019, 1:46pm UTC](https://discuss.elastic.co/t/physical-cores-vs-logical-cores-for-es-nodes-capacity-planning/200211 "2019-09-19T13:46:33Z")
I have a hyper threaded environment wherein each physical core is equivalent to 2 Logical cores. Should I consider physical cores or logical cores for my elastic search nodes capacity planning? --- ## [Minor problem with documentation for es debian installation](https://discuss.elastic.co/t/minor-problem-with-documentation-for-es-debian-installation/200172)
**Author:** [@jillesvangurp](https://discuss.elastic.co/u/jillesvangurp)\ **Replies:** 4\ **Last updated:** [September 19, 2019, 1:45pm UTC](https://discuss.elastic.co/t/minor-problem-with-documentation-for-es-debian-installation/200172 "2019-09-19T13:45:20Z")
The documentation for installing the debian package suggests running: echo "deb https://artifacts.elastic.co/packages/7.x/apt stable main" | sudo tee -a /etc/apt/sources.list.d/elastic-7.x.list We added this to our che… --- ## [Query with regular expression special characters](https://discuss.elastic.co/t/query-with-regular-expression-special-characters/200195)
**Author:** [@evalufran](https://discuss.elastic.co/u/evalufran)\ **Replies:** 2\ **Last updated:** [September 19, 2019, 1:40pm UTC](https://discuss.elastic.co/t/query-with-regular-expression-special-characters/200195 "2019-09-19T13:40:19Z")
HI everyone! I have a lot of fields with XML text and i want to make a query to check if some tags are closed. In order to do that i'm using the whitespace analyzer (so that i can query for char like "\<"). Assuming th… --- ## [Query range lte return all data](https://discuss.elastic.co/t/query-range-lte-return-all-data/198282)
**Author:** [@Jeremy\_Guyenot](https://discuss.elastic.co/u/Jeremy_Guyenot)\ **Replies:** 3\ **Last updated:** [September 19, 2019, 1:38pm UTC](https://discuss.elastic.co/t/query-range-lte-return-all-data/198282 "2019-09-19T13:38:24Z")
Hi everybody, I encountered a problem with a "range" request with the "lte" operator alone. With only "lte" in the query, this returns all the data. With "gte" or "gte" / "lte", the result is the one expected. We decl… --- ## [Documents distributions across shards](https://discuss.elastic.co/t/documents-distributions-across-shards/200137)
**Author:** [@pathri](https://discuss.elastic.co/u/pathri)\ **Replies:** 1\ **Last updated:** [September 19, 2019, 1:36pm UTC](https://discuss.elastic.co/t/documents-distributions-across-shards/200137 "2019-09-19T13:36:24Z")
say there are 99 documents and we have 3 shards for an index. is it sure that all the 3 shards are going to have 33 documents each? thanks in advance? --- ## [Verification exception querying on multiple index](https://discuss.elastic.co/t/verification-exception-querying-on-multiple-index/200121)
**Author:** [@Nithish\_Thirmul](https://discuss.elastic.co/u/Nithish_Thirmul)\ **Replies:** 0\ **Last updated:** [September 19, 2019, 6:17am UTC](https://discuss.elastic.co/t/verification-exception-querying-on-multiple-index/200121 "2019-09-19T06:17:50Z")
Hi All, When i try to query on multiple indexes it throws me a Verification Exception. The single index works fine for me. Any idea on how to query over multiple indexes in sql query. Working one : POST \_xpack/sql?fo… --- ## [I am using aws es in that es version is 7.1 but some tools are not there in kibana 7.1 version compared to kibana 7.3.2 version.How can i resolve this](https://discuss.elastic.co/t/i-am-using-aws-es-in-that-es-version-is-7-1-but-some-tools-are-not-there-in-kibana-7-1-version-compared-to-kibana-7-3-2-version-how-can-i-resolve-this/200202)
**Author:** [@naveena.lm](https://discuss.elastic.co/u/naveena.lm)\ **Replies:** 3\ **Last updated:** [September 19, 2019, 1:29pm UTC](https://discuss.elastic.co/t/i-am-using-aws-es-in-that-es-version-is-7-1-but-some-tools-are-not-there-in-kibana-7-1-version-compared-to-kibana-7-3-2-version-how-can-i-resolve-this/200202 "2019-09-19T13:29:19Z")
i launched kibana 7.1 but some settings are not visible like how can i add tools to kibana 7.1. version --- ## [Problem with installing Plugin - no Java detected](https://discuss.elastic.co/t/problem-with-installing-plugin-no-java-detected/200209)
**Author:** [@Daniel\_Keska](https://discuss.elastic.co/u/Daniel_Keska)\ **Replies:** 0\ **Last updated:** [September 19, 2019, 1:28pm UTC](https://discuss.elastic.co/t/problem-with-installing-plugin-no-java-detected/200209 "2019-09-19T13:28:40Z")
When I try install plugin on Ubuntu on Windows 10 ( with the command: sudo bin/elasticsearch-plugin install analysis-stempel) i get the error: could not find java in JAVA\_HOME or bundled at /mnt/c/Users/DXXXX/elasticsear… --- ## [Elasticsearch range filter not returning expected data](https://discuss.elastic.co/t/elasticsearch-range-filter-not-returning-expected-data/200190)
**Author:** [@Maneesh](https://discuss.elastic.co/u/Maneesh)\ **Replies:** 1\ **Last updated:** [September 19, 2019, 1:01pm UTC](https://discuss.elastic.co/t/elasticsearch-range-filter-not-returning-expected-data/200190 "2019-09-19T13:01:55Z")
I have a range data as shown below for each of the products: "regionRanges": \[ {"lowerLimit": "1000", "upperLimit": "1019"}, {"lowerLimit": "1000","upperLimit": "1099"}, {"lowerLimit": "3000","upperLimit": "3099"} \] … --- ## [Filtering inside objects array](https://discuss.elastic.co/t/filtering-inside-objects-array/199809)
**Author:** [@Irakli](https://discuss.elastic.co/u/Irakli)\ **Replies:** 3\ **Last updated:** [September 19, 2019, 1:00pm UTC](https://discuss.elastic.co/t/filtering-inside-objects-array/199809 "2019-09-19T13:00:40Z")
Hi there, My issue is following: I have the following structure in elastic index, two document examples are here: { "customerID" : 2, "customerStatus" : "active", "customerName" : "customerName2", "customerAge" : … --- ## [Elasticsearch and inodes](https://discuss.elastic.co/t/elasticsearch-and-inodes/200160)
**Author:** [@granier](https://discuss.elastic.co/u/granier)\ **Replies:** 2\ **Last updated:** [September 19, 2019, 12:55pm UTC](https://discuss.elastic.co/t/elasticsearch-and-inodes/200160 "2019-09-19T12:55:40Z")
Hi, In configuration system https://www.elastic.co/guide/en/elasticsearch/reference/master/file-descriptors.html there is a point about the number of files that can be opened by Elasticsearch. But there is no item abou… --- ## [Proper way to store large fields in elasticsearch](https://discuss.elastic.co/t/proper-way-to-store-large-fields-in-elasticsearch/200194)
**Author:** [@elk11](https://discuss.elastic.co/u/elk11)\ **Replies:** 3\ **Last updated:** [September 19, 2019, 12:23pm UTC](https://discuss.elastic.co/t/proper-way-to-store-large-fields-in-elasticsearch/200194 "2019-09-19T12:23:35Z")
Hi, Our documents have few fields which cross the limit of length of the field allowed for highlighting. These are only some 6 fields which are very large. I don't want to increase that limit. And the error suggests sto… --- ## [Reindex from remote cluster and index names with special characters](https://discuss.elastic.co/t/reindex-from-remote-cluster-and-index-names-with-special-characters/199117)
**Author:** [@kernelpanic](https://discuss.elastic.co/u/kernelpanic)\ **Replies:** 3\ **Last updated:** [September 19, 2019, 12:11pm UTC](https://discuss.elastic.co/t/reindex-from-remote-cluster-and-index-names-with-special-characters/199117 "2019-09-19T12:11:54Z")
Hello all, we're reindexing from a remote cluster to a new one, the issue I'm having is that the source index name has special characters and escaping them doesn't seem to work. Here is the command I'm running: POST \_r… --- ## [Elasticsearch to persist in specified EBS volume ID](https://discuss.elastic.co/t/elasticsearch-to-persist-in-specified-ebs-volume-id/200200)
**Author:** [@charanjitkaur](https://discuss.elastic.co/u/charanjitkaur)\ **Replies:** 0\ **Last updated:** [September 19, 2019, 12:08pm UTC](https://discuss.elastic.co/t/elasticsearch-to-persist-in-specified-ebs-volume-id/200200 "2019-09-19T12:08:04Z")
How can i set a specific EBS volume id to be used as persistent volume for elasticsearch. --- ## [ERROR StatusLogger Log4j2 could not find a logging implementation. Please add log4j-core to the classpath. Using SimpleLogger to log to the console](https://discuss.elastic.co/t/error-statuslogger-log4j2-could-not-find-a-logging-implementation-please-add-log4j-core-to-the-classpath-using-simplelogger-to-log-to-the-console/200199)
**Author:** [@Velliyangiri](https://discuss.elastic.co/u/Velliyangiri)\ **Replies:** 0\ **Last updated:** [September 19, 2019, 11:59am UTC](https://discuss.elastic.co/t/error-statuslogger-log4j2-could-not-find-a-logging-implementation-please-add-log4j-core-to-the-classpath-using-simplelogger-to-log-to-the-console/200199 "2019-09-19T11:59:28Z")
How to resolve this error in elastic search --- ## [How to setup authentication for aws elasticsearch?](https://discuss.elastic.co/t/how-to-setup-authentication-for-aws-elasticsearch/200188)
**Author:** [@naveena.lm](https://discuss.elastic.co/u/naveena.lm)\ **Replies:** 2\ **Last updated:** [September 19, 2019, 11:14am UTC](https://discuss.elastic.co/t/how-to-setup-authentication-for-aws-elasticsearch/200188 "2019-09-19T11:14:50Z")
I configured amazon elastic search service with t2. small instance. It's getting 2 end points one for elastic search and another one for kibana. Kibana I set up the Cognito authentication, so its getting login page. same… --- ## [How to archive old indexes in elasticsearch](https://discuss.elastic.co/t/how-to-archive-old-indexes-in-elasticsearch/200185)
**Author:** [@skdasari](https://discuss.elastic.co/u/skdasari)\ **Replies:** 1\ **Last updated:** [September 19, 2019, 11:10am UTC](https://discuss.elastic.co/t/how-to-archive-old-indexes-in-elasticsearch/200185 "2019-09-19T11:10:27Z")
Hello Team, I would like to archive my old elasticsearch indexes, I am using elasticsearch 7.2.1. Not sure how to do it. Previously For version 5 I have come across curator. But when it comes to newer version not sure h… --- ## [Incorrect averageFieldLength(avgdl, average length of field) and fieldLength (dl, length of field) calculation](https://discuss.elastic.co/t/incorrect-averagefieldlength-avgdl-average-length-of-field-and-fieldlength-dl-length-of-field-calculation/200189)
**Author:** [@AshishkumarUpadhye](https://discuss.elastic.co/u/AshishkumarUpadhye)\ **Replies:** 0\ **Last updated:** [September 19, 2019, 10:59am UTC](https://discuss.elastic.co/t/incorrect-averagefieldlength-avgdl-average-length-of-field-and-fieldlength-dl-length-of-field-calculation/200189 "2019-09-19T10:59:13Z")
I have created new index in Elastic Search 7.3.2 version ( "lucene\_version" : "8.1.0") . With following details: INDEX created using the below details: FILTER "skillset\_synonyms\_filter": { "type": "synonym\_graph", "s… --- ## [Data node unable to find master node](https://discuss.elastic.co/t/data-node-unable-to-find-master-node/200187)
**Author:** [@Miao](https://discuss.elastic.co/u/Miao)\ **Replies:** 0\ **Last updated:** [September 19, 2019, 10:57am UTC](https://discuss.elastic.co/t/data-node-unable-to-find-master-node/200187 "2019-09-19T10:57:34Z")
I have two Windows VMs hosted on Azure. Both have ElasticSearch 7.x installed. One of them is designated as the master node, and the other a data node. Here are the contents of the elasticsearch.yml file on the master n… --- ## [How to monitor the ES index](https://discuss.elastic.co/t/how-to-monitor-the-es-index/200181)
**Author:** [@rajuleo](https://discuss.elastic.co/u/rajuleo)\ **Replies:** 0\ **Last updated:** [September 19, 2019, 10:39am UTC](https://discuss.elastic.co/t/how-to-monitor-the-es-index/200181 "2019-09-19T10:39:47Z")
Hi Team, Currently we are running ELK 6.3 version, we have a problem sometimes some of the indexes are empty and no data and dashboards are throwing shards mismatch error etc..How do we monitor the data quality and index… [Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1149) [Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1151)