# Elasticsearch **URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1769 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1770 --- ## [Multiple ES-Hadoop versions detected in the classpath in Hue](https://discuss.elastic.co/t/multiple-es-hadoop-versions-detected-in-the-classpath-in-hue/120946)
**Author:** [@ebeb](https://discuss.elastic.co/u/ebeb)\ **Replies:** 4\ **Last updated:** [March 1, 2018, 10:31pm UTC](https://discuss.elastic.co/t/multiple-es-hadoop-versions-detected-in-the-classpath-in-hue/120946 "2018-03-01T22:31:38Z")
Hello, We are using Cloudera CDH5.12 and elasticsearch-hadoop-6.2.1 . We added the ES-hadoop jars path to Cloudera Manager-\>Clusters-\>Hive-\>Advanced and set the value of: Hive Auxiliary JARs Directory to the jar direct… --- ## [Need help framing the query, wildcard search and range](https://discuss.elastic.co/t/need-help-framing-the-query-wildcard-search-and-range/122160)
**Author:** [@krishbish](https://discuss.elastic.co/u/krishbish)\ **Replies:** 0\ **Last updated:** [March 1, 2018, 10:03pm UTC](https://discuss.elastic.co/t/need-help-framing-the-query-wildcard-search-and-range/122160 "2018-03-01T22:03:24Z")
My index "access\_recs" and mapping for type "config" are like this: { "access\_recs": { "mappings": { "config": { "properties": { "timestamp": { "type": "date", "format": "epoch\_second" }, "destUpdate": { "type… --- ## [AWS Error:- Cannot detect ES version: - typically this happens if the network/Elasticsearch cluster is not accessible or when tar geting a WAN/Cloud instance without the proper setting 'es.nodes.wan.only'](https://discuss.elastic.co/t/aws-error-cannot-detect-es-version-typically-this-happens-if-the-network-elasticsearch-cluster-is-not-accessible-or-when-tar-geting-a-wan-cloud-instance-without-the-proper-setting-es-nodes-wan-only/121665)
**Author:** [@krishnaSH](https://discuss.elastic.co/u/krishnaSH)\ **Replies:** 1\ **Last updated:** [March 1, 2018, 9:59pm UTC](https://discuss.elastic.co/t/aws-error-cannot-detect-es-version-typically-this-happens-if-the-network-elasticsearch-cluster-is-not-accessible-or-when-tar-geting-a-wan-cloud-instance-without-the-proper-setting-es-nodes-wan-only/121665 "2018-03-01T21:59:19Z")
I am connecting Hive in AWS EMR instancewith Elasticsearch and firing the command (PFB) to create a table in hive: create external table abc(schema) STORED BY 'org.elasticsearch.hadoop.hive.EsStorageHandler' TBLPROPERT… --- ## [Query String Query for case insensitive matching using ES-Spark connector](https://discuss.elastic.co/t/query-string-query-for-case-insensitive-matching-using-es-spark-connector/120242)
**Author:** [@Pramod\_Sripada](https://discuss.elastic.co/u/Pramod_Sripada)\ **Replies:** 1\ **Last updated:** [March 1, 2018, 9:43pm UTC](https://discuss.elastic.co/t/query-string-query-for-case-insensitive-matching-using-es-spark-connector/120242 "2018-03-01T21:43:19Z")
Hi, I am using ES-Spark connector and trying to push filters down to ES, so that Spark would have exact data for processing . I am trying to perform a case insensitive value match on a column value but unable to perform… --- ## [Elasticsearch-hive Storage handler exception](https://discuss.elastic.co/t/elasticsearch-hive-storage-handler-exception/119993)
**Author:** [@sat](https://discuss.elastic.co/u/sat)\ **Replies:** 1\ **Last updated:** [March 1, 2018, 9:38pm UTC](https://discuss.elastic.co/t/elasticsearch-hive-storage-handler-exception/119993 "2018-03-01T21:38:41Z")
Hi i am trying to get elasticsearch data in to hive external table, CREATE EXTERNAL TABLE eshadoop( name String ) STORED BY 'org.elasticsearch.hadoop.hive.EsStorageHandler' TBLPROPERTIES('es.nodes' = 'XXXX:9200', … --- ## [Elasticsearch Geo Distance query in PySpark DataFrame](https://discuss.elastic.co/t/elasticsearch-geo-distance-query-in-pyspark-dataframe/119656)
**Author:** [@Pramod\_Sripada](https://discuss.elastic.co/u/Pramod_Sripada)\ **Replies:** 1\ **Last updated:** [March 1, 2018, 9:36pm UTC](https://discuss.elastic.co/t/elasticsearch-geo-distance-query-in-pyspark-dataframe/119656 "2018-03-01T21:36:40Z")
I am using elasticsearch-spark connector to query data from Elasticsearch and get it into a PySpark DataFrame. Going through materials online and few Stackoverflow answers, I understood that filters will be pushed during… --- ## [Script fields in Spark](https://discuss.elastic.co/t/script-fields-in-spark/121741)
**Author:** [@jbraun](https://discuss.elastic.co/u/jbraun)\ **Replies:** 1\ **Last updated:** [March 1, 2018, 9:32pm UTC](https://discuss.elastic.co/t/script-fields-in-spark/121741 "2018-03-01T21:32:19Z")
Is it possible to create a script field when querying ES in spark? --- ## [Data Modeling - Product Data](https://discuss.elastic.co/t/data-modeling-product-data/122156)
**Author:** [@m82labs](https://discuss.elastic.co/u/m82labs)\ **Replies:** 0\ **Last updated:** [March 1, 2018, 9:11pm UTC](https://discuss.elastic.co/t/data-modeling-product-data/122156 "2018-03-01T21:11:24Z")
I currently have a use case where I need to store lots of product information that needs to be searchable. This data is updated many times a day. Each product could have any number of attributes associated with it depen… --- ## [Problems/Bug ? while updating existing teamplates](https://discuss.elastic.co/t/problems-bug-while-updating-existing-teamplates/122147)
**Author:** [@kasi](https://discuss.elastic.co/u/kasi)\ **Replies:** 0\ **Last updated:** [March 1, 2018, 8:17pm UTC](https://discuss.elastic.co/t/problems-bug-while-updating-existing-teamplates/122147 "2018-03-01T20:17:42Z")
Hi, Use Case: Have an Elastic Search template gdp\_es1 which has three fields of type integer,interger,string col1: integer, col2:integer, col3:string, there is a corresponding index that is created for this templates … --- ## [Elasticsearch painless access dynamically named field](https://discuss.elastic.co/t/elasticsearch-painless-access-dynamically-named-field/122025)
**Author:** [@Jibin\_Mathews](https://discuss.elastic.co/u/Jibin_Mathews)\ **Replies:** 1\ **Last updated:** [March 1, 2018, 8:16pm UTC](https://discuss.elastic.co/t/elasticsearch-painless-access-dynamically-named-field/122025 "2018-03-01T20:16:07Z")
I am trying to average a field in elastic search, "aggs": { "avg\_timedifference": { "avg": { "script" : "doc\['@timestamp'\].value" } } this works, where the mapping is, { … --- ## [How to edit a ES query in JAVA](https://discuss.elastic.co/t/how-to-edit-a-es-query-in-java/122073)
**Author:** [@joker](https://discuss.elastic.co/u/joker)\ **Replies:** 5\ **Last updated:** [March 1, 2018, 7:32pm UTC](https://discuss.elastic.co/t/how-to-edit-a-es-query-in-java/122073 "2018-03-01T19:32:48Z")
Can we edit a ES query in jAVA ? like removing some condition, modifying it, etc. Thanks. --- ## [Search using ngram max\_ngram](https://discuss.elastic.co/t/search-using-ngram-max-ngram/122099)
**Author:** [@Ram\_Ibaset](https://discuss.elastic.co/u/Ram_Ibaset)\ **Replies:** 1\ **Last updated:** [March 1, 2018, 6:35pm UTC](https://discuss.elastic.co/t/search-using-ngram-max-ngram/122099 "2018-03-01T18:35:11Z")
What's the best practice for pattern searches? I have implemented using ngram tokenizer, however there are min and max limitations. For instance min\_gram - 3 and max\_gram - 4 will limit the search to 3 characters and … --- ## [Courier Fetch: 3 out of 33 shards failed](https://discuss.elastic.co/t/courier-fetch-3-out-of-33-shards-failed/122094)
**Author:** [@hadi](https://discuss.elastic.co/u/hadi)\ **Replies:** 12\ **Last updated:** [March 1, 2018, 6:28pm UTC](https://discuss.elastic.co/t/courier-fetch-3-out-of-33-shards-failed/122094 "2018-03-01T18:28:39Z")
Hello Everyone! Once trying to check a specific index via Kibana, I get the following error! \[fffffff\] The related logs that I see in my elastic search for this Courier Fetch: 3 shard failed are as follows: 2018-03-0… --- ## [Does Elastic Cloud on AWS has XPACK features like reporting and IAM](https://discuss.elastic.co/t/does-elastic-cloud-on-aws-has-xpack-features-like-reporting-and-iam/121984)
**Author:** [@dubul](https://discuss.elastic.co/u/dubul)\ **Replies:** 1\ **Last updated:** [March 1, 2018, 5:58pm UTC](https://discuss.elastic.co/t/does-elastic-cloud-on-aws-has-xpack-features-like-reporting-and-iam/121984 "2018-03-01T17:58:58Z")
I would like to know if Elastic Cloud on AWS has XPACK features like Reporting, Monitoring,IAM. If not what are the best options to have XPACK features. 1.Bringing Elastic Cloud data to On premise and have premium XPACK… --- ## [Elastic Search \[5.3\] throwing exception when 10 concurrent threads are trying to index large documents](https://discuss.elastic.co/t/elastic-search-5-3-throwing-exception-when-10-concurrent-threads-are-trying-to-index-large-documents/122133)
**Author:** [@njsinghal](https://discuss.elastic.co/u/njsinghal)\ **Replies:** 0\ **Last updated:** [March 1, 2018, 5:31pm UTC](https://discuss.elastic.co/t/elastic-search-5-3-throwing-exception-when-10-concurrent-threads-are-trying-to-index-large-documents/122133 "2018-03-01T17:31:34Z")
Hi, We are using Elastic Search 5.3 version and elastic search rest client for Java with the same version. We have a cluster of 3 nodes. Below are config for rest client- maxConnsPerRoute=100 maxConns=200 We have bi… --- ## [Elasticsearch won't start after upgrade from 5.6.8 to 6.0.1. Failed to read local state - directory not empty](https://discuss.elastic.co/t/elasticsearch-wont-start-after-upgrade-from-5-6-8-to-6-0-1-failed-to-read-local-state-directory-not-empty/122129)
**Author:** [@daved](https://discuss.elastic.co/u/daved)\ **Replies:** 0\ **Last updated:** [March 1, 2018, 5:20pm UTC](https://discuss.elastic.co/t/elasticsearch-wont-start-after-upgrade-from-5-6-8-to-6-0-1-failed-to-read-local-state-directory-not-empty/122129 "2018-03-01T17:20:38Z")
Hi, I'm trying to upgrade our stack from 5.6.8 to 6.0.1 on an Ubuntu OS using the deb file after running Upgrade Assistant on 5.6.8. I'm seeing the following error in /var/log/elasticsearch/elasticsearch.log: 2018-03-0… --- ## [Search with complete suggester and german analyzer](https://discuss.elastic.co/t/search-with-complete-suggester-and-german-analyzer/122126)
**Author:** [@Kurzer\_Patrick](https://discuss.elastic.co/u/Kurzer_Patrick)\ **Replies:** 0\ **Last updated:** [March 1, 2018, 5:07pm UTC](https://discuss.elastic.co/t/search-with-complete-suggester-and-german-analyzer/122126 "2018-03-01T17:07:03Z")
Hi, I created a simple index with a suggest field and a completion type. I indexed some city names. For the suggest field I use a german analyzer. PUT city\_de { "mappings": { "city" : { "properties": { … --- ## ["key=" for entering server?](https://discuss.elastic.co/t/key-for-entering-server/122125)
**Author:** [@jmgarcia](https://discuss.elastic.co/u/jmgarcia)\ **Replies:** 0\ **Last updated:** [March 1, 2018, 4:59pm UTC](https://discuss.elastic.co/t/key-for-entering-server/122125 "2018-03-01T16:59:17Z")
Hey fellas, I am finally getting all of this put together and I am running into issues, For some reason we dont have usernames setup but only a key that is given out. I have this key and I am unsure how to properly appl… --- ## [Deprecating path.data volume, preserving closed indices](https://discuss.elastic.co/t/deprecating-path-data-volume-preserving-closed-indices/122120)
**Author:** [@excalq](https://discuss.elastic.co/u/excalq)\ **Replies:** 0\ **Last updated:** [March 1, 2018, 4:29pm UTC](https://discuss.elastic.co/t/deprecating-path-data-volume-preserving-closed-indices/122120 "2018-03-01T16:29:07Z")
I have an ES node, which has temporarily attached EBS volumes belonging to our former cluster which went down due to operator error. Attaching these EBS volumes, and adding them to path.data has allowed fairly easy reall… --- ## [Autocomplete across multiple fields with NEST client](https://discuss.elastic.co/t/autocomplete-across-multiple-fields-with-nest-client/120878)
**Author:** [@rdcm](https://discuss.elastic.co/u/rdcm)\ **Replies:** 4\ **Last updated:** [March 1, 2018, 3:39pm UTC](https://discuss.elastic.co/t/autocomplete-across-multiple-fields-with-nest-client/120878 "2018-03-01T15:39:19Z")
Hi! I\`am trying implement autocomplete feature for multiple fields with official high-level NEST client. But quick and dirty solution looks like this: public async Task\\> Complete(string tex… --- ## [Query data in S3 using elastic search](https://discuss.elastic.co/t/query-data-in-s3-using-elastic-search/122005)
**Author:** [@Umer\_Munir](https://discuss.elastic.co/u/Umer_Munir)\ **Replies:** 1\ **Last updated:** [March 1, 2018, 3:34pm UTC](https://discuss.elastic.co/t/query-data-in-s3-using-elastic-search/122005 "2018-03-01T15:34:43Z")
Hi, Can I query data placed in S3 using elastic search. Regards, Umer --- ## [How to test java(Elasticsearch) service?](https://discuss.elastic.co/t/how-to-test-java-elasticsearch-service/122010)
**Author:** [@Nikita\_Krasnov](https://discuss.elastic.co/u/Nikita_Krasnov)\ **Replies:** 1\ **Last updated:** [March 1, 2018, 3:33pm UTC](https://discuss.elastic.co/t/how-to-test-java-elasticsearch-service/122010 "2018-03-01T15:33:48Z")
Hello to everyone, I use Elastic 6.1, Rest High level client for searching and adding information(logs and metrics). Right know I need to test this service, methods for adding and saving information(like with the help … --- ## [Query DSL, multiple filter, dynamic query](https://discuss.elastic.co/t/query-dsl-multiple-filter-dynamic-query/122016)
**Author:** [@DiSiZ](https://discuss.elastic.co/u/DiSiZ)\ **Replies:** 1\ **Last updated:** [March 1, 2018, 3:11pm UTC](https://discuss.elastic.co/t/query-dsl-multiple-filter-dynamic-query/122016 "2018-03-01T15:11:35Z")
Hey, I have to create dynamic query to be more precise, create multiple filters, here's my code : Filter dynamic creation : var filters = new List\, QueryContainer\>\>(); for (int i … --- ## [Elasticsearch php client searching from multiple indices](https://discuss.elastic.co/t/elasticsearch-php-client-searching-from-multiple-indices/122043)
**Author:** [@Balog\_Dominik](https://discuss.elastic.co/u/Balog_Dominik)\ **Replies:** 1\ **Last updated:** [March 1, 2018, 2:55pm UTC](https://discuss.elastic.co/t/elasticsearch-php-client-searching-from-multiple-indices/122043 "2018-03-01T14:55:27Z")
How can I specify query rules for each index when searching through multiple indices? Because indexed the same table twice with different mappings. But I need different query rules for each index when i'm searching. … --- ## [Getting "bad\_certificate" with certs that I've generated](https://discuss.elastic.co/t/getting-bad-certificate-with-certs-that-ive-generated/122097)
**Author:** [@sbu](https://discuss.elastic.co/u/sbu)\ **Replies:** 0\ **Last updated:** [March 1, 2018, 2:34pm UTC](https://discuss.elastic.co/t/getting-bad-certificate-with-certs-that-ive-generated/122097 "2018-03-01T14:34:18Z")
I've set up a CA and generated my own cert using the following commands:- Create root private CA key winpty openssl genrsa -aes256 -out private/ca.key.pem 4096 Create root cert. winpty openssl req -config openssl-ca.… --- ## [\[IMPROVEMENT REQUEST\] Disk Available in Monitoring can be misleading](https://discuss.elastic.co/t/improvement-request-disk-available-in-monitoring-can-be-misleading/119032)
**Author:** [@Cornoualis](https://discuss.elastic.co/u/Cornoualis)\ **Replies:** 4\ **Last updated:** [March 1, 2018, 2:34pm UTC](https://discuss.elastic.co/t/improvement-request-disk-available-in-monitoring-can-be-misleading/119032 "2018-03-01T14:34:27Z")
Feature request Describe the feature: Improve the "Disk Available" value on the main "Monitoring" page, by only counting the free disk space on nodes that have node.data=true in their config. Elasticsearch version: Ver… --- ## [Alias for monthly indices](https://discuss.elastic.co/t/alias-for-monthly-indices/122003)
**Author:** [@kottapar](https://discuss.elastic.co/u/kottapar)\ **Replies:** 1\ **Last updated:** [March 1, 2018, 2:22pm UTC](https://discuss.elastic.co/t/alias-for-monthly-indices/122003 "2018-03-01T14:22:35Z")
Hey guys, We've created an alias perferr for two indices say perf-yyyy.mm and err-yyyy.mm. However when a new index is created the next month we have to run the alias command again. Is there any way we can make any new… --- ## [Searching with & without spaces](https://discuss.elastic.co/t/searching-with-without-spaces/122076)
**Author:** [@iluvcode](https://discuss.elastic.co/u/iluvcode)\ **Replies:** 6\ **Last updated:** [March 1, 2018, 2:13pm UTC](https://discuss.elastic.co/t/searching-with-without-spaces/122076 "2018-03-01T14:13:04Z")
I am using Elasticsearch 5.3 and would like to get the same results if the words have space or without space. example : Some of the documents have "SM 58" (with space) and some have "SM58" (without space). So when I se… --- ## [Elasticsearch 2.4.x shard data not removed from disk](https://discuss.elastic.co/t/elasticsearch-2-4-x-shard-data-not-removed-from-disk/122089)
**Author:** [@jaul](https://discuss.elastic.co/u/jaul)\ **Replies:** 0\ **Last updated:** [March 1, 2018, 2:05pm UTC](https://discuss.elastic.co/t/elasticsearch-2-4-x-shard-data-not-removed-from-disk/122089 "2018-03-01T14:05:32Z")
Hi, We are experiencing an unbalance on our cluster, and after some manual shard reallocation, we saw that there was no disk space freed at the time. After a quick check on the logs, we saw that lucene failed to acquir… --- ## [Select query from External elasticsearch table throwing classcastexception](https://discuss.elastic.co/t/select-query-from-external-elasticsearch-table-throwing-classcastexception/122088)
**Author:** [@adarsh\_ks](https://discuss.elastic.co/u/adarsh_ks)\ **Replies:** 0\ **Last updated:** [March 1, 2018, 2:05pm UTC](https://discuss.elastic.co/t/select-query-from-external-elasticsearch-table-throwing-classcastexception/122088 "2018-03-01T14:05:03Z")
Hi, I am using Elasticsearch in Hadoop version 6.2.0 to connect Hive and elasticsearch. My queries is as below. Hive Tables CREATE TABLE IF NOT EXISTS User\_Details( Id bigint, username string, name string, address1 … [Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1768) [Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1770)