# Elasticsearch **URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1951 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1952 --- ## [Very slow response in cluster](https://discuss.elastic.co/t/very-slow-response-in-cluster/100291)
**Author:** [@Amin1](https://discuss.elastic.co/u/Amin1)\ **Replies:** 3\ **Last updated:** [September 13, 2017, 8:21am UTC](https://discuss.elastic.co/t/very-slow-response-in-cluster/100291 "2017-09-13T08:21:45Z")
Hi team I have 7 node as follow : 172.24.69.14 22 47 0 0.03 0.02 0.05 - - es-client-02 172.24.69.18 84 98 20 0.45 0.60 0.71 d - es-data-03 172.24.69.13 15 41 0 0.00 0.01 0.05 - - es-client-01 172.24.69.17 … --- ## [Unable to compile spark 2.0 project with es-hadoop](https://discuss.elastic.co/t/unable-to-compile-spark-2-0-project-with-es-hadoop/98569)
**Author:** [@Noorul\_Islam\_Kamal\_M](https://discuss.elastic.co/u/Noorul_Islam_Kamal_M)\ **Replies:** 2\ **Last updated:** [September 13, 2017, 8:19am UTC](https://discuss.elastic.co/t/unable-to-compile-spark-2-0-project-with-es-hadoop/98569 "2017-09-13T08:19:37Z")
I have the following dependency added in sbt "org.elasticsearch" %% "elasticsearch-spark-20" % "5.5.2" I get the following error \[warn\] Run ‘evicted’ to see detailed eviction warnings \[info\] Compiling 1 protobuf file… --- ## [Elasticsearch - Object or Array Datatype](https://discuss.elastic.co/t/elasticsearch-object-or-array-datatype/100294)
**Author:** [@NerdSec](https://discuss.elastic.co/u/NerdSec)\ **Replies:** 1\ **Last updated:** [September 13, 2017, 8:14am UTC](https://discuss.elastic.co/t/elasticsearch-object-or-array-datatype/100294 "2017-09-13T08:14:50Z")
Hi, I am parsing proxy logs. These contain around 3 IP address fields. I wish to create a structure, in which IP is the main field with multiple sub-fields present. The final structure would be similar to something lik… --- ## [Ingest attachment plugin, 2 fields with content - one encoded and one decoded](https://discuss.elastic.co/t/ingest-attachment-plugin-2-fields-with-content-one-encoded-and-one-decoded/100213)
**Author:** [@mbedna](https://discuss.elastic.co/u/mbedna)\ **Replies:** 4\ **Last updated:** [September 13, 2017, 7:32am UTC](https://discuss.elastic.co/t/ingest-attachment-plugin-2-fields-with-content-one-encoded-and-one-decoded/100213 "2017-09-13T07:32:52Z")
Is it necessary to have content of pdf file in 2 fields in Elastic while using ingest attachment plugin? Example: "data": "JVBERi0xLjUNCiW1tbW1DQoxIDA "attachment": { "content\_type": "application/pdf", "author": "Sa… --- ## [Partial word search does not work with Ngram Analyzer!](https://discuss.elastic.co/t/partial-word-search-does-not-work-with-ngram-analyzer/100284)
**Author:** [@Nima](https://discuss.elastic.co/u/Nima)\ **Replies:** 1\ **Last updated:** [September 13, 2017, 5:51am UTC](https://discuss.elastic.co/t/partial-word-search-does-not-work-with-ngram-analyzer/100284 "2017-09-13T05:51:47Z")
Despairly trying to add n-gram to an index but no effect! I try dozen combination but still does not have partial word matching! ICreateIndexResponse indexResult = await \_elasticClient.CreateIndexAsync("prod… --- ## [How to get termvectors when using ingest plugin in ElasticSearch 5.5?](https://discuss.elastic.co/t/how-to-get-termvectors-when-using-ingest-plugin-in-elasticsearch-5-5/100260)
**Author:** [@sramalin](https://discuss.elastic.co/u/sramalin)\ **Replies:** 1\ **Last updated:** [September 13, 2017, 5:06am UTC](https://discuss.elastic.co/t/how-to-get-termvectors-when-using-ingest-plugin-in-elasticsearch-5-5/100260 "2017-09-13T05:06:22Z")
All, I have the following code to index a file using ingest plugin in elasticsearch public class Document { public string Id { get; set; } public string Content { get; set; } public Attachment Attachment { get; s… --- ## [ES on Azure - Version](https://discuss.elastic.co/t/es-on-azure-version/98645)
**Author:** [@sanketshinde](https://discuss.elastic.co/u/sanketshinde)\ **Replies:** 12\ **Last updated:** [September 13, 2017, 4:30am UTC](https://discuss.elastic.co/t/es-on-azure-version/98645 "2017-09-13T04:30:35Z")
The version of elastic search available for deployment on Azure as a marketplace template is limited to the latest version of 2.3.1 Why is this so far back in the evolution? --- ## [Term query with long value field](https://discuss.elastic.co/t/term-query-with-long-value-field/100182)
**Author:** [@seongwon](https://discuss.elastic.co/u/seongwon)\ **Replies:** 5\ **Last updated:** [September 13, 2017, 4:19am UTC](https://discuss.elastic.co/t/term-query-with-long-value-field/100182 "2017-09-13T04:19:33Z")
I tried to search using term query with long value, but the hits were only part of whole documents. Surprisingly, I tried to search using range query Instead of term query, then I got whole documents that I wanted. The… --- ## [Cannot handle type while writing dataframe to ES](https://discuss.elastic.co/t/cannot-handle-type-while-writing-dataframe-to-es/99635)
**Author:** [@chaitujil](https://discuss.elastic.co/u/chaitujil)\ **Replies:** 2\ **Last updated:** [September 13, 2017, 12:22am UTC](https://discuss.elastic.co/t/cannot-handle-type-while-writing-dataframe-to-es/99635 "2017-09-13T00:22:08Z")
Hi, I am seeing this exception while writing an RDD to ES Caused by: org.elasticsearch.hadoop.serialization.EsHadoopSerializationException: Cannot handle type \[class scala.Enumeration$Val\] … My object has Enumeration … --- ## [Master not discovered exception happening randomly in self hosted AWS](https://discuss.elastic.co/t/master-not-discovered-exception-happening-randomly-in-self-hosted-aws/99659)
**Author:** [@mujtabahussain](https://discuss.elastic.co/u/mujtabahussain)\ **Replies:** 5\ **Last updated:** [September 12, 2017, 10:57pm UTC](https://discuss.elastic.co/t/master-not-discovered-exception-happening-randomly-in-self-hosted-aws/99659 "2017-09-12T22:57:38Z")
Hello all. Setup: Configurable number of data nodes (3 at the moment), one dedicated master node and configurable number of ingest nodes (based on load) that exist in the same private subnet inside a VPC. The master no… --- ## [Change the settings of an S3 Repository](https://discuss.elastic.co/t/change-the-settings-of-an-s3-repository/100265)
**Author:** [@Dan\_Rough](https://discuss.elastic.co/u/Dan_Rough)\ **Replies:** 2\ **Last updated:** [September 12, 2017, 10:57pm UTC](https://discuss.elastic.co/t/change-the-settings-of-an-s3-repository/100265 "2017-09-12T22:57:13Z")
Hi, Earlier, today I successfully installed the S3-repository plugin and was able to create a repository, and subsequently take a snapshot. All good, nice and straight forward :slight\_smile: However, now that I've mana… --- ## [How to get the inner hits of a nested query ? (JAVA API version 5.5)](https://discuss.elastic.co/t/how-to-get-the-inner-hits-of-a-nested-query-java-api-version-5-5/100146)
**Author:** [@Pritom\_Ahmed](https://discuss.elastic.co/u/Pritom_Ahmed)\ **Replies:** 2\ **Last updated:** [September 12, 2017, 6:38pm UTC](https://discuss.elastic.co/t/how-to-get-the-inner-hits-of-a-nested-query-java-api-version-5-5/100146 "2017-09-12T18:38:38Z")
Hi, I was wondering How to get the inner hits of a nested query? SearchResponse response = client.prepareSearch("trace-index2") .setTypes("trace-log2") .setSearchType(SearchType.DFS\_QUE… --- ## [Controlling elasticsearch \_bulk queue size](https://discuss.elastic.co/t/controlling-elasticsearch--bulk-queue-size/99455)
**Author:** [@Quintus](https://discuss.elastic.co/u/Quintus)\ **Replies:** 8\ **Last updated:** [September 12, 2017, 7:39pm UTC](https://discuss.elastic.co/t/controlling-elasticsearch--bulk-queue-size/99455 "2017-09-12T19:39:26Z")
I’ve setup elasricsearch on a machine with the following specs: Storage: 500 GB HDD Ram: 8 GB CPU : Intel i7 Quad-Core On the same machine I have an application that listens to netflow data and exports it to elastics… --- ## [How to store correctly the probe's value to have trends and live value](https://discuss.elastic.co/t/how-to-store-correctly-the-probes-value-to-have-trends-and-live-value/100238)
**Author:** [@iCreil](https://discuss.elastic.co/u/iCreil)\ **Replies:** 0\ **Last updated:** [September 12, 2017, 3:37pm UTC](https://discuss.elastic.co/t/how-to-store-correctly-the-probes-value-to-have-trends-and-live-value/100238 "2017-09-12T15:37:34Z")
Hello Guys, I need to find a way about how to store probes 's value over the time, but I don't know from where I can start, basically I've already read the guideline of elasticsearch and I cannot find a way to do that,… --- ## [NoClassDefFoundError: Could not initialize class org.elasticsearch.common.network.NetworkService](https://discuss.elastic.co/t/noclassdeffounderror-could-not-initialize-class-org-elasticsearch-common-network-networkservice/100020)
**Author:** [@Kirito940613](https://discuss.elastic.co/u/Kirito940613)\ **Replies:** 1\ **Last updated:** [September 12, 2017, 3:40pm UTC](https://discuss.elastic.co/t/noclassdeffounderror-could-not-initialize-class-org-elasticsearch-common-network-networkservice/100020 "2017-09-12T15:40:27Z")
public final static TransportClient getClient() { synchronized (EsUtil.class) { if(client == null) try { Settings settings = Settings.builder() .put("cluster.name", clusterName… --- ## [Elasstic search insertion failing](https://discuss.elastic.co/t/elasstic-search-insertion-failing/99788)
**Author:** [@guthurti](https://discuss.elastic.co/u/guthurti)\ **Replies:** 1\ **Last updated:** [September 12, 2017, 3:38pm UTC](https://discuss.elastic.co/t/elasstic-search-insertion-failing/99788 "2017-09-12T15:38:41Z")
While inserting the data into elastic search using spark am getting the following exception. I am completely blocked here ,Can anybody help here Setting the following properties to ES "es.nodes" es.net.http.auth.user… --- ## [How to handle data that causes failure while indexing from spark to ES](https://discuss.elastic.co/t/how-to-handle-data-that-causes-failure-while-indexing-from-spark-to-es/99857)
**Author:** [@bricheet](https://discuss.elastic.co/u/bricheet)\ **Replies:** 1\ **Last updated:** [September 12, 2017, 3:34pm UTC](https://discuss.elastic.co/t/how-to-handle-data-that-causes-failure-while-indexing-from-spark-to-es/99857 "2017-09-12T15:34:59Z")
I'm using pyspark to index 8 TB of data into an elasticsearch index. My code looks something like this: df.write.format("org.elasticsearch.spark.sql").mode( 'append' ).option( "es.mapping.id", "id" ).options( … --- ## [Advice on cross field lookup](https://discuss.elastic.co/t/advice-on-cross-field-lookup/99022)
**Author:** [@capaneus](https://discuss.elastic.co/u/capaneus)\ **Replies:** 3\ **Last updated:** [September 12, 2017, 3:34pm UTC](https://discuss.elastic.co/t/advice-on-cross-field-lookup/99022 "2017-09-12T15:34:03Z")
Hi, I have 2 document types, Doc type 1 stores all information of each problem: { … ’\_type’: 'problems’ assignto: userabc, reportby: usercde ... } Doc type 2 stores how users are grouped into different groups: … --- ## [Elastisearch-Hadoop how to do a bulk search in spark program](https://discuss.elastic.co/t/elastisearch-hadoop-how-to-do-a-bulk-search-in-spark-program/99652)
**Author:** [@tosaurabh85](https://discuss.elastic.co/u/tosaurabh85)\ **Replies:** 1\ **Last updated:** [September 12, 2017, 3:15pm UTC](https://discuss.elastic.co/t/elastisearch-hadoop-how-to-do-a-bulk-search-in-spark-program/99652 "2017-09-12T15:15:27Z")
I am writing a spark program which is basically a RDD of Strings. What i need to to do is basically create a query per string and do the query based on Elastic search index. So essentially Query would differ on string. I… --- ## [Hive to ES incremental upload](https://discuss.elastic.co/t/hive-to-es-incremental-upload/99516)
**Author:** [@Ashwini\_Kumar](https://discuss.elastic.co/u/Ashwini_Kumar)\ **Replies:** 1\ **Last updated:** [September 12, 2017, 2:57pm UTC](https://discuss.elastic.co/t/hive-to-es-incremental-upload/99516 "2017-09-12T14:57:01Z")
I have 20000 documents in ES and I have uploaded them from Hive using Hive -ES connector. How can I dump new data from hive to ES? I want to do an incremental upload how sqoop does. --- ## [Elasticsearch for Apache Hadoop 5.5.3 and 5.6.0 released](https://discuss.elastic.co/t/elasticsearch-for-apache-hadoop-5-5-3-and-5-6-0-released/100231)
**Author:** [@james.baiera](https://discuss.elastic.co/u/james.baiera)\ **Replies:** 0\ **Last updated:** [September 12, 2017, 2:46pm UTC](https://discuss.elastic.co/t/elasticsearch-for-apache-hadoop-5-5-3-and-5-6-0-released/100231 "2017-09-12T14:46:54Z")
I am proud to announce that both ES-Hadoop 5.5.3 and 5.6.0 have been released! You can read more about these releases here. --- ## [Question on watcher trigger schedule - Activate from 6am to 10pm daily, run every 5 minutes](https://discuss.elastic.co/t/question-on-watcher-trigger-schedule-activate-from-6am-to-10pm-daily-run-every-5-minutes/99654)
**Author:** [@joedissmeyer](https://discuss.elastic.co/u/joedissmeyer)\ **Replies:** 2\ **Last updated:** [September 12, 2017, 2:42pm UTC](https://discuss.elastic.co/t/question-on-watcher-trigger-schedule-activate-from-6am-to-10pm-daily-run-every-5-minutes/99654 "2017-09-12T14:42:03Z")
What I am trying to do is activate a watch rule to run in 5 minute intervals only from 6am to 10pm every single day. Is this an appropriate trigger schedule to achieve this goal? "trigger" : { "schedule" : { … --- ## [Gold and Platinum subscription](https://discuss.elastic.co/t/gold-and-platinum-subscription/100037)
**Author:** [@mruthyu](https://discuss.elastic.co/u/mruthyu)\ **Replies:** 3\ **Last updated:** [September 12, 2017, 2:33pm UTC](https://discuss.elastic.co/t/gold-and-platinum-subscription/100037 "2017-09-12T14:33:21Z")
Can you please provide more details about the Elastic Stack Monitoring Service which is part of the platinum and gold subscriptions? --- ## [Elasticsearch nodes not being discovered in EC2 in 5.6](https://discuss.elastic.co/t/elasticsearch-nodes-not-being-discovered-in-ec2-in-5-6/100222)
**Author:** [@intrepid1](https://discuss.elastic.co/u/intrepid1)\ **Replies:** 0\ **Last updated:** [September 12, 2017, 2:16pm UTC](https://discuss.elastic.co/t/elasticsearch-nodes-not-being-discovered-in-ec2-in-5-6/100222 "2017-09-12T14:16:20Z")
I am setting up an Elasticsearch cluster in EC2 but it is failing with the crucial discovery stage. I am using packer to build the instances and this works. However when I start up a master I receive the message "\[2017-… --- ## [Nodes API](https://discuss.elastic.co/t/nodes-api/99831)
**Author:** [@mruthyu](https://discuss.elastic.co/u/mruthyu)\ **Replies:** 4\ **Last updated:** [September 12, 2017, 1:11pm UTC](https://discuss.elastic.co/t/nodes-api/99831 "2017-09-12T13:11:43Z")
How to get only following response from the nodes API REST service GET /\_nodes/ { "\_nodes": { "total": 2, "successful": 2, "failed": 0 } } --- ## [TransportClient createInjector error while using inmemory es cluster](https://discuss.elastic.co/t/transportclient-createinjector-error-while-using-inmemory-es-cluster/97029)
**Author:** [@areddy7021](https://discuss.elastic.co/u/areddy7021)\ **Replies:** 4\ **Last updated:** [September 12, 2017, 12:55pm UTC](https://discuss.elastic.co/t/transportclient-createinjector-error-while-using-inmemory-es-cluster/97029 "2017-09-12T12:55:51Z")
I have a unit test where i am creating an inmemory es cluster using node builder and having issues while accessing through es transport client. There are no issues while accessing through node client. Any one any ideas o… --- ## [How can i disable ignore\_above for every existing and new index](https://discuss.elastic.co/t/how-can-i-disable-ignore-above-for-every-existing-and-new-index/100208)
**Author:** [@vinay\_garg](https://discuss.elastic.co/u/vinay_garg)\ **Replies:** 0\ **Last updated:** [September 12, 2017, 12:25pm UTC](https://discuss.elastic.co/t/how-can-i-disable-ignore-above-for-every-existing-and-new-index/100208 "2017-09-12T12:25:03Z")
Hi All, We're having fuse logs which field having 1000-2000 character. How can i disable ignore\_above attribute for logstash source? --- ## [Not able to search from java](https://discuss.elastic.co/t/not-able-to-search-from-java/99928)
**Author:** [@nishanthsolomon](https://discuss.elastic.co/u/nishanthsolomon)\ **Replies:** 13\ **Last updated:** [September 12, 2017, 12:03pm UTC](https://discuss.elastic.co/t/not-able-to-search-from-java/99928 "2017-09-12T12:03:54Z")
I want to create a simple java program for elastic search. from the documentations and examples i came up with the following package testListJava; import static org.elasticsearch.node.NodeBuilder.nodeBuilder; import o… --- ## [Problem to install delete-by-query plugin](https://discuss.elastic.co/t/problem-to-install-delete-by-query-plugin/100086)
**Author:** [@joao](https://discuss.elastic.co/u/joao)\ **Replies:** 4\ **Last updated:** [September 12, 2017, 12:02pm UTC](https://discuss.elastic.co/t/problem-to-install-delete-by-query-plugin/100086 "2017-09-12T12:02:36Z")
Hello, I've a problem to install the delete-by-query plugin. When I try to install the plugin the elasticsearch returns this message: \[root@homologacaoes bin\]# ./elasticsearch-plugin install delete-by-query A tool for… --- ## [Integrating elasticsearch with java through TransportClient](https://discuss.elastic.co/t/integrating-elasticsearch-with-java-through-transportclient/100190)
**Author:** [@vaibhav2903](https://discuss.elastic.co/u/vaibhav2903)\ **Replies:** 1\ **Last updated:** [September 12, 2017, 11:34am UTC](https://discuss.elastic.co/t/integrating-elasticsearch-with-java-through-transportclient/100190 "2017-09-12T11:34:21Z")
I am trying to connect Eclipse(Java) with elasticsearch using transportclient. i am unable to connect both of them because of the following error: I have used logstash to connect mysqlWorkbench with elasticsearch. Tra… [Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1950) [Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1952)