# Elasticsearch **URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1553 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1554 --- ## [Processing HTML content using java transport client within JSON files ingested using Logstash and Kafka](https://discuss.elastic.co/t/processing-html-content-using-java-transport-client-within-json-files-ingested-using-logstash-and-kafka/147935)
**Author:** [@phoenix9](https://discuss.elastic.co/u/phoenix9)\ **Replies:** 0\ **Last updated:** [September 10, 2018, 10:21am UTC](https://discuss.elastic.co/t/processing-html-content-using-java-transport-client-within-json-files-ingested-using-logstash-and-kafka/147935 "2018-09-10T10:21:12Z")
I am trying to ingest files (articles with a heading, body, etc) into ElasticSearch using Logstash and Kafka. The files are in JSON (fields - title, body, etc) where the body field is in HTML. My ElasticSearch version is… --- ## [Getting gc overhead on elastic search cluster on each instance](https://discuss.elastic.co/t/getting-gc-overhead-on-elastic-search-cluster-on-each-instance/147898)
**Author:** [@manish\_jaiswal](https://discuss.elastic.co/u/manish_jaiswal)\ **Replies:** 5\ **Last updated:** [September 10, 2018, 10:11am UTC](https://discuss.elastic.co/t/getting-gc-overhead-on-elastic-search-cluster-on-each-instance/147898 "2018-09-10T10:11:02Z")
I am getting gc overhead on elastic search cluster on each instance. (16data node 3master) instance memory 60 heap size ES :32 queue size:7000 thread pool:write Indices: 1,541 Primary Shards 7,557 Replica Shards 7… --- ## [Match query on array field](https://discuss.elastic.co/t/match-query-on-array-field/147933)
**Author:** [@Cosmin\_Marginean1](https://discuss.elastic.co/u/Cosmin_Marginean1)\ **Replies:** 0\ **Last updated:** [September 10, 2018, 9:58am UTC](https://discuss.elastic.co/t/match-query-on-array-field/147933 "2018-09-10T09:58:17Z")
We have a standard match query { "query": { "match" : { "names" : "John smith" "operator": "and" } } } The field names is an array that contains, for a document, values l… --- ## [ServiceNow integration with ELK Stack 6.3](https://discuss.elastic.co/t/servicenow-integration-with-elk-stack-6-3/147903)
**Author:** [@bab](https://discuss.elastic.co/u/bab)\ **Replies:** 2\ **Last updated:** [September 10, 2018, 8:29am UTC](https://discuss.elastic.co/t/servicenow-integration-with-elk-stack-6-3/147903 "2018-09-10T08:29:41Z")
Hey, We’re using ELK Stack 6.3 to visualize/analyse different kind of logs in our company. Now, we would need to raise a ticket in ServiceNow if there are any warnings or critical messages in the logs. Is there anyway … --- ## [EsThreadPoolExecutor err](https://discuss.elastic.co/t/esthreadpoolexecutor-err/146464)
**Author:** [@shwesinhan](https://discuss.elastic.co/u/shwesinhan)\ **Replies:** 10\ **Last updated:** [September 10, 2018, 8:09am UTC](https://discuss.elastic.co/t/esthreadpoolexecutor-err/146464 "2018-09-10T08:09:48Z")
hi there! this error i can't solve while using kibana rejected execution of org.elasticsearch.action.search.FetchSearchPhase$1@3f6d8e9e on EsThreadPoolExecutor\[search, queue capacity = 1000, org.elasticsearch.common.u… --- ## [Is this sufficcent hardware to handle 300 to 600 GB daily data volume?](https://discuss.elastic.co/t/is-this-sufficcent-hardware-to-handle-300-to-600-gb-daily-data-volume/147906)
**Author:** [@vikas\_gopal](https://discuss.elastic.co/u/vikas_gopal)\ **Replies:** 0\ **Last updated:** [September 10, 2018, 7:31am UTC](https://discuss.elastic.co/t/is-this-sufficcent-hardware-to-handle-300-to-600-gb-daily-data-volume/147906 "2018-09-10T07:31:48Z")
Hi Experts, I have gone through many posts and blogs related to the hardware recommendation . I am planning to use below architecture to handle 300 GB to 600 GB daily data volume . ES Production cluster Data Type :- T… --- ## [Query to compare between lists](https://discuss.elastic.co/t/query-to-compare-between-lists/147909)
**Author:** [@rakshify](https://discuss.elastic.co/u/rakshify)\ **Replies:** 0\ **Last updated:** [September 10, 2018, 7:37am UTC](https://discuss.elastic.co/t/query-to-compare-between-lists/147909 "2018-09-10T07:37:09Z")
Hi, I need to have a field, say "tags", in indexed document which has a list value. I have the same field in request at query time, "tags", which again has a list value. Could someone please help me with query, and als… --- ## [Error while trying to insert data to elasticsearch using hive elasticsearch storage handler from spark](https://discuss.elastic.co/t/error-while-trying-to-insert-data-to-elasticsearch-using-hive-elasticsearch-storage-handler-from-spark/147902)
**Author:** [@Shiva\_Dorai](https://discuss.elastic.co/u/Shiva_Dorai)\ **Replies:** 0\ **Last updated:** [September 10, 2018, 7:28am UTC](https://discuss.elastic.co/t/error-while-trying-to-insert-data-to-elasticsearch-using-hive-elasticsearch-storage-handler-from-spark/147902 "2018-09-10T07:28:49Z")
I have an hive interface to elasticsearch - CREATE EXTERNAL TABLE IF NOT EXISTS analytics\_metrics\_workflow\_es( workflow\_id string, workflow\_name string) ROW FORMAT SERDE 'org.elasticsearch.hadoop.hive.EsSerD… --- ## [Master not discovered exception is an error while doing Elasticsearch cluster setup](https://discuss.elastic.co/t/master-not-discovered-exception-is-an-error-while-doing-elasticsearch-cluster-setup/147897)
**Author:** [@nageswar](https://discuss.elastic.co/u/nageswar)\ **Replies:** 1\ **Last updated:** [September 10, 2018, 7:14am UTC](https://discuss.elastic.co/t/master-not-discovered-exception-is-an-error-while-doing-elasticsearch-cluster-setup/147897 "2018-09-10T07:14:16Z")
Hi All, while doing Elasticsearch 3 node cluster setup, we are getting below error. Please some help me to resolve this issue. For cluster status, it is giving below error. { "error" : { "root\_cause" : \[ { "type"… --- ## [Using @timestamp field in SQL queries](https://discuss.elastic.co/t/using-timestamp-field-in-sql-queries/147701)
**Author:** [@prwillmot](https://discuss.elastic.co/u/prwillmot)\ **Replies:** 2\ **Last updated:** [September 10, 2018, 7:04am UTC](https://discuss.elastic.co/t/using-timestamp-field-in-sql-queries/147701 "2018-09-10T07:04:36Z")
given a simple sample index, the following works perfectly running from Kibana dev console and includes @timestamp as a column in the output: POST \_xpack/sql?format=txt { "query":"SELECT \* FROM sampleindex LIMIT 10" … --- ## [Nested subquery similar to NOT IN SQL syntax](https://discuss.elastic.co/t/nested-subquery-similar-to-not-in-sql-syntax/147673)
**Author:** [@prwillmot](https://discuss.elastic.co/u/prwillmot)\ **Replies:** 2\ **Last updated:** [September 10, 2018, 6:59am UTC](https://discuss.elastic.co/t/nested-subquery-similar-to-not-in-sql-syntax/147673 "2018-09-10T06:59:47Z")
Am am trying to use ELK stack to monitor status of many 1000s of "terminals" in our environment we have built an index that contains timestamp and terminal\_id (along with other terminal properties) - ingested via filebe… --- ## [Document names in a time stamp scenario](https://discuss.elastic.co/t/document-names-in-a-time-stamp-scenario/147886)
**Author:** [@ecarmona](https://discuss.elastic.co/u/ecarmona)\ **Replies:** 0\ **Last updated:** [September 10, 2018, 6:09am UTC](https://discuss.elastic.co/t/document-names-in-a-time-stamp-scenario/147886 "2018-09-10T06:09:50Z")
Dear All, I hope this message finds you well. I have a question, which would be the best practice to name a document, in the scenario that I'm receiving documents every second? The document structure, came with an stan… --- ## [How to log information of top documents in Elasticsearch](https://discuss.elastic.co/t/how-to-log-information-of-top-documents-in-elasticsearch/147884)
**Author:** [@rainfield](https://discuss.elastic.co/u/rainfield)\ **Replies:** 0\ **Last updated:** [September 10, 2018, 5:37am UTC](https://discuss.elastic.co/t/how-to-log-information-of-top-documents-in-elasticsearch/147884 "2018-09-10T05:37:35Z")
We have an ES based system in which we use a native java plugin to score and rank documents. We need to log some attributes of the documents that are returned to the client for machine learning model training. Is that po… --- ## [Challenge concepts](https://discuss.elastic.co/t/challenge-concepts/147754)
**Author:** [@pmbrull](https://discuss.elastic.co/u/pmbrull)\ **Replies:** 3\ **Last updated:** [September 10, 2018, 5:10am UTC](https://discuss.elastic.co/t/challenge-concepts/147754 "2018-09-10T05:10:04Z")
Hello and thank you for your time, I was wondering if there was something similar to the Metric Keys info. for challenge options to further understand how the workload is actually treated by the DB. https://esrally.rea… --- ## [Recommendation on multi level hierarchial structure with arrays](https://discuss.elastic.co/t/recommendation-on-multi-level-hierarchial-structure-with-arrays/147255)
**Author:** [@rohitgoel](https://discuss.elastic.co/u/rohitgoel)\ **Replies:** 1\ **Last updated:** [September 10, 2018, 4:18am UTC](https://discuss.elastic.co/t/recommendation-on-multi-level-hierarchial-structure-with-arrays/147255 "2018-09-10T04:18:31Z")
I have a complex data structure that I would want to index in Elastic. Its a multi level structure with arrays. What's the best way to model it ? For example, { "Organization": "MyOrg", "Business Units": \[ { "Name… --- ## [Using 2 different data sources to create/update index](https://discuss.elastic.co/t/using-2-different-data-sources-to-create-update-index/146950)
**Author:** [@kumar-pratyaksh](https://discuss.elastic.co/u/kumar-pratyaksh)\ **Replies:** 1\ **Last updated:** [September 10, 2018, 4:13am UTC](https://discuss.elastic.co/t/using-2-different-data-sources-to-create-update-index/146950 "2018-09-10T04:13:08Z")
We are trying to build an index using 2 data sources. Data source A is the actual database where all records are updated regularly. Data source B is a referential database. It contains ids of some elements of data source… --- ## [The query results of Elasticsearch are less than the actual number of data when data in Elasticsearch update every 30s](https://discuss.elastic.co/t/the-query-results-of-elasticsearch-are-less-than-the-actual-number-of-data-when-data-in-elasticsearch-update-every-30s/146621)
**Author:** [@april](https://discuss.elastic.co/u/april)\ **Replies:** 1\ **Last updated:** [September 10, 2018, 4:06am UTC](https://discuss.elastic.co/t/the-query-results-of-elasticsearch-are-less-than-the-actual-number-of-data-when-data-in-elasticsearch-update-every-30s/146621 "2018-09-10T04:06:45Z")
I am trying to use Grafana and display real time data in table. Grafana uses POST to obtain query results from Elasticsearch. While sometimes the number of acquired doc is less than the actual number. After several times… --- ## [Query to get the child documents by using alias](https://discuss.elastic.co/t/query-to-get-the-child-documents-by-using-alias/145589)
**Author:** [@nsrini](https://discuss.elastic.co/u/nsrini)\ **Replies:** 1\ **Last updated:** [September 10, 2018, 3:55am UTC](https://discuss.elastic.co/t/query-to-get-the-child-documents-by-using-alias/145589 "2018-09-10T03:55:16Z")
Hi, I am able to get the child documents by using an index. But not by using an alias. This works: /cms\_articles\_v7/trending\_articles/\_search But this doesn't work: /cms\_articles/trending\_articles/\_search I use AWS… --- ## [Elasticsearch parallel bulk using Python - issue with json](https://discuss.elastic.co/t/elasticsearch-parallel-bulk-using-python-issue-with-json/146026)
**Author:** [@hari\_priya](https://discuss.elastic.co/u/hari_priya)\ **Replies:** 1\ **Last updated:** [September 10, 2018, 3:50am UTC](https://discuss.elastic.co/t/elasticsearch-parallel-bulk-using-python-issue-with-json/146026 "2018-09-10T03:50:31Z")
Hi All - I am a newbie with ELasticsearch and I am encountering strange issue . Specifications: I have a Json file of size: 0.5 GB and I am using python 3.6 , ELasticsearch 6.3 version . I am using parallel bulk cal… --- ## [Index Sorting Nested Fields](https://discuss.elastic.co/t/index-sorting-nested-fields/145965)
**Author:** [@panda2004](https://discuss.elastic.co/u/panda2004)\ **Replies:** 1\ **Last updated:** [September 10, 2018, 3:39am UTC](https://discuss.elastic.co/t/index-sorting-nested-fields/145965 "2018-09-10T03:39:09Z")
Hey all, I wanted to examine the option to use index sort. I did saw the following message here: "An error will be thrown if index sorting is activated on an index that contains nested fields". What does it mean? This… --- ## [Search is slow on single machine cluster](https://discuss.elastic.co/t/search-is-slow-on-single-machine-cluster/145880)
**Author:** [@ashishtiwari1993](https://discuss.elastic.co/u/ashishtiwari1993)\ **Replies:** 1\ **Last updated:** [September 10, 2018, 3:32am UTC](https://discuss.elastic.co/t/search-is-slow-on-single-machine-cluster/145880 "2018-09-10T03:32:19Z")
Hi Team, ES configuration: Heap : 30gb Ram : 128gb Primary shards : 15 replica : 1 index : 1 index size : 200GB version : 6.2.2 single cluster machine, no node I am performing search query on above index. I am … --- ## [Any way to specify fields not to index, but it should be stored](https://discuss.elastic.co/t/any-way-to-specify-fields-not-to-index-but-it-should-be-stored/145693)
**Author:** [@Sangeeth\_Kumar](https://discuss.elastic.co/u/Sangeeth_Kumar)\ **Replies:** 1\ **Last updated:** [September 10, 2018, 3:28am UTC](https://discuss.elastic.co/t/any-way-to-specify-fields-not-to-index-but-it-should-be-stored/145693 "2018-09-10T03:28:21Z")
I have Json data to index into my index. I would like to skip some specific fields like nested\_content before indexing a data. Sample JSON data: { "Name": "Sangeeth", "Cars": "Toyato", "nested\_content": { "object" … --- ## [Netty](https://discuss.elastic.co/t/netty/147772)
**Author:** [@William\_Bell](https://discuss.elastic.co/u/William_Bell)\ **Replies:** 4\ **Last updated:** [September 10, 2018, 2:35am UTC](https://discuss.elastic.co/t/netty/147772 "2018-09-10T02:35:28Z")
We should get Netty upgrades \[netty-4.1.29.Final.tar --- ## [X-pack security for Elasticsearch 6.4 not installed properly](https://discuss.elastic.co/t/x-pack-security-for-elasticsearch-6-4-not-installed-properly/147788)
**Author:** [@Krishna2](https://discuss.elastic.co/u/Krishna2)\ **Replies:** 1\ **Last updated:** [September 10, 2018, 12:31am UTC](https://discuss.elastic.co/t/x-pack-security-for-elasticsearch-6-4-not-installed-properly/147788 "2018-09-10T00:31:16Z")
I. have downloaded and installed. Elasticsearch 6.4 it has x-pack also. When installed x-pack file/jars/directories are in bin folder. when I run. bin/elasticsearch-plugin list etc it did not list anything. Also starte… --- ## [Grouping by proximity to a field in other matches](https://discuss.elastic.co/t/grouping-by-proximity-to-a-field-in-other-matches/147872)
**Author:** [@kalda341](https://discuss.elastic.co/u/kalda341)\ **Replies:** 0\ **Last updated:** [September 9, 2018, 11:42pm UTC](https://discuss.elastic.co/t/grouping-by-proximity-to-a-field-in-other-matches/147872 "2018-09-09T23:42:54Z")
I have an index which contains the content of a presentation, with one document per slide. I am searching for relevant slides with the common terms query, which works quite well. Now I wish to group search results base… --- ## [SOLVED - Error on query for ML Job](https://discuss.elastic.co/t/solved-error-on-query-for-ml-job/147869)
**Author:** [@Wayne\_Taylor](https://discuss.elastic.co/u/Wayne_Taylor)\ **Replies:** 1\ **Last updated:** [September 9, 2018, 11:01pm UTC](https://discuss.elastic.co/t/solved-error-on-query-for-ml-job/147869 "2018-09-09T23:01:43Z")
Hi, I am getting the following error on a single job: Job Validation Error: \[parsing\_exception\] \[query\_string\] unknown token \[START\_OBJECT\] after \[query\], with { line=1 & col=35 } :: {"path":"/usage-\*/\_search","query"… --- ## [Reindex to change analyzer not working](https://discuss.elastic.co/t/reindex-to-change-analyzer-not-working/145411)
**Author:** [@rishabh644](https://discuss.elastic.co/u/rishabh644)\ **Replies:** 1\ **Last updated:** [September 9, 2018, 10:56pm UTC](https://discuss.elastic.co/t/reindex-to-change-analyzer-not-working/145411 "2018-09-09T22:56:09Z")
I have written a piece of code, on top of reindex functionality provided by ElasticSearch. The code takes an alias name and searches for the linked index. Let's say alias name is x then index name is x\_v1. Later it cr… --- ## [Match query](https://discuss.elastic.co/t/match-query/145366)
**Author:** [@amaljose123](https://discuss.elastic.co/u/amaljose123)\ **Replies:** 1\ **Last updated:** [September 9, 2018, 10:53pm UTC](https://discuss.elastic.co/t/match-query/145366 "2018-09-09T22:53:21Z")
is there any limit in the no.of terms i can use in simple match query like "query": { "match": { "sample": "hello world" //is there any limit in the no.of terms i can use here (not considering performance) } } … --- ## [ElasticSearch gives unexpected data when search for string like 23.com](https://discuss.elastic.co/t/elasticsearch-gives-unexpected-data-when-search-for-string-like-23-com/145336)
**Author:** [@Anand2184](https://discuss.elastic.co/u/Anand2184)\ **Replies:** 1\ **Last updated:** [September 9, 2018, 10:51pm UTC](https://discuss.elastic.co/t/elasticsearch-gives-unexpected-data-when-search-for-string-like-23-com/145336 "2018-09-09T22:51:09Z")
Hello, I am pretty new to ElasticSearch. I have a query. My dataset is something like this, 23.com 46.com 23ccom abc.com Now when I try to search the data with query like 23.com, ElasticSearch give all records but… --- ## [Update ELS documents as frequently as relational database](https://discuss.elastic.co/t/update-els-documents-as-frequently-as-relational-database/144737)
**Author:** [@hym](https://discuss.elastic.co/u/hym)\ **Replies:** 1\ **Last updated:** [September 9, 2018, 10:42pm UTC](https://discuss.elastic.co/t/update-els-documents-as-frequently-as-relational-database/144737 "2018-09-09T22:42:25Z")
Hi all, We have a relational main data source for which we established an ELS to leverage its search capabilities. The data stored in RDB frequently needs update. My question is this, to reflect those updates in the EL… [Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1552) [Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1554)