# Elasticsearch **URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1604 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1605 --- ## [NEST and Bulk operations of parital Updates (specifically UpdateMany)](https://discuss.elastic.co/t/nest-and-bulk-operations-of-parital-updates-specifically-updatemany/140947)
**Author:** [@cscorley](https://discuss.elastic.co/u/cscorley)\ **Replies:** 5\ **Last updated:** [July 25, 2018, 5:41pm UTC](https://discuss.elastic.co/t/nest-and-bulk-operations-of-parital-updates-specifically-updatemany/140947 "2018-07-25T17:41:28Z")
The current implementation of UpdateMany\ operates on objects of type T instead of type TPartialDocument. This seems wrong to me, following the implementation of Update\, which o… --- ## [How to scroll through the returned aggregated results](https://discuss.elastic.co/t/how-to-scroll-through-the-returned-aggregated-results/141633)
**Author:** [@cool\_arun](https://discuss.elastic.co/u/cool_arun)\ **Replies:** 1\ **Last updated:** [July 25, 2018, 6:35pm UTC](https://discuss.elastic.co/t/how-to-scroll-through-the-returned-aggregated-results/141633 "2018-07-25T18:35:27Z")
hi, is this possible to scroll through the returned aggregation results. --- ## [Elastic Stack out of Memory](https://discuss.elastic.co/t/elastic-stack-out-of-memory/141598)
**Author:** [@adwaitjoshi](https://discuss.elastic.co/u/adwaitjoshi)\ **Replies:** 2\ **Last updated:** [July 25, 2018, 6:35pm UTC](https://discuss.elastic.co/t/elastic-stack-out-of-memory/141598 "2018-07-25T18:35:08Z")
I am having an issue running some kibana reports. It runs out of memory (See below), I started with basic memoryu, upped it to 8GB and now to 16GB. What may be going on? \[2018-07-25T10:02:46,072\]\[ERROR\]\[o.e.x.w.i.s.Exec… --- ## [Loading JSON documents to elasticsearch via es-spark connector](https://discuss.elastic.co/t/loading-json-documents-to-elasticsearch-via-es-spark-connector/141616)
**Author:** [@rkalluri](https://discuss.elastic.co/u/rkalluri)\ **Replies:** 4\ **Last updated:** [July 25, 2018, 6:22pm UTC](https://discuss.elastic.co/t/loading-json-documents-to-elasticsearch-via-es-spark-connector/141616 "2018-07-25T18:22:40Z")
If I have a spark dataframe full of JSON documents with the following schema, does the es-hadoop connector allow indexing them to elastic. scala\> df.printSchema root |-- address: array (nullable = true) | |-- elem… --- ## [Connect timeout when adding a remote node as seed in cross cluster search](https://discuss.elastic.co/t/connect-timeout-when-adding-a-remote-node-as-seed-in-cross-cluster-search/141639)
**Author:** [@Sabith\_T\_H](https://discuss.elastic.co/u/Sabith_T_H)\ **Replies:** 0\ **Last updated:** [July 25, 2018, 5:46pm UTC](https://discuss.elastic.co/t/connect-timeout-when-adding-a-remote-node-as-seed-in-cross-cluster-search/141639 "2018-07-25T17:46:37Z")
I'm trying to setup a cross cluster search. When I try to add a remote node as a seed, I'm getting a connect\_timeout. Error in cross cluster node: \[2018-07-25T23:08:51,936\]\[WARN \]\[o.e.t.RemoteClusterService\] \[qR5I4sH\] … --- ## [Restart improves latencies](https://discuss.elastic.co/t/restart-improves-latencies/139667)
**Author:** [@doron](https://discuss.elastic.co/u/doron)\ **Replies:** 2\ **Last updated:** [July 25, 2018, 5:33pm UTC](https://discuss.elastic.co/t/restart-improves-latencies/139667 "2018-07-25T17:33:33Z")
We've noticed a weird trend with our ES (6.2.4) cluster. After a few weeks of production work, search latencies begin to deteriorate (about X3 slower in the 95%) . However, a full cluster restart brings things back to no… --- ## [Multiple filters on Filter Aggregation](https://discuss.elastic.co/t/multiple-filters-on-filter-aggregation/141613)
**Author:** [@zivari](https://discuss.elastic.co/u/zivari)\ **Replies:** 3\ **Last updated:** [July 25, 2018, 4:02pm UTC](https://discuss.elastic.co/t/multiple-filters-on-filter-aggregation/141613 "2018-07-25T16:02:48Z")
Hey, Using ElasticSearch aggregation to aggregate data on my documents. so the aggregation request looks something like this { "query":{ "bool":{ "filter":\[ { "t… --- ## [6.2.2 cannot run job: datafeed \[XXX\] cannot retrieve field \[@timestamp\] because it has no mappings](https://discuss.elastic.co/t/6-2-2-cannot-run-job-datafeed-xxx-cannot-retrieve-field-timestamp-because-it-has-no-mappings/141475)
**Author:** [@dao](https://discuss.elastic.co/u/dao)\ **Replies:** 2\ **Last updated:** [July 25, 2018, 3:50pm UTC](https://discuss.elastic.co/t/6-2-2-cannot-run-job-datafeed-xxx-cannot-retrieve-field-timestamp-because-it-has-no-mappings/141475 "2018-07-25T15:50:20Z")
I found out that I could not start the job because of this message: cannot run job: datafeed \[XXX\] cannot retrieve field \[@timestamp\] because it has no mappings can you explain why? Regards, Here is my job: { "job\_… --- ## [Collect data from HIVE](https://discuss.elastic.co/t/collect-data-from-hive/141385)
**Author:** [@Divit\_Sharma](https://discuss.elastic.co/u/Divit_Sharma)\ **Replies:** 3\ **Last updated:** [July 25, 2018, 3:24pm UTC](https://discuss.elastic.co/t/collect-data-from-hive/141385 "2018-07-25T15:24:24Z")
I am trying to index data from Hive to ES. I have read the documentation online which basically tells you to first create a external table and then start inserting data into it. Now for inserting data into this table at … --- ## [Fetching Data from Hive tables](https://discuss.elastic.co/t/fetching-data-from-hive-tables/139556)
**Author:** [@Divit\_Sharma](https://discuss.elastic.co/u/Divit_Sharma)\ **Replies:** 1\ **Last updated:** [July 25, 2018, 3:02pm UTC](https://discuss.elastic.co/t/fetching-data-from-hive-tables/139556 "2018-07-25T15:02:12Z")
How to connect to Hive and index data to elasticsearch? --- ## [Infinite bulk-rejection retries via es.batch.write.retry.count = -1](https://discuss.elastic.co/t/infinite-bulk-rejection-retries-via-es-batch-write-retry-count-1/140810)
**Author:** [@sumitsu](https://discuss.elastic.co/u/sumitsu)\ **Replies:** 1\ **Last updated:** [July 25, 2018, 3:00pm UTC](https://discuss.elastic.co/t/infinite-bulk-rejection-retries-via-es-batch-write-retry-count-1/140810 "2018-07-25T15:00:10Z")
The ES-Hadoop configuration documentation states that setting es.batch.write.retry.count to a negative number will direct the ES-Hadoop connector to retry infinitely upon bulk-rejection failures. Could someone advise as … --- ## [Can't add Node to elasticsearch AWS Bitnami stacks](https://discuss.elastic.co/t/cant-add-node-to-elasticsearch-aws-bitnami-stacks/141594)
**Author:** [@Jacox](https://discuss.elastic.co/u/Jacox)\ **Replies:** 2\ **Last updated:** [July 25, 2018, 2:52pm UTC](https://discuss.elastic.co/t/cant-add-node-to-elasticsearch-aws-bitnami-stacks/141594 "2018-07-25T14:52:47Z")
I have problem to add a node to my master node in AWS, the node give me this error \[2018-07-25T15:42:28,163\]\[INFO \]\[o.e.d.z.ZenDiscovery \] \[FANIMAR-LOG\] failed to send join request to master \[{ELK Master}{spOnKZNEQl… --- ## [EsHadoopInvalidRequest: An HTTP line is larger than 4096 bytes](https://discuss.elastic.co/t/eshadoopinvalidrequest-an-http-line-is-larger-than-4096-bytes/136572)
**Author:** [@yoramd](https://discuss.elastic.co/u/yoramd)\ **Replies:** 4\ **Last updated:** [July 25, 2018, 2:51pm UTC](https://discuss.elastic.co/t/eshadoopinvalidrequest-an-http-line-is-larger-than-4096-bytes/136572 "2018-07-25T14:51:16Z")
Hi We're trying to use spark-elasticsearch to load data from an Elasticsearch index into Spark for processing. We load the data using: sparkSession .read .format("es") .option("pushdown", "false") … --- ## [Routing documents dynamically from spark connector](https://discuss.elastic.co/t/routing-documents-dynamically-from-spark-connector/139247)
**Author:** [@rkalluri](https://discuss.elastic.co/u/rkalluri)\ **Replies:** 1\ **Last updated:** [July 25, 2018, 2:47pm UTC](https://discuss.elastic.co/t/routing-documents-dynamically-from-spark-connector/139247 "2018-07-25T14:47:18Z")
I want to be able to do some thing like. PUT my\_index/\_doc/1?routing=user1&refresh=true { "title": "This is a document" } As described in https://www.elastic.co/guide/en/elasticsearch/reference/6.2/mapping-routing-f… --- ## [Date/timestamp fields are indexing as long](https://discuss.elastic.co/t/date-timestamp-fields-are-indexing-as-long/139173)
**Author:** [@pradosh\_gupta](https://discuss.elastic.co/u/pradosh_gupta)\ **Replies:** 1\ **Last updated:** [July 25, 2018, 2:46pm UTC](https://discuss.elastic.co/t/date-timestamp-fields-are-indexing-as-long/139173 "2018-07-25T14:46:02Z")
Hi, I am using Elasticsearch for Apache Hadoop 6.2.0 to index my data to ES using Structured Streaming (spark2.2.0) My data contains one date field and one timestamp field along with other fields. Data is successfully… --- ## [Elastic Search Goes Red](https://discuss.elastic.co/t/elastic-search-goes-red/140037)
**Author:** [@adwaitjoshi](https://discuss.elastic.co/u/adwaitjoshi)\ **Replies:** 5\ **Last updated:** [July 25, 2018, 2:27pm UTC](https://discuss.elastic.co/t/elastic-search-goes-red/140037 "2018-07-25T14:27:52Z")
I have a single node elastic cluster with replication turned off. I have significant amount of data in the system (about 300MM records). When I load my Visualizations they load but are slow. However when I try to open da… --- ## [Search string with special characters](https://discuss.elastic.co/t/search-string-with-special-characters/141576)
**Author:** [@Ayala](https://discuss.elastic.co/u/Ayala)\ **Replies:** 3\ **Last updated:** [July 25, 2018, 2:25pm UTC](https://discuss.elastic.co/t/search-string-with-special-characters/141576 "2018-07-25T14:25:48Z")
Hi, I am using ES 5.1.2. I would like to store emails (or any other string with special characters for that matter), and enable ngram search. For example: Store "carlos.santana.1925@yat.co.tod". Return the document w… --- ## [Order results of date Histogram](https://discuss.elastic.co/t/order-results-of-date-histogram/141591)
**Author:** [@ChrisHck](https://discuss.elastic.co/u/ChrisHck)\ **Replies:** 0\ **Last updated:** [July 25, 2018, 1:52pm UTC](https://discuss.elastic.co/t/order-results-of-date-histogram/141591 "2018-07-25T13:52:30Z")
Hello, is it possible to order the hourly aggregated values (results of a date histogram aggregation)? I wish to order the results based on the value instead of the date. I think that I can not use a histogram aggregati… --- ## [Trouble using NEST](https://discuss.elastic.co/t/trouble-using-nest/141566)
**Author:** [@Jacques\_du\_Plessis](https://discuss.elastic.co/u/Jacques_du_Plessis)\ **Replies:** 0\ **Last updated:** [July 25, 2018, 12:39pm UTC](https://discuss.elastic.co/t/trouble-using-nest/141566 "2018-07-25T12:39:47Z")
I have the following "query" I need to rewrite it using NEST and I can't seem to get it right. PUT company { "settings": { "index": { "analysis": { "filter": {}, "analyzer": { "keyw… --- ## [Elastic search sql parameters](https://discuss.elastic.co/t/elastic-search-sql-parameters/137813)
**Author:** [@bossi6of9](https://discuss.elastic.co/u/bossi6of9)\ **Replies:** 3\ **Last updated:** [July 25, 2018, 1:10pm UTC](https://discuss.elastic.co/t/elastic-search-sql-parameters/137813 "2018-07-25T13:10:43Z")
Hi, I'm trying to connect a BI tool into Elasticsearch 6.3. In order to do so, I need the serviceClass and jdbcDriverClass, but don't see it documented anywhere. Can someone provide it? --- ## [Single node Cross Cluster Search](https://discuss.elastic.co/t/single-node-cross-cluster-search/141574)
**Author:** [@Hari\_Prasad](https://discuss.elastic.co/u/Hari_Prasad)\ **Replies:** 0\ **Last updated:** [July 25, 2018, 1:02pm UTC](https://discuss.elastic.co/t/single-node-cross-cluster-search/141574 "2018-07-25T13:02:41Z")
We are testing out The Elasticsearch cross cluster search Our Setup is 2 ELK+Kafka cluster in docker with each having single nodes of all component, that is Elasticsearch, Logstatsh, Kibana and Kafka. Below is the Dock… --- ## [ML | Event Co-relation and Forecast](https://discuss.elastic.co/t/ml-event-co-relation-and-forecast/140459)
**Author:** [@anmani23](https://discuss.elastic.co/u/anmani23)\ **Replies:** 4\ **Last updated:** [July 25, 2018, 10:45am UTC](https://discuss.elastic.co/t/ml-event-co-relation-and-forecast/140459 "2018-07-25T10:45:51Z")
Hi, I have two sets of Data Set X{a,b,c} & Set Y{A,B,C,D}. I want to take an event(attrib A) from Y identify an pattern(based on attrib a) in X And thus forecast for any possible event in Y in future. I have uploaded… --- ## [ES 6.2.4 What should be done when having "out of sync replica" error](https://discuss.elastic.co/t/es-6-2-4-what-should-be-done-when-having-out-of-sync-replica-error/141197)
**Author:** [@ld\_pvl](https://discuss.elastic.co/u/ld_pvl)\ **Replies:** 3\ **Last updated:** [July 25, 2018, 10:45am UTC](https://discuss.elastic.co/t/es-6-2-4-what-should-be-done-when-having-out-of-sync-replica-error/141197 "2018-07-25T10:45:33Z")
I just hit this issue when trying to close some indexes in the cluster. What are the recommended actions that one should take in order to resolve this problem? I have read this thread Out Of Sync Replica and this threa… --- ## [Cross Cluster Search on Kubernetes problem](https://discuss.elastic.co/t/cross-cluster-search-on-kubernetes-problem/141543)
**Author:** [@kelson.martins](https://discuss.elastic.co/u/kelson.martins)\ **Replies:** 0\ **Last updated:** [July 25, 2018, 10:28am UTC](https://discuss.elastic.co/t/cross-cluster-search-on-kubernetes-problem/141543 "2018-07-25T10:28:50Z")
Hi all, looking into the forum I was not able to find any similar case so here is my issue: I have 2 ELK stacks, each running on 2 different Kubernetes clusters. My goal is to to enable Cross Cluster Search between t… --- ## [Java error](https://discuss.elastic.co/t/java-error/138488)
**Author:** [@jrplus](https://discuss.elastic.co/u/jrplus)\ **Replies:** 14\ **Last updated:** [July 25, 2018, 10:28am UTC](https://discuss.elastic.co/t/java-error/138488 "2018-07-25T10:28:17Z")
Ran into this while executing \\bin\\elasticsearch.bat, anyone encountered the same error?? Picked up \_JAVA\_OPTIONS: -Xmx512M -Xms256M \\Java\\jre1.8.0\_171\\bin\\java.exe" -cp "!ES\_CLASSPATH!" "org.elasticsearch.tools.launc… --- ## [Default value http.content\_content\_length does not restricts ingestion of large documents](https://discuss.elastic.co/t/default-value-http-content-content-length-does-not-restricts-ingestion-of-large-documents/138853)
**Author:** [@sachinkarora](https://discuss.elastic.co/u/sachinkarora)\ **Replies:** 11\ **Last updated:** [July 25, 2018, 9:48am UTC](https://discuss.elastic.co/t/default-value-http-content-content-length-does-not-restricts-ingestion-of-large-documents/138853 "2018-07-25T09:48:25Z")
I am using FSCrawler to perform rich documents (PDF/PPT/DOCX etc.) ingestion into ElasticSearch and while doing some validation to check how much big file i can ingest, i tried ingesting a TXT file of 1GB and 2GB as well… --- ## [How to score by IoU (Intersection over Union)](https://discuss.elastic.co/t/how-to-score-by-iou-intersection-over-union/141529)
**Author:** [@jamminbean](https://discuss.elastic.co/u/jamminbean)\ **Replies:** 0\ **Last updated:** [July 25, 2018, 9:02am UTC](https://discuss.elastic.co/t/how-to-score-by-iou-intersection-over-union/141529 "2018-07-25T09:02:57Z")
Hello! Suppose, I have the following documents: put movies/movie/1 { "title": "Some Romance Movie", "description": \["romance", "comedy", "Sophie Starring", "James Actor", "90's", "New York"\] } put movies/movie/2 … --- ## [How to check some condition through all docs in aggregation](https://discuss.elastic.co/t/how-to-check-some-condition-through-all-docs-in-aggregation/139150)
**Author:** [@\_Sergey](https://discuss.elastic.co/u/_Sergey)\ **Replies:** 15\ **Last updated:** [July 25, 2018, 8:52am UTC](https://discuss.elastic.co/t/how-to-check-some-condition-through-all-docs-in-aggregation/139150 "2018-07-25T08:52:54Z")
Hey ES community! I have a query: (the part of code is below...btw script was taken from visualization in kibana request) "aggs": { "uuid": { "terms": { "field": "device\_uuid", "size":… --- ## [Watcher fails when an external webservice is unreachable](https://discuss.elastic.co/t/watcher-fails-when-an-external-webservice-is-unreachable/141507)
**Author:** [@JeffreyH1989](https://discuss.elastic.co/u/JeffreyH1989)\ **Replies:** 2\ **Last updated:** [July 25, 2018, 8:25am UTC](https://discuss.elastic.co/t/watcher-fails-when-an-external-webservice-is-unreachable/141507 "2018-07-25T08:25:26Z")
Hello, For simple monitoring of our webservices, I'm creating some watchers based on response codes. However, when a service is unreachable (not something like response 404 not found, but an offline server) watcher exe… --- ## [Secure communications?](https://discuss.elastic.co/t/secure-communications/141458)
**Author:** [@Sjaak01](https://discuss.elastic.co/u/Sjaak01)\ **Replies:** 7\ **Last updated:** [July 25, 2018, 8:19am UTC](https://discuss.elastic.co/t/secure-communications/141458 "2018-07-25T08:19:17Z")
Hi, How do I apply ssl/https secure communications on elastic cloud? I have a Kibana instance running on a EC2 instance connecting to a elastic instance in the elastic cloud. kibana.yml on the EC2 instance: elastics… [Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1603) [Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1605)