# Elasticsearch **URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1817 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1818 --- ## [Does Elastic Search Spark 6.1.2 connector has Spark streaming sink?](https://discuss.elastic.co/t/does-elastic-search-spark-6-1-2-connector-has-spark-streaming-sink/116748)
**Author:** [@kant\_kodali](https://discuss.elastic.co/u/kant_kodali)\ **Replies:** 2\ **Last updated:** [January 24, 2018, 5:51am UTC](https://discuss.elastic.co/t/does-elastic-search-spark-6-1-2-connector-has-spark-streaming-sink/116748 "2018-01-24T05:51:23Z")
Does Elastic Search Spark 6.1.2 connector has Spark streaming sink? I am using compile group: 'org.elasticsearch', name: 'elasticsearch-hadoop', version: '6.1.2' For example I tried the following and both didn't work. … --- ## [org.apache.lucene.store.AlreadyClosedException - Can this be ignored?](https://discuss.elastic.co/t/org-apache-lucene-store-alreadyclosedexception-can-this-be-ignored/116801)
**Author:** [@Deb](https://discuss.elastic.co/u/Deb)\ **Replies:** 0\ **Last updated:** [January 24, 2018, 5:14am UTC](https://discuss.elastic.co/t/org-apache-lucene-store-alreadyclosedexception-can-this-be-ignored/116801 "2018-01-24T05:14:19Z")
Cross-posting from \[stackoverflow\] (https://stackoverflow.com/questions/48415289/elasticsearch-org-apache-lucene-store-alreadyclosedexception-can-this-be-ign) as I did not get any response there. I am seeing an exceptio… --- ## [Error creating a document with pinyin-plugin in es 6.0.0](https://discuss.elastic.co/t/error-creating-a-document-with-pinyin-plugin-in-es-6-0-0/116788)
**Author:** [@idiotslkp](https://discuss.elastic.co/u/idiotslkp)\ **Replies:** 1\ **Last updated:** [January 24, 2018, 4:10am UTC](https://discuss.elastic.co/t/error-creating-a-document-with-pinyin-plugin-in-es-6-0-0/116788 "2018-01-24T04:10:04Z")
When I use es 6.0.0 creating a document with pinyin-puigin,it will cause error: { "error": { "root\_cause": \[ { "type": "illegal\_argument\_exception", "reason": "startOffset must be non-negative, and endOffset must b… --- ## [Logs are missing in ES](https://discuss.elastic.co/t/logs-are-missing-in-es/116793)
**Author:** [@shwesinhan](https://discuss.elastic.co/u/shwesinhan)\ **Replies:** 0\ **Last updated:** [January 24, 2018, 3:50am UTC](https://discuss.elastic.co/t/logs-are-missing-in-es/116793 "2018-01-24T03:50:36Z")
Hi there! Let me say my scenario first, logstash index from AWS CWL and inject to AWS ES domain. We have application logs stored in Amazon CloudWatch Logs. Eg: Under Test-Log-Group, App1-Log-Stream, App2-Log-Stream, … --- ## [Array data types](https://discuss.elastic.co/t/array-data-types/116791)
**Author:** [@Alexey\_Maykov](https://discuss.elastic.co/u/Alexey_Maykov)\ **Replies:** 0\ **Last updated:** [January 24, 2018, 3:23am UTC](https://discuss.elastic.co/t/array-data-types/116791 "2018-01-24T03:23:21Z")
What is the reasonable upper bound on the number of items on array data type? I have a reasonably loaded cluster which stores 60M documents. If I want to add a list of integer IDs to each document, whats the reasonable… --- ## [Filter Aggregation vs Msearch](https://discuss.elastic.co/t/filter-aggregation-vs-msearch/116581)
**Author:** [@jdgenio](https://discuss.elastic.co/u/jdgenio)\ **Replies:** 3\ **Last updated:** [January 24, 2018, 12:05am UTC](https://discuss.elastic.co/t/filter-aggregation-vs-msearch/116581 "2018-01-24T00:05:00Z")
Hi, we currently use elasticsearch for our backend and have noticed that msearch performs significantly better than a single query with multiple filter aggregations and I'm curious as to why this is so. In a query that … --- ## [How do I update specific fields on the document](https://discuss.elastic.co/t/how-do-i-update-specific-fields-on-the-document/116769)
**Author:** [@Alexey\_Maykov](https://discuss.elastic.co/u/Alexey_Maykov)\ **Replies:** 0\ **Last updated:** [January 23, 2018, 11:08pm UTC](https://discuss.elastic.co/t/how-do-i-update-specific-fields-on-the-document/116769 "2018-01-23T23:08:37Z")
Hello, if I need to update a specific field on a document, what do I do? get a document, update a field, save a document - potential race condition use script - perf issues? Can it do bulk operations Have an external … --- ## [Correlating data across indices](https://discuss.elastic.co/t/correlating-data-across-indices/116755)
**Author:** [@chimbo84](https://discuss.elastic.co/u/chimbo84)\ **Replies:** 0\ **Last updated:** [January 23, 2018, 9:38pm UTC](https://discuss.elastic.co/t/correlating-data-across-indices/116755 "2018-01-23T21:38:02Z")
I know I will probably need the \_msearch API to do this but am having trouble accomplishing my goal. I have two indices (Index1 and Index2) that each have a term I am trying to correlate. Basically, I want to find docu… --- ## [Java High Level REST Client Dependencies](https://discuss.elastic.co/t/java-high-level-rest-client-dependencies/116751)
**Author:** [@Jotschi](https://discuss.elastic.co/u/Jotschi)\ **Replies:** 1\ **Last updated:** [January 23, 2018, 9:24pm UTC](https://discuss.elastic.co/t/java-high-level-rest-client-dependencies/116751 "2018-01-23T21:24:23Z")
I was just surprised by the transitive dependencies of the Java High Level REST Client (v6.1.2) maven artifact. Is there a valid reason why this client is requiring the full ES dependency which includes Lucene etc. This… --- ## ["No space left of device" mitigation plan?](https://discuss.elastic.co/t/no-space-left-of-device-mitigation-plan/116645)
**Author:** [@eugene\_pirogov](https://discuss.elastic.co/u/eugene_pirogov)\ **Replies:** 2\ **Last updated:** [January 23, 2018, 8:47pm UTC](https://discuss.elastic.co/t/no-space-left-of-device-mitigation-plan/116645 "2018-01-23T20:47:16Z")
I have Elasticsearch cluster with two nodes: a two-master setup. It is used to store logs. Suddenly one of the masters went down, and refuses to go up. The logs reveal the following error: Suppressed: java.io.IOExcepti… --- ## [Changing time zone in date fields](https://discuss.elastic.co/t/changing-time-zone-in-date-fields/116739)
**Author:** [@eteuler](https://discuss.elastic.co/u/eteuler)\ **Replies:** 0\ **Last updated:** [January 23, 2018, 7:31pm UTC](https://discuss.elastic.co/t/changing-time-zone-in-date-fields/116739 "2018-01-23T19:31:34Z")
Is it possible, when using Date fields (doc\['field\_name'\].date.hourOfDay, doc\['field\_name'\].date.minuteOfDay, etc.) to have the output be in the EST time zone rather than GMT? --- ## [Multi Get API reference and results order](https://discuss.elastic.co/t/multi-get-api-reference-and-results-order/116689)
**Author:** [@golubev](https://discuss.elastic.co/u/golubev)\ **Replies:** 2\ **Last updated:** [January 23, 2018, 7:25pm UTC](https://discuss.elastic.co/t/multi-get-api-reference-and-results-order/116689 "2018-01-23T19:25:49Z")
Hi! I'm a little bit confused with the Multi Get API. While trying the API I see that it always returns results in the same order as in the ids field of the request body. But in the reference for the API I didn't find an… --- ## [Increase data size in Rally existing tracks](https://discuss.elastic.co/t/increase-data-size-in-rally-existing-tracks/116514)
**Author:** [@Alp1](https://discuss.elastic.co/u/Alp1)\ **Replies:** 2\ **Last updated:** [January 23, 2018, 7:19pm UTC](https://discuss.elastic.co/t/increase-data-size-in-rally-existing-tracks/116514 "2018-01-23T19:19:50Z")
Hi Daniel , I am using Rally's existing tracks to perform benchmarking. I noticed that nyc taxis is the largest track with 4.5GB compressed and 74.3 GB uncompressed docs. I want to test with larger data volume. Is there… --- ## [Yet another "FORBIDDEN/12/index read-only" message](https://discuss.elastic.co/t/yet-another-forbidden-12-index-read-only-message/115772)
**Author:** [@dorj1234](https://discuss.elastic.co/u/dorj1234)\ **Replies:** 4\ **Last updated:** [January 23, 2018, 7:13pm UTC](https://discuss.elastic.co/t/yet-another-forbidden-12-index-read-only-message/115772 "2018-01-23T19:13:54Z")
Yet another message of this type. I read past similar messages but none really help me. This alert pops up in Kibana when I try to create any new index. The hard drive has enough space, this is not the reason. My thou… --- ## [Best indexes design](https://discuss.elastic.co/t/best-indexes-design/116728)
**Author:** [@nux17](https://discuss.elastic.co/u/nux17)\ **Replies:** 0\ **Last updated:** [January 23, 2018, 6:41pm UTC](https://discuss.elastic.co/t/best-indexes-design/116728 "2018-01-23T18:41:02Z")
Hello, I'm building an Elasticsearch service for an IoT application. The purpose of it will be to store different kinds of messages coming from a lot of different devices (hear different sets of fields for each type of … --- ## [Use dfs\_query\_then\_fetch with aggregation](https://discuss.elastic.co/t/use-dfs-query-then-fetch-with-aggregation/115210)
**Author:** [@ankur\_singla](https://discuss.elastic.co/u/ankur_singla)\ **Replies:** 5\ **Last updated:** [January 23, 2018, 6:41pm UTC](https://discuss.elastic.co/t/use-dfs-query-then-fetch-with-aggregation/115210 "2018-01-23T18:41:00Z")
I am trying to use term aggregation with dfs\_query\_then\_fetch in order to get accurate values but still i am not getting accurate count. QUERY: GET demo/\_search?pretty=true&search\_type=dfs\_query\_then\_fetch { "agg… --- ## [What is blocks in \_cluster/state response?](https://discuss.elastic.co/t/what-is-blocks-in-cluster-state-response/116710)
**Author:** [@dhondup](https://discuss.elastic.co/u/dhondup)\ **Replies:** 1\ **Last updated:** [January 23, 2018, 5:55pm UTC](https://discuss.elastic.co/t/what-is-blocks-in-cluster-state-response/116710 "2018-01-23T17:55:40Z")
Can someone please explain what the 'blocks' section of the response in cluster status? # Return only blocks data $ curl -XGET 'http://localhost:9200/\_cluster/state/blocks' The doc does not say what it is. --- ## [Aggregation to take the first result for every unique value of a term](https://discuss.elastic.co/t/aggregation-to-take-the-first-result-for-every-unique-value-of-a-term/116513)
**Author:** [@Thomas\_Millward\_Wrig](https://discuss.elastic.co/u/Thomas_Millward_Wrig)\ **Replies:** 3\ **Last updated:** [January 23, 2018, 6:12pm UTC](https://discuss.elastic.co/t/aggregation-to-take-the-first-result-for-every-unique-value-of-a-term/116513 "2018-01-23T18:12:28Z")
Hey. I have a bunch of documents that set an attribute - "unique\_hash". There will be duplicates based on that hash, and I'm looking to return only the first results for a given value of "unique\_hash", but one for every… --- ## [Using synonyms with built-in analyzers](https://discuss.elastic.co/t/using-synonyms-with-built-in-analyzers/116713)
**Author:** [@sramalin](https://discuss.elastic.co/u/sramalin)\ **Replies:** 2\ **Last updated:** [January 23, 2018, 5:57pm UTC](https://discuss.elastic.co/t/using-synonyms-with-built-in-analyzers/116713 "2018-01-23T17:57:02Z")
All, Is it possible to use synonyms with out defining a custom analyzer. Say i want to index documents using "english" analyzer and supply my synonyms as an array, how can i specify this without using a custom analyzer… --- ## [Painless test on Array length](https://discuss.elastic.co/t/painless-test-on-array-length/116494)
**Author:** [@sgruhier](https://discuss.elastic.co/u/sgruhier)\ **Replies:** 5\ **Last updated:** [January 23, 2018, 5:29pm UTC](https://discuss.elastic.co/t/painless-test-on-array-length/116494 "2018-01-23T17:29:17Z")
Hi, I'm trying to display only documents with more than one value in an array. My naïve approach was to do { "query": { "bool": { "must": { "script": { … --- ## [Hot/Warm Index Allocation Failing due to Other Shard Allocation](https://discuss.elastic.co/t/hot-warm-index-allocation-failing-due-to-other-shard-allocation/116721)
**Author:** [@seth.yes](https://discuss.elastic.co/u/seth.yes)\ **Replies:** 0\ **Last updated:** [January 23, 2018, 5:17pm UTC](https://discuss.elastic.co/t/hot-warm-index-allocation-failing-due-to-other-shard-allocation/116721 "2018-01-23T17:17:08Z")
I have a hot/warm architecture in ES 5.6.2. This architecture is in place for certain high IO indices; primarily Nginx indices. After two days, I use Curator to update the index requirements from: "require"… --- ## [Get the the names of only the closed indices in a cluster using Kibana](https://discuss.elastic.co/t/get-the-the-names-of-only-the-closed-indices-in-a-cluster-using-kibana/116696)
**Author:** [@dhondup](https://discuss.elastic.co/u/dhondup)\ **Replies:** 3\ **Last updated:** [January 23, 2018, 3:25pm UTC](https://discuss.elastic.co/t/get-the-the-names-of-only-the-closed-indices-in-a-cluster-using-kibana/116696 "2018-01-23T15:25:52Z")
I have looked up the Elastic docs, but have not found a clear answer yet. One way to get the names of closed indices was using blocks data, but the indices section of the blocks data return closed indices along with som… --- ## [Connection failed to Elasticsearch: failed to authenticate user](https://discuss.elastic.co/t/connection-failed-to-elasticsearch-failed-to-authenticate-user/116650)
**Author:** [@Rym\_Guerbi\_Michaut](https://discuss.elastic.co/u/Rym_Guerbi_Michaut)\ **Replies:** 6\ **Last updated:** [January 23, 2018, 3:12pm UTC](https://discuss.elastic.co/t/connection-failed-to-elasticsearch-failed-to-authenticate-user/116650 "2018-01-23T15:12:29Z")
Hi there, After installing x-pack for Elasticsearch 6.1 and Logstash and even for Kibana, I'm facing some new problems. I cannot get connected to Elasticsearch. The error generated: \[2018-01-23T11:46:54,606\]\[INFO \]\[o… --- ## [Data directory is still growing after initial index build](https://discuss.elastic.co/t/data-directory-is-still-growing-after-initial-index-build/116075)
**Author:** [@4b3l](https://discuss.elastic.co/u/4b3l)\ **Replies:** 17\ **Last updated:** [January 23, 2018, 3:03pm UTC](https://discuss.elastic.co/t/data-directory-is-still-growing-after-initial-index-build/116075 "2018-01-23T15:03:47Z")
Hi, I have a 3 Node ES Cluster. I have built an index in my new cluster. This took a while to complete. I've noticed that since the index being built, the data directory is still growing and I am not sure why or where … --- ## [2.3.2 Java client : is there any way to throttle an \_msearch request?](https://discuss.elastic.co/t/2-3-2-java-client-is-there-any-way-to-throttle-an-msearch-request/116690)
**Author:** [@mrec](https://discuss.elastic.co/u/mrec)\ **Replies:** 0\ **Last updated:** [January 23, 2018, 2:29pm UTC](https://discuss.elastic.co/t/2-3-2-java-client-is-there-any-way-to-throttle-an-msearch-request/116690 "2018-01-23T14:29:27Z")
The 6.1 docs mention max\_concurrent\_searches, but it's not in the 2.3 docs or in any version of the Java API that I can see. We're looking at supporting potentially-very-large multisearches from users; it's OK for them … --- ## [Two ElasticSeacrch in one machine](https://discuss.elastic.co/t/two-elasticseacrch-in-one-machine/116201)
**Author:** [@davidsoler95](https://discuss.elastic.co/u/davidsoler95)\ **Replies:** 4\ **Last updated:** [January 23, 2018, 12:52pm UTC](https://discuss.elastic.co/t/two-elasticseacrch-in-one-machine/116201 "2018-01-23T12:52:11Z")
Hi, Im tryning to set up two ElasticSearch + Kibana in the same machine to use different version (and different data for purpose tests). I've changed the port of ElasticSearch and Kibana, and the elasticsearch.url in K… --- ## [Es server connect to client，than throw connect timeout](https://discuss.elastic.co/t/es-server-connect-to-client-than-throw-connect-timeout/116627)
**Author:** [@fightingaman](https://discuss.elastic.co/u/fightingaman)\ **Replies:** 3\ **Last updated:** [January 23, 2018, 11:49am UTC](https://discuss.elastic.co/t/es-server-connect-to-client-than-throw-connect-timeout/116627 "2018-01-23T11:49:10Z")
Hi, I have some doubts. problem: I use es-rest client api，than the es-server throw connect timeout. It could be this. I can't imagine why es-server connect to client? Thanks. \[2018-01-18T05:11:15,107\]\[WARN \]\[o.e.h.n… --- ## [How to take backup in elasticsearch 0.90?](https://discuss.elastic.co/t/how-to-take-backup-in-elasticsearch-0-90/116613)
**Author:** [@Chintan\_Joshi](https://discuss.elastic.co/u/Chintan_Joshi)\ **Replies:** 7\ **Last updated:** [January 23, 2018, 11:46am UTC](https://discuss.elastic.co/t/how-to-take-backup-in-elasticsearch-0-90/116613 "2018-01-23T11:46:18Z")
Hello all, I am new to elasticsearch and I don't know how many indices/index is there on my existing server, I have to move elasticsearch along with whole data from one server to another with same version (0.90.13), now … --- ## [Watcher webhook outlook ssl exception](https://discuss.elastic.co/t/watcher-webhook-outlook-ssl-exception/116114)
**Author:** [@AbdulH](https://discuss.elastic.co/u/AbdulH)\ **Replies:** 2\ **Last updated:** [January 23, 2018, 11:44am UTC](https://discuss.elastic.co/t/watcher-webhook-outlook-ssl-exception/116114 "2018-01-23T11:44:39Z")
I've getting the following error trying to configure the Elasticsearch watcher with webhooks to connect to Microsoft Teams: s\_s\_l\_exception:Unrecognized SSL message, plaintext connection? This is my config: "metadata… --- ## [Restore Snapshot in a new Index](https://discuss.elastic.co/t/restore-snapshot-in-a-new-index/116656)
**Author:** [@Shalvin\_Kumar](https://discuss.elastic.co/u/Shalvin_Kumar)\ **Replies:** 0\ **Last updated:** [January 23, 2018, 11:25am UTC](https://discuss.elastic.co/t/restore-snapshot-in-a-new-index/116656 "2018-01-23T11:25:16Z")
Hi Team, Its slightly urgent to get this done. I will detail my problem below: So I had an index named 'tradeflow' where I had created atleast 20 scripted fields to generate few reports required by Business of our orga… [Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1816) [Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1818)