# Elasticsearch **URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1054 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1055 --- ## [Updating dates in Painless](https://discuss.elastic.co/t/updating-dates-in-painless/213784)
**Author:** [@ffknob](https://discuss.elastic.co/u/ffknob)\ **Replies:** 2\ **Last updated:** [January 5, 2020, 9:37pm UTC](https://discuss.elastic.co/t/updating-dates-in-painless/213784 "2020-01-05T21:37:31Z")
Hi there today I was a little bit confused with the documentation about the Painless language. My goal was to use the \_update\_by\_query API to correct the year of some date fields. I was happy to read that... Date field… --- ## [Received message from unsupported version: \[2.0.0\] minimal compatible version is: \[6.8.0\]](https://discuss.elastic.co/t/received-message-from-unsupported-version-2-0-0-minimal-compatible-version-is-6-8-0/211895)
**Author:** [@sg70](https://discuss.elastic.co/u/sg70)\ **Replies:** 8\ **Last updated:** [January 5, 2020, 7:55pm UTC](https://discuss.elastic.co/t/received-message-from-unsupported-version-2-0-0-minimal-compatible-version-is-6-8-0/211895 "2020-01-05T19:55:08Z")
Iam trying to integrate ElasticSearch with Microsoft SQL Server 2016 and I get this error : java.lang.IllegalStateException: Received message from unsupported version: \[2.0.0\] minimal compatible version is: \[6.8.0\] … --- ## [Bytes can be at most 32766 in length](https://discuss.elastic.co/t/bytes-can-be-at-most-32766-in-length/213650)
**Author:** [@alexus](https://discuss.elastic.co/u/alexus)\ **Replies:** 8\ **Last updated:** [January 5, 2020, 6:31pm UTC](https://discuss.elastic.co/t/bytes-can-be-at-most-32766-in-length/213650 "2020-01-05T18:31:14Z")
Hello World! I'm trying to \_reindex one of my indices, yet I'm running into following issue: { "took": 9502, "timed\_out": false, "total": 114143, "updated": 0, "created": 2999, "deleted": 0, "batches": 3,… --- ## [Java Rest Client time cost confusion](https://discuss.elastic.co/t/java-rest-client-time-cost-confusion/213806)
**Author:** [@xyzmonday](https://discuss.elastic.co/u/xyzmonday)\ **Replies:** 0\ **Last updated:** [January 5, 2020, 3:00pm UTC](https://discuss.elastic.co/t/java-rest-client-time-cost-confusion/213806 "2020-01-05T15:00:25Z")
Hi,I have been confused by time cost of Java Rest Client . I use Java Rest Client （6.6.0 vesion）to send requst to ES. Here is my basic config for REST Client: private static final int CONNECT\_TIMEOUT = 10000; private s… --- ## [Elasticsearch 5.6.2 (x-pack) secured cluster with custom plugin : action \[indices:data/read/search\] is unauthorized for user \[\_system\]](https://discuss.elastic.co/t/elasticsearch-5-6-2-x-pack-secured-cluster-with-custom-plugin-action-indices-data-read-search-is-unauthorized-for-user-system/213801)
**Author:** [@cohavisi](https://discuss.elastic.co/u/cohavisi)\ **Replies:** 0\ **Last updated:** [January 5, 2020, 1:45pm UTC](https://discuss.elastic.co/t/elasticsearch-5-6-2-x-pack-secured-cluster-with-custom-plugin-action-indices-data-read-search-is-unauthorized-for-user-system/213801 "2020-01-05T13:45:37Z")
Continuing the discussion from How to get a NodeClient inside a X-Pack plugin?: Hi All, I get the following exception when executing specific operation on my custom plugin. the elasticsearch cluster (5.6.2) is using x… --- ## [Map elasticsearch field to different field](https://discuss.elastic.co/t/map-elasticsearch-field-to-different-field/213799)
**Author:** [@jlevym](https://discuss.elastic.co/u/jlevym)\ **Replies:** 0\ **Last updated:** [January 5, 2020, 12:13pm UTC](https://discuss.elastic.co/t/map-elasticsearch-field-to-different-field/213799 "2020-01-05T12:13:55Z")
I am using two indexes.The first, called lessons1 has a userId field: userId : \< id number\> The second is called users1 and has a userName field: userName: \ and a userId field, userId: \ … --- ## [Pipline with convert processor](https://discuss.elastic.co/t/pipline-with-convert-processor/213718)
**Author:** [@Janga](https://discuss.elastic.co/u/Janga)\ **Replies:** 3\ **Last updated:** [January 5, 2020, 10:24am UTC](https://discuss.elastic.co/t/pipline-with-convert-processor/213718 "2020-01-05T10:24:35Z")
Hi, New to the stuck... I have a relatively nested JSON flowing into elastic. I'm using kibana for visualisation and reports. Some of the fields are number by originating system and nature, but as they converted and … --- ## [How to connect SQL data to elasticsearch without using logstash but something else like apache kafka,and spark](https://discuss.elastic.co/t/how-to-connect-sql-data-to-elasticsearch-without-using-logstash-but-something-else-like-apache-kafka-and-spark/213795)
**Author:** [@joseph\_muchoki](https://discuss.elastic.co/u/joseph_muchoki)\ **Replies:** 2\ **Last updated:** [January 5, 2020, 9:44am UTC](https://discuss.elastic.co/t/how-to-connect-sql-data-to-elasticsearch-without-using-logstash-but-something-else-like-apache-kafka-and-spark/213795 "2020-01-05T09:44:54Z")
i want to connect mysql (relational database) data into elasticsearch without using logstash but instead use message brokers like apache kafka and spark. What is the procedure? am checking most tutorials,they are broken.… --- ## [Elasticsearch memory-bound tasks](https://discuss.elastic.co/t/elasticsearch-memory-bound-tasks/213781)
**Author:** [@aliabbasifard](https://discuss.elastic.co/u/aliabbasifard)\ **Replies:** 1\ **Last updated:** [January 4, 2020, 11:28pm UTC](https://discuss.elastic.co/t/elasticsearch-memory-bound-tasks/213781 "2020-01-04T23:28:37Z")
Hi. I am reading a book about elastic stack 6. This sentence was in the book and i don't understand it. "Elasticsearch primarily has memory-bound tasks which rely on the inverted index. The more data that it can f… --- ## [Unable to enable cluster security](https://discuss.elastic.co/t/unable-to-enable-cluster-security/213741)
**Author:** [@Terran](https://discuss.elastic.co/u/Terran)\ **Replies:** 2\ **Last updated:** [January 4, 2020, 6:23pm UTC](https://discuss.elastic.co/t/unable-to-enable-cluster-security/213741 "2020-01-04T18:23:27Z")
I have am attempting to enable the basic security as provided in the xpack. I stopped ES across the cluster, then added the key xpack.security.enabled to each .yml. When I attempted to restart the services, elasticsear… --- ## [Indices got deleted suddenly](https://discuss.elastic.co/t/indices-got-deleted-suddenly/213767)
**Author:** [@Revanth](https://discuss.elastic.co/u/Revanth)\ **Replies:** 8\ **Last updated:** [January 4, 2020, 9:47am UTC](https://discuss.elastic.co/t/indices-got-deleted-suddenly/213767 "2020-01-04T09:47:46Z")
We have an AWS Managed ES Cluster, and 4 indices in them. Our data was there in all the indices till 31st December, 2019. However, when we returned on 2nd Jan, 2020. We saw all the indices were deleted! This is really te… --- ## [Failed to execute on node \[E1irYLdQQtG6fr91UvCTBQ\] org.elasticsearch.transport.RemoteTransportException:](https://discuss.elastic.co/t/failed-to-execute-on-node-e1iryldqqtg6fr91uvctbq-org-elasticsearch-transport-remotetransportexception/213771)
**Author:** [@abhi\_12](https://discuss.elastic.co/u/abhi_12)\ **Replies:** 0\ **Last updated:** [January 4, 2020, 8:47am UTC](https://discuss.elastic.co/t/failed-to-execute-on-node-e1iryldqqtg6fr91uvctbq-org-elasticsearch-transport-remotetransportexception/213771 "2020-01-04T08:47:11Z")
Please help me out for fix this issue. Getting error on each node. elasticsearch 3 node cluster version: 7.3.2 \[2020-01-04T08:17:28,651\]\[DEBUG\]\[o.e.a.a.c.n.i.TransportNodesInfoAction\] \[hostname\] failed to execute on no… --- ## [Index update](https://discuss.elastic.co/t/index-update/213559)
**Author:** [@volcano](https://discuss.elastic.co/u/volcano)\ **Replies:** 1\ **Last updated:** [January 4, 2020, 1:44am UTC](https://discuss.elastic.co/t/index-update/213559 "2020-01-04T01:44:19Z")
I have this output plugin in Logstash to create elastic search index. output { amazon\_es { hosts =\> \["https://xxxxxxxxxxxxxxxx.es.amazonaws.com/"\] region =\> "ap-southeast-1" index =\> "studentser… --- ## [Issue in new fields](https://discuss.elastic.co/t/issue-in-new-fields/213693)
**Author:** [@volcano](https://discuss.elastic.co/u/volcano)\ **Replies:** 1\ **Last updated:** [January 4, 2020, 1:42am UTC](https://discuss.elastic.co/t/issue-in-new-fields/213693 "2020-01-04T01:42:18Z")
I have added new fields in logstash.conf file by the mutate filter But these new fields are not visible in Kibana index pattern. I have already refreshed Kibana index pattern but still it is not visible. what to look at… --- ## [error\_type=\>LogStash::Outputs::ElasticSearch::HttpClient::Pool::HostUnreachableError, :error=\>"Elasticsearch Unreachable](https://discuss.elastic.co/t/error-type-logstash-hostunreachableerror-error-elasticsearch-unreachable/213702)
**Author:** [@Punithraya](https://discuss.elastic.co/u/Punithraya)\ **Replies:** 1\ **Last updated:** [January 4, 2020, 1:37am UTC](https://discuss.elastic.co/t/error-type-logstash-hostunreachableerror-error-elasticsearch-unreachable/213702 "2020-01-04T01:37:55Z")
Hello Team, We are getting error in logstash file as below, Attempted to resurrect connection to dead ES instance, but got an error. {:url=\>"http://xx.xx.xx.xx:9200/", :error\_type=\>LogStash::Outputs::ElasticSearch::Htt… --- ## [Query search based on condition (Elasticsearch v6.84) - please advice](https://discuss.elastic.co/t/query-search-based-on-condition-elasticsearch-v6-84-please-advice/213611)
**Author:** [@Chetan\_Ramaiah](https://discuss.elastic.co/u/Chetan_Ramaiah)\ **Replies:** 3\ **Last updated:** [January 4, 2020, 1:33am UTC](https://discuss.elastic.co/t/query-search-based-on-condition-elasticsearch-v6-84-please-advice/213611 "2020-01-04T01:33:30Z")
Hi, Searching based on multiple fields such as name, country, company, 30days\_flag, 60days\_flag, 90days\_flag. I am trying to fetch all companies which took part in a survey from the last 30, 60 and 90 days from the spec… --- ## [Elasticsearch 7.5 + ubuntu 18.04 3 nodes clusters problem](https://discuss.elastic.co/t/elasticsearch-7-5-ubuntu-18-04-3-nodes-clusters-problem/213763)
**Author:** [@JTdev](https://discuss.elastic.co/u/JTdev)\ **Replies:** 0\ **Last updated:** [January 4, 2020, 1:25am UTC](https://discuss.elastic.co/t/elasticsearch-7-5-ubuntu-18-04-3-nodes-clusters-problem/213763 "2020-01-04T01:25:52Z")
Hello Need some help. I have set up a 3 nodes clusters (3 ubuntu 18.04 servers (8G, 8G, and 4G)) with elasticsearch 7.5 For unknown reasons even though I think the elasticsearch.yml settings are correct. I can only … --- ## [Match\_all & update\_by\_query & script error!](https://discuss.elastic.co/t/match-all-update-by-query-script-error/213724)
**Author:** [@laoyang360](https://discuss.elastic.co/u/laoyang360)\ **Replies:** 2\ **Last updated:** [January 4, 2020, 12:45am UTC](https://discuss.elastic.co/t/match-all-update-by-query-script-error/213724 "2020-01-04T00:45:34Z")
\# running ok POST products/\_update\_by\_query { "script": { "source": "ctx.\_source.in\_stock++", "lang": "painless" }, "query": { "term": { "name": "LED TV" … --- ## [Query not returning document - mapping issue?](https://discuss.elastic.co/t/query-not-returning-document-mapping-issue/213696)
**Author:** [@jong99](https://discuss.elastic.co/u/jong99)\ **Replies:** 3\ **Last updated:** [January 3, 2020, 7:49pm UTC](https://discuss.elastic.co/t/query-not-returning-document-mapping-issue/213696 "2020-01-03T19:49:06Z")
I'm having problems when querying for a document and my search is not working. It's probably something simple such as an issue with my mapping. The queries below were generated by Kibana but I've simplified below to tr… --- ## [Elasticsearch query for user data overrides](https://discuss.elastic.co/t/elasticsearch-query-for-user-data-overrides/213727)
**Author:** [@Eric\_Bowden](https://discuss.elastic.co/u/Eric_Bowden)\ **Replies:** 1\ **Last updated:** [January 3, 2020, 7:43pm UTC](https://discuss.elastic.co/t/elasticsearch-query-for-user-data-overrides/213727 "2020-01-03T19:43:09Z")
I need to design a query which can support user specific document edits. The document below describes one way to store this data. The document below includes a root document Description property. The root document Des… --- ## [Getting grouped result collectly](https://discuss.elastic.co/t/getting-grouped-result-collectly/213722)
**Author:** [@yuri9163](https://discuss.elastic.co/u/yuri9163)\ **Replies:** 2\ **Last updated:** [January 3, 2020, 7:42pm UTC](https://discuss.elastic.co/t/getting-grouped-result-collectly/213722 "2020-01-03T19:42:33Z")
I have cardinality result 122, but group\_by 0 which supposed to group by same 'global\_fdid' returns only 9 result. I'm expecting 122 result. How can I get entire result? "visit\_count" : { "cardinality" : { … --- ## [Basic Configuration Questions](https://discuss.elastic.co/t/basic-configuration-questions/213731)
**Author:** [@JeezusJuice](https://discuss.elastic.co/u/JeezusJuice)\ **Replies:** 1\ **Last updated:** [January 3, 2020, 6:50pm UTC](https://discuss.elastic.co/t/basic-configuration-questions/213731 "2020-01-03T18:50:42Z")
Hello, This is more broad than Elasticsearch, but I don't see a category for questions about the whole stack. I need to setup a central logging cluster in a relatively small environment. We have about 500 servers that … --- ## [Searching with Dense Vector](https://discuss.elastic.co/t/searching-with-dense-vector/213374)
**Author:** [@Dipanjan\_Nag](https://discuss.elastic.co/u/Dipanjan_Nag)\ **Replies:** 3\ **Last updated:** [January 3, 2020, 5:45pm UTC](https://discuss.elastic.co/t/searching-with-dense-vector/213374 "2020-01-03T17:45:10Z")
Is there a way to apply a query directly to DenseVector e.g. Nearest Neighbors. I understand that a vector field (i.e. Dense or Sparse) is accessible via scoring. But I'm rather curious about true sense vector search lik… --- ## [Sum of document fields with same timestamp](https://discuss.elastic.co/t/sum-of-document-fields-with-same-timestamp/213717)
**Author:** [@irfancnk](https://discuss.elastic.co/u/irfancnk)\ **Replies:** 1\ **Last updated:** [January 3, 2020, 5:16pm UTC](https://discuss.elastic.co/t/sum-of-document-fields-with-same-timestamp/213717 "2020-01-03T17:16:53Z")
Hi, I have a bunch of network throughput document looking exactly like the following. {timestamp: 1578038384.011689, ip1: 192.168.56.1, port1: 5353, ip2: 224.0.0.251, port2: 5353, recv: 14.0, sent: 0.2, total: 14.2} {… --- ## [Cluster recovery inside K8s](https://discuss.elastic.co/t/cluster-recovery-inside-k8s/213641)
**Author:** [@pbecot01](https://discuss.elastic.co/u/pbecot01)\ **Replies:** 5\ **Last updated:** [January 3, 2020, 4:06pm UTC](https://discuss.elastic.co/t/cluster-recovery-inside-k8s/213641 "2020-01-03T16:06:47Z")
Hi all! Spent the last month or so playing with elastic stack for my side project site. Its just a flask/react app with virtually 0 traffic, so nothing particularly fancy, but I like playing with new tech. So am deployin… --- ## [Change Index retention period](https://discuss.elastic.co/t/change-index-retention-period/213468)
**Author:** [@kumar6](https://discuss.elastic.co/u/kumar6)\ **Replies:** 1\ **Last updated:** [January 3, 2020, 4:03pm UTC](https://discuss.elastic.co/t/change-index-retention-period/213468 "2020-01-03T16:03:10Z")
Hi, Currently my indices are stored for 21 days and would like to change it to 7 days. I am not able to find out where to change it. Can you please let me know the steps to change it. I am using AWS managed elastic s… --- ## [Autoscaling ES 7](https://discuss.elastic.co/t/autoscaling-es-7/213575)
**Author:** [@PabloDominico](https://discuss.elastic.co/u/PabloDominico)\ **Replies:** 2\ **Last updated:** [January 3, 2020, 2:56pm UTC](https://discuss.elastic.co/t/autoscaling-es-7/213575 "2020-01-03T14:56:38Z")
Hi, Im looking for a solution to store data for years and ES is prefered for logging indexing searching etc. However i setup a nice cluster but the search is beaing slow, thinking on autoscaling this when the resource … --- ## [Two indexes, one on encrypted fs, one on regular fs](https://discuss.elastic.co/t/two-indexes-one-on-encrypted-fs-one-on-regular-fs/213708)
**Author:** [@justroll](https://discuss.elastic.co/u/justroll)\ **Replies:** 1\ **Last updated:** [January 3, 2020, 1:33pm UTC](https://discuss.elastic.co/t/two-indexes-one-on-encrypted-fs-one-on-regular-fs/213708 "2020-01-03T13:33:59Z")
I'm tring to setup elastisearch for two different purposes, keeping general data that doesn't need encryption, and user sensitive data that needs to be stored in encrypted filesystem. Can you please confirm/correct my c… --- ## [Index Templates tracing](https://discuss.elastic.co/t/index-templates-tracing/213413)
**Author:** [@Ayala](https://discuss.elastic.co/u/Ayala)\ **Replies:** 3\ **Last updated:** [January 3, 2020, 1:29pm UTC](https://discuss.elastic.co/t/index-templates-tracing/213413 "2020-01-03T13:29:43Z")
Is there a way to track which index templates were used/applied for the creation of an index? --- ## [How to cover all conditions when fetch all data with scroll?](https://discuss.elastic.co/t/how-to-cover-all-conditions-when-fetch-all-data-with-scroll/213461)
**Author:** [@riverbuilding](https://discuss.elastic.co/u/riverbuilding)\ **Replies:** 6\ **Last updated:** [January 3, 2020, 12:53pm UTC](https://discuss.elastic.co/t/how-to-cover-all-conditions-when-fetch-all-data-with-scroll/213461 "2020-01-03T12:53:21Z")
based on this discuss: the content I quote below: Short answer: yes, if you have a single shard index (as seems to be in your case) - it is expected behavior, but it can happen even if you have multiple shards. Longer… [Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1053) [Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1055)