# Elasticsearch **URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=854 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 855 --- ## [Elastic Rest-Client date format issues](https://discuss.elastic.co/t/elastic-rest-client-date-format-issues/242209)
**Author:** [@Dede\_Pessu](https://discuss.elastic.co/u/Dede_Pessu)\ **Replies:** 1\ **Last updated:** [July 22, 2020, 10:51pm UTC](https://discuss.elastic.co/t/elastic-rest-client-date-format-issues/242209 "2020-07-22T22:51:39Z")
Sending data to elastic search via Rest client from a java application it it is complaining about the date format below is the stack trace that it being spit out. 1. ElasticsearchStatusException\[Elasticsearch excep… --- ## [Setting security for ElasticSearch 7.6.2](https://discuss.elastic.co/t/setting-security-for-elasticsearch-7-6-2/240834)
**Author:** [@zaeemmasood](https://discuss.elastic.co/u/zaeemmasood)\ **Replies:** 2\ **Last updated:** [July 22, 2020, 8:51pm UTC](https://discuss.elastic.co/t/setting-security-for-elasticsearch-7-6-2/240834 "2020-07-22T20:51:02Z")
Hello. I am new to ElasticSearch. I need to make security settings for a elasticsearch cluster with 3 Master nodes and 5 data nodes. I was looking at the video under https://www.youtube.com/watch?v=nMh1HWWe6B4 This v… --- ## [Trouble configuring datastore](https://discuss.elastic.co/t/trouble-configuring-datastore/242206)
**Author:** [@lzukel](https://discuss.elastic.co/u/lzukel)\ **Replies:** 4\ **Last updated:** [July 22, 2020, 2:51pm UTC](https://discuss.elastic.co/t/trouble-configuring-datastore/242206 "2020-07-22T14:51:50Z")
I am unable to use an existing elasticsearch cluster as a datastore. I am unable to find how to disable certificate verification for the datastore, thus the only way I can run rally is to use the in-memory datastore. I … --- ## [Aggregate query on filtered array of objects across documents](https://discuss.elastic.co/t/aggregate-query-on-filtered-array-of-objects-across-documents/242207)
**Author:** [@Aditya\_Anirudh\_T](https://discuss.elastic.co/u/Aditya_Anirudh_T)\ **Replies:** 0\ **Last updated:** [July 22, 2020, 1:57pm UTC](https://discuss.elastic.co/t/aggregate-query-on-filtered-array-of-objects-across-documents/242207 "2020-07-22T13:57:41Z")
Hi all, I want to do a term aggregation on a field inside an array of objects, after filtering the array of objects on two other fields. For example, let's say I have the below documents in my database \[ { … --- ## [Nodos máster como Data](https://discuss.elastic.co/t/nodos-master-como-data/242185)
**Author:** [@Jesus2121](https://discuss.elastic.co/u/Jesus2121)\ **Replies:** 0\ **Last updated:** [July 22, 2020, 12:17pm UTC](https://discuss.elastic.co/t/nodos-master-como-data/242185 "2020-07-22T12:17:39Z")
Buenas. Tengo 4 datas, 2 máster y un nodo de ingesta. ¿Es mejor poner el ingesta que también sea data? o ¿un máster que sea data a la vez? Gracias de antemano --- ## [Discover-gce plugin and old google api libraries](https://discuss.elastic.co/t/discover-gce-plugin-and-old-google-api-libraries/242183)
**Author:** [@Daniel\_S](https://discuss.elastic.co/u/Daniel_S)\ **Replies:** 0\ **Last updated:** [July 22, 2020, 12:06pm UTC](https://discuss.elastic.co/t/discover-gce-plugin-and-old-google-api-libraries/242183 "2020-07-22T12:06:46Z")
Hi! Google is going to deprecate (Aug 12, 2020) for JSON-RPC and global HTTP batch endpoints and their recommendation for clients is to update all Google API Service packages to a version 1.23.1 or higher. Currently, d… --- ## [Remove specific fields from index pattern](https://discuss.elastic.co/t/remove-specific-fields-from-index-pattern/242165)
**Author:** [@sfenman](https://discuss.elastic.co/u/sfenman)\ **Replies:** 1\ **Last updated:** [July 22, 2020, 11:20am UTC](https://discuss.elastic.co/t/remove-specific-fields-from-index-pattern/242165 "2020-07-22T11:20:32Z")
Hello, I am using filebeat to parse my logs to Elasticsearch and after some testing with the dissect processor on ingest pipelines, I created too many random fields by mistake as I have noticed from my index patterns on… --- ## [Aggregation of nearby dense vectors](https://discuss.elastic.co/t/aggregation-of-nearby-dense-vectors/242163)
**Author:** [@JulGor](https://discuss.elastic.co/u/JulGor)\ **Replies:** 0\ **Last updated:** [July 22, 2020, 9:37am UTC](https://discuss.elastic.co/t/aggregation-of-nearby-dense-vectors/242163 "2020-07-22T09:37:49Z")
Hello, Is there any aggregation that group documents in terms of closeness of dense vectors? My documents have the following structure: { "label": "value", "vector": \[1, 0, 3, 0, 0, 0, 18, 0, 0, 0, ...\] # N dimen… --- ## [High Availability with 2 DCs](https://discuss.elastic.co/t/high-availability-with-2-dcs/242159)
**Author:** [@Muttley](https://discuss.elastic.co/u/Muttley)\ **Replies:** 1\ **Last updated:** [July 22, 2020, 9:31am UTC](https://discuss.elastic.co/t/high-availability-with-2-dcs/242159 "2020-07-22T09:31:36Z")
Hi, I am setting up a cluster (or two) The plan is to have nodes in the US and in EU Looking through posts regarding HA I can see 3 ways this is implemented Two clusters, logstash sends to Cluster A, Cluster B uses … --- ## [Failed to index all results after \[N\] attempts. failure in bulk execution](https://discuss.elastic.co/t/failed-to-index-all-results-after-n-attempts-failure-in-bulk-execution/241968)
**Author:** [@AClerk](https://discuss.elastic.co/u/AClerk)\ **Replies:** 3\ **Last updated:** [July 22, 2020, 8:19am UTC](https://discuss.elastic.co/t/failed-to-index-all-results-after-n-attempts-failure-in-bulk-execution/241968 "2020-07-22T08:19:31Z")
Hello All, I see the following error originated by one of the ML jobs Could not find anything related on the www. Any ideas? \[2020-07-21T14:33:29,745\]\[WARN \]\[o.e.x.m.u.p.ResultsPersisterService\] \[NODE3\] \[job-name\] fa… --- ## [Can't run ElasticSearch](https://discuss.elastic.co/t/cant-run-elasticsearch/238842)
**Author:** [@zepp\_e](https://discuss.elastic.co/u/zepp_e)\ **Replies:** 5\ **Last updated:** [July 22, 2020, 8:11am UTC](https://discuss.elastic.co/t/cant-run-elasticsearch/238842 "2020-07-22T08:11:58Z")
Hey guys, I try to install ElasticSearch but when I download it and try to set it up via the command window it looks like the following: '// C:\\Users\\josef\>cd C:\\Program Files\\elasticsearch-7.8.0 C:\\Program Files\\elas… --- ## [Painless scripting](https://discuss.elastic.co/t/painless-scripting/242139)
**Author:** [@richylyq](https://discuss.elastic.co/u/richylyq)\ **Replies:** 2\ **Last updated:** [July 22, 2020, 7:54am UTC](https://discuss.elastic.co/t/painless-scripting/242139 "2020-07-22T07:54:59Z")
Hi, Just to check, i am unable to use another scripted field in the new scripted field that i am trying to create when i want to derive some other information with the scripted field previously created? --- ## [Cannot call \_cluster / \_search API](https://discuss.elastic.co/t/cannot-call-cluster-search-api/241383)
**Author:** [@worapojc](https://discuss.elastic.co/u/worapojc)\ **Replies:** 2\ **Last updated:** [July 22, 2020, 7:39am UTC](https://discuss.elastic.co/t/cannot-call-cluster-search-api/241383 "2020-07-22T07:39:27Z")
Hi, I've Elasticsearch 6.3.2 installed on AWS EC2 and Kibana 6.3.2 installed on on-prem. I can call some ES API from on-prem such as \_cat, \_xpack or \_template. For \_cluster and \_search API, I always get the request ti… --- ## [Create field based on calculated data](https://discuss.elastic.co/t/create-field-based-on-calculated-data/242138)
**Author:** [@Magnuss](https://discuss.elastic.co/u/Magnuss)\ **Replies:** 0\ **Last updated:** [July 22, 2020, 6:32am UTC](https://discuss.elastic.co/t/create-field-based-on-calculated-data/242138 "2020-07-22T06:32:40Z")
Dear reader, I would like to do the following: I get data ingested everyday with the following fields.(example) Day 1 stock: 200 price: 10 Day 2 stock 200 price: 10 Day 1 stock: 200 price: 10 Day 3 stock 190 pric… --- ## [Master node's Elasticsearch sometimes dead while ingested data from filebeat](https://discuss.elastic.co/t/master-nodes-elasticsearch-sometimes-dead-while-ingested-data-from-filebeat/242035)
**Author:** [@Charles\_Yuliansen](https://discuss.elastic.co/u/Charles_Yuliansen)\ **Replies:** 8\ **Last updated:** [July 22, 2020, 6:26am UTC](https://discuss.elastic.co/t/master-nodes-elasticsearch-sometimes-dead-while-ingested-data-from-filebeat/242035 "2020-07-22T06:26:28Z")
I have a cluster with 2 nodes. Master node and data node. Both was fine back then. But it becoming a mess lately, like it is really slow ingesting csv data from filebeat, really slow kibana ui open. These is what it sho… --- ## [Scroll & heap size\\ another memory configuration](https://discuss.elastic.co/t/scroll-heap-size-another-memory-configuration/241732)
**Author:** [@liron\_gofberg](https://discuss.elastic.co/u/liron_gofberg)\ **Replies:** 6\ **Last updated:** [July 22, 2020, 5:57am UTC](https://discuss.elastic.co/t/scroll-heap-size-another-memory-configuration/241732 "2020-07-22T05:57:44Z")
Hi, I want to fetch 50 millions of records into data frame with scan(scroll...) what heap size do I need for that procedure? How can I know what is the right size for me? do I need to configure it only in the master … --- ## [Reboot Hot nodes machine on elasticsearch cluster](https://discuss.elastic.co/t/reboot-hot-nodes-machine-on-elasticsearch-cluster/241481)
**Author:** [@maadhav](https://discuss.elastic.co/u/maadhav)\ **Replies:** 5\ **Last updated:** [July 22, 2020, 5:13am UTC](https://discuss.elastic.co/t/reboot-hot-nodes-machine-on-elasticsearch-cluster/241481 "2020-07-22T05:13:27Z")
Hello Team We have docker based ELK setup with 17 nodes among which 4 nodes are hot nodes. Docker containers for all 4 hot nodes are on the same machine. The machine also contains one hyper node and one kibana docker co… --- ## [High "took" time but low query time](https://discuss.elastic.co/t/high-took-time-but-low-query-time/241668)
**Author:** [@tawik](https://discuss.elastic.co/u/tawik)\ **Replies:** 5\ **Last updated:** [July 22, 2020, 4:20am UTC](https://discuss.elastic.co/t/high-took-time-but-low-query-time/241668 "2020-07-22T04:20:31Z")
Hello, We are trying to identify the source of high latency in our searches to our Elasticsearch cluster. Elasticsearch returns one field called "took" which is the time a request takes within ES (i.e. discounting time … --- ## [Problem when using Elasticsearch and Tesseract-OCR](https://discuss.elastic.co/t/problem-when-using-elasticsearch-and-tesseract-ocr/238770)
**Author:** [@hanguyen.uet](https://discuss.elastic.co/u/hanguyen.uet)\ **Replies:** 14\ **Last updated:** [July 22, 2020, 3:48am UTC](https://discuss.elastic.co/t/problem-when-using-elasticsearch-and-tesseract-ocr/238770 "2020-07-22T03:48:12Z")
Hi everybody! I have a directory containing text data at /opt/data/. When a new file is uploaded to that directory. Is there a way to automatically use tesseract-ocr to convert to another language, then use elasticsearc… --- ## [Elasticsearch put role API](https://discuss.elastic.co/t/elasticsearch-put-role-api/239428)
**Author:** [@Hari\_Prasanth\_Logana](https://discuss.elastic.co/u/Hari_Prasanth_Logana)\ **Replies:** 1\ **Last updated:** [July 22, 2020, 3:47am UTC](https://discuss.elastic.co/t/elasticsearch-put-role-api/239428 "2020-07-22T03:47:20Z")
I started using the create role API and it works as expected: https://www.elastic.co/guide/en/elasticsearch/reference/current/security-api-put-role.html I got the list of default roles in elastic search, /\_security/role … --- ## [Can ingest pipeline or logstash input plugin be configured in linux where log source is from mounted windows dir as nfs partition](https://discuss.elastic.co/t/can-ingest-pipeline-or-logstash-input-plugin-be-configured-in-linux-where-log-source-is-from-mounted-windows-dir-as-nfs-partition/241504)
**Author:** [@text2sky](https://discuss.elastic.co/u/text2sky)\ **Replies:** 2\ **Last updated:** [July 22, 2020, 3:03am UTC](https://discuss.elastic.co/t/can-ingest-pipeline-or-logstash-input-plugin-be-configured-in-linux-where-log-source-is-from-mounted-windows-dir-as-nfs-partition/241504 "2020-07-22T03:03:15Z")
can ingest pipeline or logstash input plugin be configured in linux where log source is from mounted windows dir as nfs partition Setup: logstash/ingest pipeline is running in linux App logs are getting stored in wind… --- ## [How to do script sorting with inner\_hits?](https://discuss.elastic.co/t/how-to-do-script-sorting-with-inner-hits/242129)
**Author:** [@yanlin.liu](https://discuss.elastic.co/u/yanlin.liu)\ **Replies:** 0\ **Last updated:** [July 22, 2020, 2:52am UTC](https://discuss.elastic.co/t/how-to-do-script-sorting-with-inner-hits/242129 "2020-07-22T02:52:09Z")
I have an index with template like this: "properties": { "id": {"type": "long"}, "connections": { "type": "nested", "properties": { "connectionId": {"type": "long"}, "targetId": {"type": "long"}, "archive": {"typ… --- ## [Elasticsearch All Shards failed on cluster with multiple nodes on azure VM](https://discuss.elastic.co/t/elasticsearch-all-shards-failed-on-cluster-with-multiple-nodes-on-azure-vm/241809)
**Author:** [@pranav\_patwardhan](https://discuss.elastic.co/u/pranav_patwardhan)\ **Replies:** 6\ **Last updated:** [July 22, 2020, 2:39am UTC](https://discuss.elastic.co/t/elasticsearch-all-shards-failed-on-cluster-with-multiple-nodes-on-azure-vm/241809 "2020-07-22T02:39:49Z")
I have Elasticsearch cluster with 3 master nodes, 2 data nodes, and cluster node deployed on different Virtual Machine on Azure. It was working fine but suddenly it failed and now \[search\_phase\_execution\_exception\] all s… --- ## [Elasticsearch Installation - “jdk “ ” was unexpected at this time”](https://discuss.elastic.co/t/elasticsearch-installation-jdk-was-unexpected-at-this-time/242102)
**Author:** [@jatin\_w](https://discuss.elastic.co/u/jatin_w)\ **Replies:** 1\ **Last updated:** [July 22, 2020, 12:05am UTC](https://discuss.elastic.co/t/elasticsearch-installation-jdk-was-unexpected-at-this-time/242102 "2020-07-22T00:05:05Z")
Hello team, I am trying to install and configure Elasticsearch on - prem server. And as a prerequisite I have install Java 1.8 (8.02610.12) version But after running command to install Elasticsearch I am getting " “jd… --- ## [Update mappings without having to delete indexes](https://discuss.elastic.co/t/update-mappings-without-having-to-delete-indexes/241870)
**Author:** [@g30](https://discuss.elastic.co/u/g30)\ **Replies:** 3\ **Last updated:** [July 21, 2020, 11:27pm UTC](https://discuss.elastic.co/t/update-mappings-without-having-to-delete-indexes/241870 "2020-07-21T23:27:22Z")
Hi, We are using elastic search for a file storage api implementation where by files are stored with metadata and the metadata is stored to elastic search. We are having issues at the moment where by when we need to add… --- ## [Logstash MySQL to Elasticsearch output does not reflect data in indices](https://discuss.elastic.co/t/logstash-mysql-to-elasticsearch-output-does-not-reflect-data-in-indices/241885)
**Author:** [@profgrammer](https://discuss.elastic.co/u/profgrammer)\ **Replies:** 1\ **Last updated:** [July 21, 2020, 5:57pm UTC](https://discuss.elastic.co/t/logstash-mysql-to-elasticsearch-output-does-not-reflect-data-in-indices/241885 "2020-07-21T17:57:01Z")
I am trying to build search functionality for a website, where there are different assets whose names, descriptions, tags, categories, etc. can be searched for. I am using the AWS elasticsearch service (elasticsearch ver… --- ## [How to get exact unique doc count based on some fields](https://discuss.elastic.co/t/how-to-get-exact-unique-doc-count-based-on-some-fields/241718)
**Author:** [@sandeep\_rana](https://discuss.elastic.co/u/sandeep_rana)\ **Replies:** 7\ **Last updated:** [July 21, 2020, 5:38pm UTC](https://discuss.elastic.co/t/how-to-get-exact-unique-doc-count-based-on-some-fields/241718 "2020-07-21T17:38:53Z")
Any way to find exact unique document count .. based on some fields.. I have also tried cardinality its not working as expected --- ## [Elasticsearch Shard Allocation - ALLOCATION\_FAILED due to apparent disk quota issues, nowhere near max](https://discuss.elastic.co/t/elasticsearch-shard-allocation-allocation-failed-due-to-apparent-disk-quota-issues-nowhere-near-max/242038)
**Author:** [@DougR](https://discuss.elastic.co/u/DougR)\ **Replies:** 1\ **Last updated:** [July 21, 2020, 2:42pm UTC](https://discuss.elastic.co/t/elasticsearch-shard-allocation-allocation-failed-due-to-apparent-disk-quota-issues-nowhere-near-max/242038 "2020-07-21T14:42:37Z")
Environment Elasticsearch 7.8.0 running in EKS EFS filesystem 3 master nodes 5 data nodes 649 total shards TL;DR Receiving ALLOCATION\_FAILED on shards due to apparent disk quota issues, should have more than enough dis… --- ## [Stop words filter works non-deterministically](https://discuss.elastic.co/t/stop-words-filter-works-non-deterministically/242050)
**Author:** [@Ewelina\_Zarebska](https://discuss.elastic.co/u/Ewelina_Zarebska)\ **Replies:** 0\ **Last updated:** [July 21, 2020, 2:42pm UTC](https://discuss.elastic.co/t/stop-words-filter-works-non-deterministically/242050 "2020-07-21T14:42:30Z")
Hi colleagues, I have following filter and custom analyzer: "custom\_address\_stopwords\_filter": { "type": "stop", "stopwords": \[ "po" , "p.o." , "box" , "n\\a" , "n\\a" , "n/a" , "n/a" , "-" , "-----" , "none" , "TBD" \] }… --- ## [How can I allow for fuzziness in a multimatch query for elasticsearch?](https://discuss.elastic.co/t/how-can-i-allow-for-fuzziness-in-a-multimatch-query-for-elasticsearch/242043)
**Author:** [@securisec](https://discuss.elastic.co/u/securisec)\ **Replies:** 0\ **Last updated:** [July 21, 2020, 2:20pm UTC](https://discuss.elastic.co/t/how-can-i-allow-for-fuzziness-in-a-multimatch-query-for-elasticsearch/242043 "2020-07-21T14:20:04Z")
Consider an index containing thousands of flowers and their descriptions in my ES. For example, a redacted json document would look like this: { "name": "rose", "description": "some long description about roses", … [Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=853) [Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=855)