# Elasticsearch **URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=865 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 866 --- ## [Unable to connect to AWS Elastic-Search Instance through AWS Spark EMR](https://discuss.elastic.co/t/unable-to-connect-to-aws-elastic-search-instance-through-aws-spark-emr/240483)
**Author:** [@dillibabu.mekala](https://discuss.elastic.co/u/dillibabu.mekala)\ **Replies:** 3\ **Last updated:** [July 10, 2020, 12:00pm UTC](https://discuss.elastic.co/t/unable-to-connect-to-aws-elastic-search-instance-through-aws-spark-emr/240483 "2020-07-10T12:00:01Z")
Hi Team, We have requirement where, we need to load the parquet file from S3 bucket and ingest this data in to the AWS Elastic-Search using Spark (Scala) Job. To Achieve this i have tried in my local system by installi… --- ## [Simultaneously executing multiple queries on Scroll API to fetch Large Data](https://discuss.elastic.co/t/simultaneously-executing-multiple-queries-on-scroll-api-to-fetch-large-data/240649)
**Author:** [@N220](https://discuss.elastic.co/u/N220)\ **Replies:** 16\ **Last updated:** [July 10, 2020, 12:01pm UTC](https://discuss.elastic.co/t/simultaneously-executing-multiple-queries-on-scroll-api-to-fetch-large-data/240649 "2020-07-10T12:01:01Z")
How to fetch large data in parallel from elastic search? Using Scroll API I am able to fetch complete data from elasticsearch. But it is too slow. Takes around 40 seconds to fetch 500000 records. I am trying to use mul… --- ## [How can we get records from elasticsearch with wildcard queries having two keywords?](https://discuss.elastic.co/t/how-can-we-get-records-from-elasticsearch-with-wildcard-queries-having-two-keywords/240641)
**Author:** [@navdeepk](https://discuss.elastic.co/u/navdeepk)\ **Replies:** 2\ **Last updated:** [July 10, 2020, 11:14am UTC](https://discuss.elastic.co/t/how-can-we-get-records-from-elasticsearch-with-wildcard-queries-having-two-keywords/240641 "2020-07-10T11:14:25Z")
using this { "query": { "bool": { "must": \[ { "wildcard": { "url.original":{ "value" : "\*version?" } } } \], "must\_not": , "should": } } … --- ## [Update Mapping after changing parser](https://discuss.elastic.co/t/update-mapping-after-changing-parser/240675)
**Author:** [@shubhamblackstratus](https://discuss.elastic.co/u/shubhamblackstratus)\ **Replies:** 3\ **Last updated:** [July 10, 2020, 10:50am UTC](https://discuss.elastic.co/t/update-mapping-after-changing-parser/240675 "2020-07-10T10:50:07Z")
Hi Guys, I am using custom app parser to get all error logs from my application to Elasticsearch. Due to great number of fields my elasticsearch index burst out with more than 4000 fields. Due to this, kibana also thro… --- ## [How to save elasticsearch date type in spring data?](https://discuss.elastic.co/t/how-to-save-elasticsearch-date-type-in-spring-data/240249)
**Author:** [@kase](https://discuss.elastic.co/u/kase)\ **Replies:** 4\ **Last updated:** [July 10, 2020, 10:30am UTC](https://discuss.elastic.co/t/how-to-save-elasticsearch-date-type-in-spring-data/240249 "2020-07-10T10:30:54Z")
Hi there, I want to use spring data to get elasticsearch documents, but encountered some problems with get data. Here is my code. Entity: @Id private String id; @Field(name = "@timestamp", type = FieldTy… --- ## [Are there any performance impact of using source filtering in elasticsearch or spring data elasticsearch?](https://discuss.elastic.co/t/are-there-any-performance-impact-of-using-source-filtering-in-elasticsearch-or-spring-data-elasticsearch/240671)
**Author:** [@mohsin](https://discuss.elastic.co/u/mohsin)\ **Replies:** 0\ **Last updated:** [July 10, 2020, 9:55am UTC](https://discuss.elastic.co/t/are-there-any-performance-impact-of-using-source-filtering-in-elasticsearch-or-spring-data-elasticsearch/240671 "2020-07-10T09:55:25Z")
We have documents in the range 50k-100k. We are using the ElasticsearchOperations interface of spring-data-elasticsearch and using NativeSearchQueryBuilder()s withSourceFilter(new FetchSourceFilter(includeFields, exclude… --- ## [Question About ELK stack](https://discuss.elastic.co/t/question-about-elk-stack/239771)
**Author:** [@vic22](https://discuss.elastic.co/u/vic22)\ **Replies:** 3\ **Last updated:** [July 10, 2020, 9:39am UTC](https://discuss.elastic.co/t/question-about-elk-stack/239771 "2020-07-10T09:39:55Z")
Hello Everybody ! I would like to know the difference between the X-PACK offered by Elastic Stack (with extra charges) and the application SIEM that can be installed in Kibana ? --- ## [Old stale shards in path.data](https://discuss.elastic.co/t/old-stale-shards-in-path-data/240637)
**Author:** [@asmith](https://discuss.elastic.co/u/asmith)\ **Replies:** 2\ **Last updated:** [July 10, 2020, 9:39am UTC](https://discuss.elastic.co/t/old-stale-shards-in-path-data/240637 "2020-07-10T09:39:39Z")
Hello, I just noticed that we have a massive shard imbalance in our 7.1.0 cluster. I'm assuming it must've happened due to many partial/failed recoveries or similar, and it seems that a lot of data must've just been lef… --- ## [How to start Fscrawler after downloading its Zip file](https://discuss.elastic.co/t/how-to-start-fscrawler-after-downloading-its-zip-file/240584)
**Author:** [@Deepika\_Rawat](https://discuss.elastic.co/u/Deepika_Rawat)\ **Replies:** 6\ **Last updated:** [July 10, 2020, 9:00am UTC](https://discuss.elastic.co/t/how-to-start-fscrawler-after-downloading-its-zip-file/240584 "2020-07-10T09:00:29Z")
I want to read a PDF file through Fscrawler but i just dont know how to start it after downloading it was written that start with bin command but when i explore the folder there was no bin folder List item spacesbeans… --- ## [Locked out of my node, How to run as a service](https://discuss.elastic.co/t/locked-out-of-my-node-how-to-run-as-a-service/240659)
**Author:** [@defalt](https://discuss.elastic.co/u/defalt)\ **Replies:** 0\ **Last updated:** [July 10, 2020, 8:50am UTC](https://discuss.elastic.co/t/locked-out-of-my-node-how-to-run-as-a-service/240659 "2020-07-10T08:50:08Z")
Hi, I am currently trying to run elastic as a windows service. But it fails every time. When I start it from the terminal it connects to the other nodes. When I start it as a service it doesn't connect. Why? But thats … --- ## [Master not discovered or elected yet, an election requires one or more nodes that have already participated as master-eligible nodes in the cluster but this node was not master-eligible the last time it joined the cluster, have discovered](https://discuss.elastic.co/t/master-not-discovered-or-elected-yet-an-election-requires-one-or-more-nodes-that-have-already-participated-as-master-eligible-nodes-in-the-cluster-but-this-node-was-not-master-eligible-the-last-time-it-joined-the-cluster-have-discovered/240416)
**Author:** [@nvelumani](https://discuss.elastic.co/u/nvelumani)\ **Replies:** 9\ **Last updated:** [July 10, 2020, 8:13am UTC](https://discuss.elastic.co/t/master-not-discovered-or-elected-yet-an-election-requires-one-or-more-nodes-that-have-already-participated-as-master-eligible-nodes-in-the-cluster-but-this-node-was-not-master-eligible-the-last-time-it-joined-the-cluster-have-discovered/240416 "2020-07-10T08:13:08Z")
Hello Team, I had Elastic cluster with node1(Master) and node2 with 7.8.0 Elastic and Kibana working Fine on Centos Servers. I had to format node1 so formatted it and installed a fresh Elastic and Kibaka and used the s… --- ## [Field\_data\_type default True](https://discuss.elastic.co/t/field-data-type-default-true/240087)
**Author:** [@vinayborra](https://discuss.elastic.co/u/vinayborra)\ **Replies:** 2\ **Last updated:** [July 10, 2020, 7:01am UTC](https://discuss.elastic.co/t/field-data-type-default-true/240087 "2020-07-10T07:01:38Z")
Hello, Can you tell me how to set default value of field\_datatype is true. Whenever i delete indices in this location Management --\> Index Management --\> indices in kibana. Field\_datatype is changed to false automatica… --- ## [Cannot connect data node to master node](https://discuss.elastic.co/t/cannot-connect-data-node-to-master-node/240594)
**Author:** [@vinci](https://discuss.elastic.co/u/vinci)\ **Replies:** 1\ **Last updated:** [July 9, 2020, 8:24pm UTC](https://discuss.elastic.co/t/cannot-connect-data-node-to-master-node/240594 "2020-07-09T20:24:03Z")
Hello, I'm configuring elasticsearch 7.8.0 directly on Ubuntu 18.04.4 on two hosts, but I have an error which I really don't understand when the data node tries to connect to the master, which keeps repeating over and o… --- ## [Performance impact of multiple BoolQueries](https://discuss.elastic.co/t/performance-impact-of-multiple-boolqueries/240647)
**Author:** [@viswanathk243](https://discuss.elastic.co/u/viswanathk243)\ **Replies:** 1\ **Last updated:** [July 10, 2020, 6:38am UTC](https://discuss.elastic.co/t/performance-impact-of-multiple-boolqueries/240647 "2020-07-10T06:38:53Z")
To my understanding the search queue gets executed sequentially on the Lucene segments, and the search queue length is fixed. Assuming that my previous understand was correct, how does a search request from client trans… --- ## [How many shards should I have in Elasticsearch Node with v7.7?](https://discuss.elastic.co/t/how-many-shards-should-i-have-in-elasticsearch-node-with-v7-7/240452)
**Author:** [@begin](https://discuss.elastic.co/u/begin)\ **Replies:** 6\ **Last updated:** [July 10, 2020, 6:34am UTC](https://discuss.elastic.co/t/how-many-shards-should-i-have-in-elasticsearch-node-with-v7-7/240452 "2020-07-10T06:34:47Z")
Hello, I know, I keep number of shards per node below 20 per GB heap it has configured. https://www.elastic.co/blog/how-many-shards-should-i-have-in-my-elasticsearch-cluster But, I know Elasticsearch heap memory usag… --- ## [Search UI is not suupoting hashing in url](https://discuss.elastic.co/t/search-ui-is-not-suupoting-hashing-in-url/240519)
**Author:** [@ranjeet.tiwari](https://discuss.elastic.co/u/ranjeet.tiwari)\ **Replies:** 5\ **Last updated:** [July 10, 2020, 5:56am UTC](https://discuss.elastic.co/t/search-ui-is-not-suupoting-hashing-in-url/240519 "2020-07-10T05:56:59Z")
We are using search ui library that allows to quickly implement search experience leveraging Elasticsearch. We have used hashing in the url routing (which generate the url like this http://www.example.com/#/Search, it i… --- ## [Unstrucutred data](https://discuss.elastic.co/t/unstrucutred-data/240644)
**Author:** [@kluvi](https://discuss.elastic.co/u/kluvi)\ **Replies:** 1\ **Last updated:** [July 10, 2020, 5:10am UTC](https://discuss.elastic.co/t/unstrucutred-data/240644 "2020-07-10T05:10:57Z")
Hi. We are currently using Elasticsearch as our primary database for some data about products. One document in Elasticsearch is one product, which have some predictable properties (like price, name,...). This products a… --- ## [Elasticsearch: empty slices when using scroll api with slice](https://discuss.elastic.co/t/elasticsearch-empty-slices-when-using-scroll-api-with-slice/239586)
**Author:** [@PierreC](https://discuss.elastic.co/u/PierreC)\ **Replies:** 2\ **Last updated:** [July 10, 2020, 5:00am UTC](https://discuss.elastic.co/t/elasticsearch-empty-slices-when-using-scroll-api-with-slice/239586 "2020-07-10T05:00:01Z")
I have a simple setup with a green cluster (v7.5.2) of 1 instance with 1 index (replica 0) with 8 shards. 61,500 documents indexed. If I create 8 slices with these queries (POST queries) http://localhost:9202/products… --- ## [Remote cluster connected but not listed](https://discuss.elastic.co/t/remote-cluster-connected-but-not-listed/238203)
**Author:** [@Sebastian\_Treu](https://discuss.elastic.co/u/Sebastian_Treu)\ **Replies:** 1\ **Last updated:** [July 10, 2020, 3:14am UTC](https://discuss.elastic.co/t/remote-cluster-connected-but-not-listed/238203 "2020-07-10T03:14:47Z")
Hey there, I'm trying to connect a local cluster (7.8.0) with a remote cluster (7.3.2) where both has secured xpack.security.transport.ssl.enabled=true with the same certificate, key and ca, and both are deployed using d… --- ## [Check if a value of a field has changed in a single query](https://discuss.elastic.co/t/check-if-a-value-of-a-field-has-changed-in-a-single-query/240629)
**Author:** [@ElasticLiver](https://discuss.elastic.co/u/ElasticLiver)\ **Replies:** 0\ **Last updated:** [July 10, 2020, 2:16am UTC](https://discuss.elastic.co/t/check-if-a-value-of-a-field-has-changed-in-a-single-query/240629 "2020-07-10T02:16:07Z")
Hi, Its is posible to check if a value of a field has changed in a single query? Maybe comparing the last value with the actual value? --- ## [Installing elasticsearch for Graylog](https://discuss.elastic.co/t/installing-elasticsearch-for-graylog/240624)
**Author:** [@Morgan\_Hausmann](https://discuss.elastic.co/u/Morgan_Hausmann)\ **Replies:** 0\ **Last updated:** [July 10, 2020, 1:29am UTC](https://discuss.elastic.co/t/installing-elasticsearch-for-graylog/240624 "2020-07-10T01:29:55Z")
Trying to install and start elasticsearch to get Graylog working. I've been following the steps from the link above but for Amazon AMI Linux. Getting this error and I cannot figure out what's going on. --- ## [ML node restart, job recovery](https://discuss.elastic.co/t/ml-node-restart-job-recovery/240441)
**Author:** [@saraKM](https://discuss.elastic.co/u/saraKM)\ **Replies:** 2\ **Last updated:** [July 10, 2020, 1:14am UTC](https://discuss.elastic.co/t/ml-node-restart-job-recovery/240441 "2020-07-10T01:14:00Z")
Hi If all available ML nodes are incidentally restarted and all running jobs go into an open/stopped mode, what would be the recommended way to resume all jobs? I've been able to start the datafeed manually for each sto… --- ## [Query ES API for a Geofence Containing Most Docs](https://discuss.elastic.co/t/query-es-api-for-a-geofence-containing-most-docs/105303)
**Author:** [@seth.yes](https://discuss.elastic.co/u/seth.yes)\ **Replies:** 1\ **Last updated:** [July 9, 2020, 9:35pm UTC](https://discuss.elastic.co/t/query-es-api-for-a-geofence-containing-most-docs/105303 "2020-07-09T21:35:44Z")
ES v5.6.2 I have a use case where I need to determine a geofence containing a large numbers of requests. It would be nice to get any geofence with \>10% of requests, however this ask is flexible depending on what's possi… --- ## [Mount Shared Repository for Snapshot](https://discuss.elastic.co/t/mount-shared-repository-for-snapshot/240563)
**Author:** [@aducSG](https://discuss.elastic.co/u/aducSG)\ **Replies:** 2\ **Last updated:** [July 9, 2020, 9:29pm UTC](https://discuss.elastic.co/t/mount-shared-repository-for-snapshot/240563 "2020-07-09T21:29:38Z")
Hello, I want to use the Snapshot module in order to make backups of my one and only index. I created manually the folder in this location C:\\ProgramData\\Elastic\\Elasticsearch\\Snapshots, and I gave the written and read… --- ## [Is Elasticsearch as a primary database better than Oracle?](https://discuss.elastic.co/t/is-elasticsearch-as-a-primary-database-better-than-oracle/236970)
**Author:** [@liron\_gofberg](https://discuss.elastic.co/u/liron_gofberg)\ **Replies:** 12\ **Last updated:** [July 9, 2020, 5:25pm UTC](https://discuss.elastic.co/t/is-elasticsearch-as-a-primary-database-better-than-oracle/236970 "2020-07-09T17:25:04Z")
Hi, I am a student and my project is about Elastic Stack. the company I work for is currently using oracle for managing its data. they want assess Elasticsearch as a replacement. according to my project success they … --- ## [Data node won't start due to name duplication](https://discuss.elastic.co/t/data-node-wont-start-due-to-name-duplication/240576)
**Author:** [@Ugon](https://discuss.elastic.co/u/Ugon)\ **Replies:** 0\ **Last updated:** [July 9, 2020, 5:21pm UTC](https://discuss.elastic.co/t/data-node-wont-start-due-to-name-duplication/240576 "2020-07-09T17:21:52Z")
Hello, I'm experiencing an error where my elasticsearch (6.7) data nodes won't start due to name duplication. Caused by: java.lang.IllegalStateException: index and alias names need to be unique, but the following d… --- ## [An election requires a node with id\[-zQWNDqiRVe\_EHGtFKi6Zw\], have discovered \[...\] which is not a quorum](https://discuss.elastic.co/t/an-election-requires-a-node-with-id-zqwndqirve-ehgtfki6zw-have-discovered-which-is-not-a-quorum/240537)
**Author:** [@MartiM](https://discuss.elastic.co/u/MartiM)\ **Replies:** 3\ **Last updated:** [July 9, 2020, 4:40pm UTC](https://discuss.elastic.co/t/an-election-requires-a-node-with-id-zqwndqirve-ehgtfki6zw-have-discovered-which-is-not-a-quorum/240537 "2020-07-09T16:40:20Z")
Hi Everybody, We use 2 have to nodes of elasticsearch on the cluster. One of them deleted by a human error. Now we are trying to recover the cluster from one elastic node and trying to add 2 news nodes. Finally the cl… --- ## [Synonym graph on shingles gives error; works with lenient=true](https://discuss.elastic.co/t/synonym-graph-on-shingles-gives-error-works-with-lenient-true/240558)
**Author:** [@chari](https://discuss.elastic.co/u/chari)\ **Replies:** 0\ **Last updated:** [July 9, 2020, 3:53pm UTC](https://discuss.elastic.co/t/synonym-graph-on-shingles-gives-error-works-with-lenient-true/240558 "2020-07-09T15:53:17Z")
I get an error :- RequestError(400, 'illegal\_argument\_exception', 'failed to build synonyms') with the following analyzer, but it works if I set lenient=true. Any insight into why I get an error and if there is any dow… --- ## [Match keywords across multiple fields with fuzzy matching](https://discuss.elastic.co/t/match-keywords-across-multiple-fields-with-fuzzy-matching/240551)
**Author:** [@duncRed](https://discuss.elastic.co/u/duncRed)\ **Replies:** 0\ **Last updated:** [July 9, 2020, 3:24pm UTC](https://discuss.elastic.co/t/match-keywords-across-multiple-fields-with-fuzzy-matching/240551 "2020-07-09T15:24:20Z")
We are looking to match keywords across multiple fields so to do this we looked at the multi\_match query and configuring it with a type of "cross\_fields". This of course works when the search term keywords are spelt cor… --- ## [Connecting two nodes and form cluster](https://discuss.elastic.co/t/connecting-two-nodes-and-form-cluster/240546)
**Author:** [@akhilsai1499](https://discuss.elastic.co/u/akhilsai1499)\ **Replies:** 0\ **Last updated:** [July 9, 2020, 3:14pm UTC](https://discuss.elastic.co/t/connecting-two-nodes-and-form-cluster/240546 "2020-07-09T15:14:06Z")
Hi Elk team. I have two different servers. Let's say. 10.41.23.17 and 10.41.23.18 I moved elastic search tar in two servers or nodes and untarred it. Now I want to connect two servers with each other and for cluster. … [Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=864) [Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=866)