# Elasticsearch **URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=645 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 646 --- ## [Does indices()-\>refresh() wait for the completion of Bulk API?](https://discuss.elastic.co/t/does-indices-refresh-wait-for-the-completion-of-bulk-api/272914)
**Author:** [@Catalin](https://discuss.elastic.co/u/Catalin)\ **Replies:** 1\ **Last updated:** [May 17, 2021, 12:38am UTC](https://discuss.elastic.co/t/does-indices-refresh-wait-for-the-completion-of-bulk-api/272914 "2021-05-17T00:38:12Z")
In order to populate an index I have disabled its refresh\_interval and I'm using the Bulk API for inserting. The problem is I'm doing this in chunks of data and I need that after each chunk all the information is availa… --- ## [Reindex order](https://discuss.elastic.co/t/reindex-order/273114)
**Author:** [@alexs1](https://discuss.elastic.co/u/alexs1)\ **Replies:** 3\ **Last updated:** [May 17, 2021, 12:36am UTC](https://discuss.elastic.co/t/reindex-order/273114 "2021-05-17T00:36:34Z")
Hello, Does the reindex save the original order of the documents? Does the answer the same when using slice? Thank you! --- ## [What happens to snapshots when a new node joins the cluster?](https://discuss.elastic.co/t/what-happens-to-snapshots-when-a-new-node-joins-the-cluster/272907)
**Author:** [@nadler](https://discuss.elastic.co/u/nadler)\ **Replies:** 1\ **Last updated:** [May 17, 2021, 12:36am UTC](https://discuss.elastic.co/t/what-happens-to-snapshots-when-a-new-node-joins-the-cluster/272907 "2021-05-17T00:36:19Z")
Hey all, I am implementing a backup and restore process on our clusters with hdfs and i was wandering what happens when a new node joins the cluster or an old one is replaced with a new machine? Because at first, we ne… --- ## [Secure Elasticsearch with LDAP or Active Directory - questions](https://discuss.elastic.co/t/secure-elasticsearch-with-ldap-or-active-directory-questions/272944)
**Author:** [@d.silwon](https://discuss.elastic.co/u/d.silwon)\ **Replies:** 0\ **Last updated:** [May 13, 2021, 6:43pm UTC](https://discuss.elastic.co/t/secure-elasticsearch-with-ldap-or-active-directory-questions/272944 "2021-05-13T18:43:11Z")
Dears, Who can explain me the differences between two these methods of authentication? Active Directory user authentication vs LDAP user authentication On the base of Elastic documentation I understand that I need t… --- ## [Master nodes metrics](https://discuss.elastic.co/t/master-nodes-metrics/272994)
**Author:** [@Timur\_Makarchuk](https://discuss.elastic.co/u/Timur_Makarchuk)\ **Replies:** 1\ **Last updated:** [May 17, 2021, 12:28am UTC](https://discuss.elastic.co/t/master-nodes-metrics/272994 "2021-05-17T00:28:56Z")
What are some key metrics to monitor master nodes? We currently have a cluster with 30 nodes. We have 3 master-eligible nodes which also serve as data-nodes. I suspect our cluster is oversharded (~1500 shards per node)… --- ## [Index policy or Index template for Elasticsearh](https://discuss.elastic.co/t/index-policy-or-index-template-for-elasticsearh/272931)
**Author:** [@KA3AXCTAH](https://discuss.elastic.co/u/KA3AXCTAH)\ **Replies:** 1\ **Last updated:** [May 16, 2021, 2:00pm UTC](https://discuss.elastic.co/t/index-policy-or-index-template-for-elasticsearh/272931 "2021-05-16T14:00:43Z")
I have elasticsearch cluster for storing logs, and i have indices like this logs-2021.01.01 logs-2021.01.02 logs.2021.01.03 ...etc so indices creates at daily basis, and i have index template for this indices PUT \_ind… --- ## [\[Elasticsearch\] Estimating the duration of a reindex](https://discuss.elastic.co/t/elasticsearch-estimating-the-duration-of-a-reindex/272929)
**Author:** [@daniele.saccon](https://discuss.elastic.co/u/daniele.saccon)\ **Replies:** 1\ **Last updated:** [May 16, 2021, 1:56pm UTC](https://discuss.elastic.co/t/elasticsearch-estimating-the-duration-of-a-reindex/272929 "2021-05-16T13:56:19Z")
Hello everybody, is it possible to estimate the duration of a reindex between one cluster and another? Knowing the total GB and the characteristics of the VMs hosting the Elasticsearchs. Thanks Daniele --- ## [Should ordering of items in BulkRequest and BulkResponse match if java client BulkProcessor is used and requests are retried?](https://discuss.elastic.co/t/should-ordering-of-items-in-bulkrequest-and-bulkresponse-match-if-java-client-bulkprocessor-is-used-and-requests-are-retried/273101)
**Author:** [@Chobicus](https://discuss.elastic.co/u/Chobicus)\ **Replies:** 0\ **Last updated:** [May 16, 2021, 7:58am UTC](https://discuss.elastic.co/t/should-ordering-of-items-in-bulkrequest-and-bulkresponse-match-if-java-client-bulkprocessor-is-used-and-requests-are-retried/273101 "2021-05-16T07:58:35Z")
Based on the code that is used for retrying it seems that the ordering of items in BulkRequest and BulkResponse do not match. e.g. BulkRequest might contain items foo1, foo2, foo3... and the BulkResponse, if retry mechan… --- ## [Integrating elastic search with other application](https://discuss.elastic.co/t/integrating-elastic-search-with-other-application/272919)
**Author:** [@aishwarya\_Varadaraju](https://discuss.elastic.co/u/aishwarya_Varadaraju)\ **Replies:** 2\ **Last updated:** [May 15, 2021, 4:14pm UTC](https://discuss.elastic.co/t/integrating-elastic-search-with-other-application/272919 "2021-05-15T16:14:01Z")
Hi all, I need to integrate elastic search with our application. whatever keyword that I type in my application, that directly as to be searched in the elastic search. but, its giving CORS policy error. --- ## [How many processes can update the same index in parallel?](https://discuss.elastic.co/t/how-many-processes-can-update-the-same-index-in-parallel/273051)
**Author:** [@Dmitry\_Reshetnik](https://discuss.elastic.co/u/Dmitry_Reshetnik)\ **Replies:** 5\ **Last updated:** [May 15, 2021, 1:31pm UTC](https://discuss.elastic.co/t/how-many-processes-can-update-the-same-index-in-parallel/273051 "2021-05-15T13:31:43Z")
I have an index in ES that contains 50-100 fields. I'm getting all those fields from 10-15 different data sources (as partial documents). For each data source I want to configure an indexer process(es) that will update… --- ## [Compare two fields](https://discuss.elastic.co/t/compare-two-fields/273069)
**Author:** [@Gal\_Segal](https://discuss.elastic.co/u/Gal_Segal)\ **Replies:** 1\ **Last updated:** [May 15, 2021, 10:41am UTC](https://discuss.elastic.co/t/compare-two-fields/273069 "2021-05-15T10:41:32Z")
Hi, I am new to elastic and was hoping you can help me. I am using elastic to collect logs from both packetbeat to my 'packetbeat' index, and filebeat to my 'filebeat' index. I have an IP field in both of the indexes … --- ## [Elasticsearch: changing thread\_pool.search.max\_queue\_size on a high load cluster](https://discuss.elastic.co/t/elasticsearch-changing-thread-pool-search-max-queue-size-on-a-high-load-cluster/272980)
**Author:** [@cesar.hernandez.a3se](https://discuss.elastic.co/u/cesar.hernandez.a3se)\ **Replies:** 9\ **Last updated:** [May 14, 2021, 10:51am UTC](https://discuss.elastic.co/t/elasticsearch-changing-thread-pool-search-max-queue-size-on-a-high-load-cluster/272980 "2021-05-14T10:51:57Z")
Hi We have a elasticsearch cluster (version 7.8.1) using 7 nodes, every node with 96 cpu core and 192 GB RAM. During a stress test process, using locust software and simulating 1150 concurrent users, every one run a \_s… --- ## [Automatic Index rollover for elasticsearch oss distribution](https://discuss.elastic.co/t/automatic-index-rollover-for-elasticsearch-oss-distribution/273050)
**Author:** [@aravindpoojari](https://discuss.elastic.co/u/aravindpoojari)\ **Replies:** 1\ **Last updated:** [May 14, 2021, 6:42pm UTC](https://discuss.elastic.co/t/automatic-index-rollover-for-elasticsearch-oss-distribution/273050 "2021-05-14T18:42:53Z")
Hello, I'm new to elasticsearch workflow & we recently startedd moving out of Ali cloud. We are using Aiven's elasticsearch which uses opensource distribution. We would like to have automatic rollover on our indices ho… --- ## [Avoiding Nested Types](https://discuss.elastic.co/t/avoiding-nested-types/272958)
**Author:** [@pcb](https://discuss.elastic.co/u/pcb)\ **Replies:** 4\ **Last updated:** [May 14, 2021, 4:07pm UTC](https://discuss.elastic.co/t/avoiding-nested-types/272958 "2021-05-14T16:07:00Z")
Hi ya, I'm moving data from Postgres to Elasticsearch to use primarily for filtering(faceted), text search over a few fields, sorting, and pagination. Unfortunately, the data is very relational and I'm having trouble co… --- ## [Elasticsearch not able to identify the time field defined in Fluentd](https://discuss.elastic.co/t/elasticsearch-not-able-to-identify-the-time-field-defined-in-fluentd/272594)
**Author:** [@saurabh122](https://discuss.elastic.co/u/saurabh122)\ **Replies:** 6\ **Last updated:** [May 14, 2021, 3:49pm UTC](https://discuss.elastic.co/t/elasticsearch-not-able-to-identify-the-time-field-defined-in-fluentd/272594 "2021-05-14T15:49:40Z")
Issue: I have the logs getting logged into my log file and each log entry has the time information. The time field in the log is not getting recognized in Elasticssearch and hence I am not able to select this time inform… --- ## [Invalid NEST response built from a successful (404) low level call](https://discuss.elastic.co/t/invalid-nest-response-built-from-a-successful-404-low-level-call/273038)
**Author:** [@lbrowne2](https://discuss.elastic.co/u/lbrowne2)\ **Replies:** 0\ **Last updated:** [May 14, 2021, 3:30pm UTC](https://discuss.elastic.co/t/invalid-nest-response-built-from-a-successful-404-low-level-call/273038 "2021-05-14T15:30:17Z")
I am using .Nest version 7.x and I am trying to post information to a remote elasticsearch log bridge. Using the following code: var object\_test= new Dummy\_Object{ Dummy\_String = "dummy\_… --- ## [Disk sizing Snapshot Repository](https://discuss.elastic.co/t/disk-sizing-snapshot-repository/272953)
**Author:** [@Abhishek\_Shinde](https://discuss.elastic.co/u/Abhishek_Shinde)\ **Replies:** 4\ **Last updated:** [May 14, 2021, 2:18pm UTC](https://discuss.elastic.co/t/disk-sizing-snapshot-repository/272953 "2021-05-14T14:18:59Z")
Hello Team, I would need to know, what should be the disk sizing for Snapshot repository w.r.t path.data? --- ## [Wildcard search and trim normalizer behaving strangley together](https://discuss.elastic.co/t/wildcard-search-and-trim-normalizer-behaving-strangley-together/273025)
**Author:** [@alexcassells](https://discuss.elastic.co/u/alexcassells)\ **Replies:** 0\ **Last updated:** [May 14, 2021, 1:43pm UTC](https://discuss.elastic.co/t/wildcard-search-and-trim-normalizer-behaving-strangley-together/273025 "2021-05-14T13:43:51Z")
If a have an index with a trim normalizer and try and use a wildcard search with it, I am seeing behaviour that I would not expect to see // create an index and populate it with a document PUT /test-normalizer-index… --- ## [org.elasticsearch.common.breaker.CircuitBreakingException: \[parent\] Data too large, data for \[\\]](https://discuss.elastic.co/t/org-elasticsearch-common-breaker-circuitbreakingexception-parent-data-too-large-data-for-transport-request/271683)
**Author:** [@Sidharth\_Bhandari](https://discuss.elastic.co/u/Sidharth_Bhandari)\ **Replies:** 2\ **Last updated:** [May 14, 2021, 1:46pm UTC](https://discuss.elastic.co/t/org-elasticsearch-common-breaker-circuitbreakingexception-parent-data-too-large-data-for-transport-request/271683 "2021-05-14T13:46:20Z")
HI , i am getting this error org.elasticsearch.common.breaker.CircuitBreakingException: \[parent\] Data too large, data for \[\\] would be \[5331726724/4.9gb\], which is larger than the limit of \[5067151769/… --- ## [ES 7.7.1 -\> ES 7.12.0 WAND Performance Issue](https://discuss.elastic.co/t/es-7-7-1-es-7-12-0-wand-performance-issue/272854)
**Author:** [@mattweber](https://discuss.elastic.co/u/mattweber)\ **Replies:** 3\ **Last updated:** [May 14, 2021, 1:39pm UTC](https://discuss.elastic.co/t/es-7-7-1-es-7-12-0-wand-performance-issue/272854 "2021-05-14T13:39:54Z")
Hello, I am upgrading an existing cluster from ES 7.7.1 (lucene 8.5.1) to ES 7.12.0 (lucene 8.8.0) and have hit a massive performance regression in basic match queries utilizing minimum should match. I believe this is… --- ## [The results of the stress tests for Bool query combine filter were abnormal](https://discuss.elastic.co/t/the-results-of-the-stress-tests-for-bool-query-combine-filter-were-abnormal/272893)
**Author:** [@Lijian\_Liao](https://discuss.elastic.co/u/Lijian_Liao)\ **Replies:** 2\ **Last updated:** [May 14, 2021, 12:54pm UTC](https://discuss.elastic.co/t/the-results-of-the-stress-tests-for-bool-query-combine-filter-were-abnormal/272893 "2021-05-14T12:54:31Z")
I used rally to do stress tests , and i found one of the result was abnormal.I was confused .The query combined filter 's latency and service time was higher so much than must . I think filter should be more efficien… --- ## [Can a transform recalculate if old documents update their values?](https://discuss.elastic.co/t/can-a-transform-recalculate-if-old-documents-update-their-values/272954)
**Author:** [@marcosvrrs](https://discuss.elastic.co/u/marcosvrrs)\ **Replies:** 3\ **Last updated:** [May 14, 2021, 6:51am UTC](https://discuss.elastic.co/t/can-a-transform-recalculate-if-old-documents-update-their-values/272954 "2021-05-14T06:51:44Z")
Hi all! I have an index that contains millions of documents that have this structure: { id: abc87452 timestamp: 2021-05-13T12:45:13Z client : company\_X value : $ 10000 transaction\_status : authorized } So, I hav… --- ## [GlobalCheckpoint syncer only syncs translog when the translog durability is REQUEST](https://discuss.elastic.co/t/globalcheckpoint-syncer-only-syncs-translog-when-the-translog-durability-is-request/272468)
**Author:** [@asce0705](https://discuss.elastic.co/u/asce0705)\ **Replies:** 2\ **Last updated:** [May 14, 2021, 6:44am UTC](https://discuss.elastic.co/t/globalcheckpoint-syncer-only-syncs-translog-when-the-translog-durability-is-request/272468 "2021-05-14T06:44:15Z")
Elasticsearch version: 7.10 Currently, IndexShard.maybeSyncGlobalCheckpoint is called in two places: In the AsyncGlobalCheckpointTask of IndexService; In the TransportReplicationAction after a write action. In IndexS… --- ## [Insert and Update records in Elasticsearch](https://discuss.elastic.co/t/insert-and-update-records-in-elasticsearch/271459)
**Author:** [@Thamini\_NellaiKumar](https://discuss.elastic.co/u/Thamini_NellaiKumar)\ **Replies:** 6\ **Last updated:** [May 14, 2021, 2:12am UTC](https://discuss.elastic.co/t/insert-and-update-records-in-elasticsearch/271459 "2021-05-14T02:12:22Z")
Hi, I am looping through each record in elasticsearch and inserting the new records and updating the existing records. Say for example, i have a csv file which has 5000 records, only few are updated in the index and the… --- ## [None of the configured nodes are available](https://discuss.elastic.co/t/none-of-the-configured-nodes-are-available/272935)
**Author:** [@111474](https://discuss.elastic.co/u/111474)\ **Replies:** 2\ **Last updated:** [May 14, 2021, 1:39am UTC](https://discuss.elastic.co/t/none-of-the-configured-nodes-are-available/272935 "2021-05-14T01:39:01Z")
I launch spring boot app that should connect with elasticsearch 5.6.1 on macos catalina with globally installed java 14 . Elasticsearch 5.6.1 run as docker container via next command : docker run -d --rm --name elastic… --- ## [Scripted field cannot cast from String to Double](https://discuss.elastic.co/t/scripted-field-cannot-cast-from-string-to-double/272967)
**Author:** [@Matt\_Klaver](https://discuss.elastic.co/u/Matt_Klaver)\ **Replies:** 0\ **Last updated:** [May 13, 2021, 10:42pm UTC](https://discuss.elastic.co/t/scripted-field-cannot-cast-from-string-to-double/272967 "2021-05-13T22:42:38Z")
I'm trying to do some scripting on a field we have... when I preview the results it works fine, but when I go to "Discover" I get the following error: \[class\_cast\_exception\] class\_cast\_exception: Cannot cast from \[java.l… --- ## [Search-ui components using Angular](https://discuss.elastic.co/t/search-ui-components-using-angular/272965)
**Author:** [@ksuren](https://discuss.elastic.co/u/ksuren)\ **Replies:** 0\ **Last updated:** [May 13, 2021, 10:27pm UTC](https://discuss.elastic.co/t/search-ui-components-using-angular/272965 "2021-05-13T22:27:41Z")
How can we build a elastic-ui components using Angular? The docs Libraries for developing modern search experiences | Elastic mention: The underlying library powering Search UI can be used with any JavaScript framework… --- ## [Setting up a multi-nodes cluster on a single machine ( 1 elasticsearch.yml file )](https://discuss.elastic.co/t/setting-up-a-multi-nodes-cluster-on-a-single-machine-1-elasticsearch-yml-file/272286)
**Author:** [@Catalin](https://discuss.elastic.co/u/Catalin)\ **Replies:** 15\ **Last updated:** [May 13, 2021, 9:02pm UTC](https://discuss.elastic.co/t/setting-up-a-multi-nodes-cluster-on-a-single-machine-1-elasticsearch-yml-file/272286 "2021-05-13T21:02:04Z")
I have been using elasticsearch for development on my local machine and managed to setup a 3 nodes cluster by starting each node with the following command: elasticsearch -Epath.data=data1 -Epath.logs=log1 -Enode.name=n… --- ## [HTTP load balancer for dedicated master nodes](https://discuss.elastic.co/t/http-load-balancer-for-dedicated-master-nodes/272947)
**Author:** [@kianm](https://discuss.elastic.co/u/kianm)\ **Replies:** 2\ **Last updated:** [May 13, 2021, 7:31pm UTC](https://discuss.elastic.co/t/http-load-balancer-for-dedicated-master-nodes/272947 "2021-05-13T19:31:30Z")
Hello, I'm creating an Elasticsearch cluster on AWS EC2. I currently have: 1 kibana node 3 dedicated master nodes 5 data nodes These nodes are configured with the discovery-ec2 plugin which is working well. I am co… --- ## [Trying to install elastic search with Msi keep finding the same error when requesting password](https://discuss.elastic.co/t/trying-to-install-elastic-search-with-msi-keep-finding-the-same-error-when-requesting-password/272899)
**Author:** [@Tino23](https://discuss.elastic.co/u/Tino23)\ **Replies:** 0\ **Last updated:** [May 13, 2021, 9:56am UTC](https://discuss.elastic.co/t/trying-to-install-elastic-search-with-msi-keep-finding-the-same-error-when-requesting-password/272899 "2021-05-13T09:56:31Z")
i looked for config file cant find it i downloaded using msi Unexpected response code \[405\] from calling GET http://127.0.0.1:9200/\_security/\_authenticate?pretty It doesn't look like the X-Pack security feature is enab… [Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=644) [Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=646)