# Elasticsearch **URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=379 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 380 --- ## [Duplicatehandling: Only upload unique documents](https://discuss.elastic.co/t/duplicatehandling-only-upload-unique-documents/313674)
**Author:** [@Clonky](https://discuss.elastic.co/u/Clonky)\ **Replies:** 4\ **Last updated:** [September 6, 2022, 8:38am UTC](https://discuss.elastic.co/t/duplicatehandling-only-upload-unique-documents/313674 "2022-09-06T08:38:16Z")
Hello guys, I have the following situation: I am uploading time sensitive data to Elastic. The folder which gets opened by the parsing and upload script contains all the files which I want to upload. However, in this f… --- ## [Elasticsearch java client for search API not querying all ES Nodes](https://discuss.elastic.co/t/elasticsearch-java-client-for-search-api-not-querying-all-es-nodes/312673)
**Author:** [@pratikshatiwari](https://discuss.elastic.co/u/pratikshatiwari)\ **Replies:** 14\ **Last updated:** [September 6, 2022, 8:23am UTC](https://discuss.elastic.co/t/elasticsearch-java-client-for-search-api-not-querying-all-es-nodes/312673 "2022-09-06T08:23:53Z")
Hello Environment detail - We are having Elasticsearch cluster with version 8.3 with 3 masternode, also we have search API setup with elasticsearch java client to query the data from Elasticsearch using rest client. S… --- ## [How update, update\_by\_query in ES really work?](https://discuss.elastic.co/t/how-update-update-by-query-in-es-really-work/313727)
**Author:** [@robocon20x](https://discuss.elastic.co/u/robocon20x)\ **Replies:** 7\ **Last updated:** [September 6, 2022, 7:35am UTC](https://discuss.elastic.co/t/how-update-update-by-query-in-es-really-work/313727 "2022-09-06T07:35:46Z")
Hi everyone, i'm trying to optimize update speed on my ES and want to know deeper about it's update and update\_by\_query. So I have some question: how update in elasticsearch really word. As I know when I update 1 doc, … --- ## [Adding Snapshot S3 ECK elastic 8.4.1 cause 302 error](https://discuss.elastic.co/t/adding-snapshot-s3-eck-elastic-8-4-1-cause-302-error/313752)
**Author:** [@moscardo](https://discuss.elastic.co/u/moscardo)\ **Replies:** 0\ **Last updated:** [September 6, 2022, 7:21am UTC](https://discuss.elastic.co/t/adding-snapshot-s3-eck-elastic-8-4-1-cause-302-error/313752 "2022-09-06T07:21:01Z")
Hi, I am passing the secrets of the repo to the keystore like: spec: secureSettings: - secretName: s3-secret entries: - key: access-key path: s3.client.default.access\_key - key: secret-key p… --- ## [Yarn es snapshot --license trial Elasticsearch8.5 snapshot for starting Kibana as a developer](https://discuss.elastic.co/t/yarn-es-snapshot-license-trial-elasticsearch8-5-snapshot-for-starting-kibana-as-a-developer/313743)
**Author:** [@Aurangzeb099](https://discuss.elastic.co/u/Aurangzeb099)\ **Replies:** 0\ **Last updated:** [September 6, 2022, 6:29am UTC](https://discuss.elastic.co/t/yarn-es-snapshot-license-trial-elasticsearch8-5-snapshot-for-starting-kibana-as-a-developer/313743 "2022-09-06T06:29:05Z")
To create a custom plugin, not as root I cloned the kibana git hub repo yarn kbn bootstrap ----\> was successful The next step as per the documentation, (Getting started | Kibana Guide \[master\] | Elastic) yarn es sn… --- ## [If there's a way to use scroll\_id in sql?](https://discuss.elastic.co/t/if-theres-a-way-to-use-scroll-id-in-sql/313739)
**Author:** [@Zengweilu](https://discuss.elastic.co/u/Zengweilu)\ **Replies:** 0\ **Last updated:** [September 6, 2022, 6:20am UTC](https://discuss.elastic.co/t/if-theres-a-way-to-use-scroll-id-in-sql/313739 "2022-09-06T06:20:24Z")
How to use scroll query with JDBC SQL --- ## [Elasticsearch G1GC tuning Memory increases continuously](https://discuss.elastic.co/t/elasticsearch-g1gc-tuning-memory-increases-continuously/313689)
**Author:** [@M\_Khaled](https://discuss.elastic.co/u/M_Khaled)\ **Replies:** 5\ **Last updated:** [September 6, 2022, 5:54am UTC](https://discuss.elastic.co/t/elasticsearch-g1gc-tuning-memory-increases-continuously/313689 "2022-09-06T05:54:00Z")
Hi Guys, We are using Elasticsearch 8.2.0 with single node cluster, have added min/max heap as 30GB on a server with 128GB memory. We have around 1TB of index, the memory usage keeps on increasing in few hours and reach… --- ## [Error when setting up data streams](https://discuss.elastic.co/t/error-when-setting-up-data-streams/313420)
**Author:** [@anon90868141](https://discuss.elastic.co/u/anon90868141)\ **Replies:** 2\ **Last updated:** [September 6, 2022, 5:21am UTC](https://discuss.elastic.co/t/error-when-setting-up-data-streams/313420 "2022-09-06T05:21:31Z")
Hello, currently, we're using daily indices for logging events and I want to change that to data streams. I followed the steps out of the elasticsearch engineer course and also from the site "Set up a data stream". Whe… --- ## [How to calculate the estimated size (estimated\_size) of "Parent Circuit Breaker](https://discuss.elastic.co/t/how-to-calculate-the-estimated-size-estimated-size-of-parent-circuit-breaker/313733)
**Author:** [@yusuke.kominami](https://discuss.elastic.co/u/yusuke.kominami)\ **Replies:** 0\ **Last updated:** [September 6, 2022, 5:01am UTC](https://discuss.elastic.co/t/how-to-calculate-the-estimated-size-estimated-size-of-parent-circuit-breaker/313733 "2022-09-06T05:01:28Z")
Currently, \_nodes/stats are in the state attached below. As it is, it is caught in the limit of Parent Ciruit Breaker, which causes a Circuit Break. I would like to know how to deal with this. I am aware that the Pare… --- ## [What difference does it make to add the "\_all": { "enabled": false } to the \_default\_ section rather in the specifiec index\_name section?](https://discuss.elastic.co/t/what-difference-does-it-make-to-add-the-all-enabled-false-to-the-default-section-rather-in-the-specifiec-index-name-section/313571)
**Author:** [@S\_W\_A\_T\_7](https://discuss.elastic.co/u/S_W_A_T_7)\ **Replies:** 1\ **Last updated:** [September 6, 2022, 3:50am UTC](https://discuss.elastic.co/t/what-difference-does-it-make-to-add-the-all-enabled-false-to-the-default-section-rather-in-the-specifiec-index-name-section/313571 "2022-09-06T03:50:30Z")
What difference does it make to add the "\_all": { "enabled": false } to the default section rather in the specifiec index\_name section ? "mappings": { "\_default\_": { "\_all": { "enabled": false … --- ## [Kibana query Error loading gateway out](https://discuss.elastic.co/t/kibana-query-error-loading-gateway-out/313724)
**Author:** [@liucx1201](https://discuss.elastic.co/u/liucx1201)\ **Replies:** 3\ **Last updated:** [September 6, 2022, 3:29am UTC](https://discuss.elastic.co/t/kibana-query-error-loading-gateway-out/313724 "2022-09-06T03:29:22Z")
Recently, cold and hot data wind separation was operated。 Data writing is normal, but query error occurs in the afternoon of the third day An error is reported through kibana query:Kibana query Error loading gateway ou… --- ## [Can somebody share the Documents and templates dump for Splunk to ELK migration?](https://discuss.elastic.co/t/can-somebody-share-the-documents-and-templates-dump-for-splunk-to-elk-migration/313441)
**Author:** [@edwin1](https://discuss.elastic.co/u/edwin1)\ **Replies:** 1\ **Last updated:** [September 6, 2022, 1:56am UTC](https://discuss.elastic.co/t/can-somebody-share-the-documents-and-templates-dump-for-splunk-to-elk-migration/313441 "2022-09-06T01:56:32Z")
I need the standard task list excel/planner/templates and whatever useful documents you have to support Splunk to ELK migration for 10-20 PetaBytes of data. What is the realistic timeline you think it will take. I under… --- ## [Which fields are used for scoring?](https://discuss.elastic.co/t/which-fields-are-used-for-scoring/313365)
**Author:** [@frankmehlhop.com](https://discuss.elastic.co/u/frankmehlhop.com)\ **Replies:** 1\ **Last updated:** [September 6, 2022, 1:49am UTC](https://discuss.elastic.co/t/which-fields-are-used-for-scoring/313365 "2022-09-06T01:49:22Z")
I write doc's into Elastic with different fields. Only certain fields should be used for scoring. Do I need to tell the index while creating it which fields need to be used for scoring or do I include this information… --- ## [What is best node configuration in 3 node](https://discuss.elastic.co/t/what-is-best-node-configuration-in-3-node/313411)
**Author:** [@hyungsun\_lim](https://discuss.elastic.co/u/hyungsun_lim)\ **Replies:** 9\ **Last updated:** [September 6, 2022, 1:35am UTC](https://discuss.elastic.co/t/what-is-best-node-configuration-in-3-node/313411 "2022-09-06T01:35:39Z")
Hello, i have 3 nodes to operate Elasticsearch and Kibana. I have to set role node by node (master? data? ingest?) I heard that node.roles don't need to be configured in small cluster size (smaller than 3 nodes) It me… --- ## [Internal indices list](https://discuss.elastic.co/t/internal-indices-list/313575)
**Author:** [@mruthyu](https://discuss.elastic.co/u/mruthyu)\ **Replies:** 1\ **Last updated:** [September 6, 2022, 1:19am UTC](https://discuss.elastic.co/t/internal-indices-list/313575 "2022-09-06T01:19:30Z")
I am looking for elasticsearch internal indices list. 1) .kibana 2) .security 3) ... 4)... --- ## [How to increase elasticsearch update and skip high load?](https://discuss.elastic.co/t/how-to-increase-elasticsearch-update-and-skip-high-load/313680)
**Author:** [@robocon20x](https://discuss.elastic.co/u/robocon20x)\ **Replies:** 0\ **Last updated:** [September 5, 2022, 12:11pm UTC](https://discuss.elastic.co/t/how-to-increase-elasticsearch-update-and-skip-high-load/313680 "2022-09-05T12:11:08Z")
i am using bulk to update 5m doc to an index. I think i could use update\_by\_query to speed up it. in my case: I have an array of id filed value ( it is unique), and I'm going to use bool query to find all document match … --- ## [Filtering on multiple fields from deep nested object](https://discuss.elastic.co/t/filtering-on-multiple-fields-from-deep-nested-object/313698)
**Author:** [@Ahmed\_EBEN\_HASSINE](https://discuss.elastic.co/u/Ahmed_EBEN_HASSINE)\ **Replies:** 2\ **Last updated:** [September 5, 2022, 5:25pm UTC](https://discuss.elastic.co/t/filtering-on-multiple-fields-from-deep-nested-object/313698 "2022-09-05T17:25:34Z")
I have a complicated object that looks something like this: { "\_type": "\_doc", "\_id": "13", "name": "X", "unitWorkJobRiskWorkingSituations": \[ { unitWork: { "id":… --- ## [Does Elasticsearch lose logs in the event of an unexpected outage?](https://discuss.elastic.co/t/does-elasticsearch-lose-logs-in-the-event-of-an-unexpected-outage/313692)
**Author:** [@its-ogawa](https://discuss.elastic.co/u/its-ogawa)\ **Replies:** 2\ **Last updated:** [September 5, 2022, 5:12pm UTC](https://discuss.elastic.co/t/does-elasticsearch-lose-logs-in-the-event-of-an-unexpected-outage/313692 "2022-09-05T17:12:55Z")
I use Filebeat, Logstash, and Elasticsearch to collect logs. If a server with Elasticsearch and Logstash set up goes down unexpectedly, what happens to the logs sent by Filebeat? Will I lose them? If the server on whic… --- ## [Nested SQL Query or Join within an index](https://discuss.elastic.co/t/nested-sql-query-or-join-within-an-index/312207)
**Author:** [@geethajini](https://discuss.elastic.co/u/geethajini)\ **Replies:** 0\ **Last updated:** [August 16, 2022, 5:29pm UTC](https://discuss.elastic.co/t/nested-sql-query-or-join-within-an-index/312207 "2022-08-16T17:29:52Z")
Hi All, I couldn't create a visualization/report for the following scenario in Kibana. We have docs added to an Index as given below. Here one batch (in example below: 20220809.000018), can have many fields like Suppli… --- ## [ECK architecture](https://discuss.elastic.co/t/eck-architecture/313679)
**Author:** [@adityaPsl](https://discuss.elastic.co/u/adityaPsl)\ **Replies:** 1\ **Last updated:** [September 5, 2022, 2:28pm UTC](https://discuss.elastic.co/t/eck-architecture/313679 "2022-09-05T14:28:42Z")
Hello Team, I was reading through the ECK. just couple of queries regarding master node and adding new data nodes. When we configure number of master nodes , lets say 3 that means 3 master eligible nodes and only one… --- ## [Elastic search Kotlin Function score query](https://discuss.elastic.co/t/elastic-search-kotlin-function-score-query/313684)
**Author:** [@Meir\_Levi](https://discuss.elastic.co/u/Meir_Levi)\ **Replies:** 1\ **Last updated:** [September 5, 2022, 2:22pm UTC](https://discuss.elastic.co/t/elastic-search-kotlin-function-score-query/313684 "2022-09-05T14:22:17Z")
Hey I'm using kotlin and I want to write a code that run this query: { "query": { "function\_score": { "query": { "match\_all": {} }, "functions": \[ { "random\_score": { … --- ## [mTLS under basic license](https://discuss.elastic.co/t/mtls-under-basic-license/313375)
**Author:** [@Rohit\_Shrivastava](https://discuss.elastic.co/u/Rohit_Shrivastava)\ **Replies:** 10\ **Last updated:** [September 5, 2022, 2:09pm UTC](https://discuss.elastic.co/t/mtls-under-basic-license/313375 "2022-09-05T14:09:29Z")
Hi I am trying to setup mTLS and using basic license. However not able to understand how should I grant access to kibana CN? My goal is to create cert for kibana and use mTLS between elasticsearch and kibana. But for t… --- ## [Can not bulk update with script on index have mapping strict dynamic?](https://discuss.elastic.co/t/can-not-bulk-update-with-script-on-index-have-mapping-strict-dynamic/313132)
**Author:** [@robocon20x](https://discuss.elastic.co/u/robocon20x)\ **Replies:** 4\ **Last updated:** [September 5, 2022, 11:32am UTC](https://discuss.elastic.co/t/can-not-bulk-update-with-script-on-index-have-mapping-strict-dynamic/313132 "2022-09-05T11:32:04Z")
Hi guys, i use bulk request with Http to ES, but the error strict\_dynamic\_mapping\_exception has appear. this error not happening when I use bulk request with index have no dynamic\_strict. in my case, bulk reques… --- ## [ElasticSearch Strange behavior](https://discuss.elastic.co/t/elasticsearch-strange-behavior/313650)
**Author:** [@lcui\_dxc](https://discuss.elastic.co/u/lcui_dxc)\ **Replies:** 1\ **Last updated:** [September 5, 2022, 9:10am UTC](https://discuss.elastic.co/t/elasticsearch-strange-behavior/313650 "2022-09-05T09:10:28Z")
Hello there: I use ELK v8.3.3, it worked fine without x-park. I activated x-pack and configured Elasticsearch by adding the following initially pack.security.enabled: true xpack.security.http.ssl.enabled: true xpack.… --- ## [Reason for brief cluster status RED](https://discuss.elastic.co/t/reason-for-brief-cluster-status-red/311719)
**Author:** [@nisow95612](https://discuss.elastic.co/u/nisow95612)\ **Replies:** 1\ **Last updated:** [September 5, 2022, 7:32am UTC](https://discuss.elastic.co/t/reason-for-brief-cluster-status-red/311719 "2022-09-05T07:32:43Z")
From time to time I see Cluster health API | Elasticsearch Guide \[8.3\] | Elastic return "status": "red" for a few seconds. This never lasts long, so simply running Cluster allocation explain API | Elasticsearch Guide \[8.… --- ## [Upgrade elk started with docker-compose](https://discuss.elastic.co/t/upgrade-elk-started-with-docker-compose/313259)
**Author:** [@mammodde](https://discuss.elastic.co/u/mammodde)\ **Replies:** 4\ **Last updated:** [September 5, 2022, 6:27am UTC](https://discuss.elastic.co/t/upgrade-elk-started-with-docker-compose/313259 "2022-09-05T06:27:59Z")
Hi, here is my docker-compose.yml version: "2.2" services: setup: image: docker.elastic.co/elasticsearch/elasticsearch:${STACK\_VERSION} volumes: - certs:/usr/share/elasticsearch/config/certs user: "… --- ## [Elastic Enterprise Edition License](https://discuss.elastic.co/t/elastic-enterprise-edition-license/312975)
**Author:** [@MaralErdene\_Tumursuh](https://discuss.elastic.co/u/MaralErdene_Tumursuh)\ **Replies:** 3\ **Last updated:** [September 5, 2022, 5:49am UTC](https://discuss.elastic.co/t/elastic-enterprise-edition-license/312975 "2022-09-05T05:49:48Z")
Hello Dears, I installed and used elastic enterprise search with kibana. But today when i access to kibana server it displays {"statusCode":503,"error":"Service Unavailable","message":"License is not available."}. I th… --- ## [Need help adjusting elastic settings](https://discuss.elastic.co/t/need-help-adjusting-elastic-settings/313630)
**Author:** [@vortex\_444](https://discuss.elastic.co/u/vortex_444)\ **Replies:** 0\ **Last updated:** [September 4, 2022, 8:10pm UTC](https://discuss.elastic.co/t/need-help-adjusting-elastic-settings/313630 "2022-09-04T20:10:41Z")
Hello everyone, at the moment everything is almost fine, but there is a problem when the required string is not found through multi\_match and due to the filter selects the wrong result. If the occurrence of the string is… --- ## [Forcing shards synchronization](https://discuss.elastic.co/t/forcing-shards-synchronization/313549)
**Author:** [@cheshirecat](https://discuss.elastic.co/u/cheshirecat)\ **Replies:** 3\ **Last updated:** [September 4, 2022, 6:54pm UTC](https://discuss.elastic.co/t/forcing-shards-synchronization/313549 "2022-09-04T18:54:02Z")
Hello There! I know that shards are synchronized automatically but is there a way to force synchronization? I'm thinking of command/setting in Kibana/bash script to do fire and do it for me. --- ## [Bringing Elasticsearch node back online after being offline for a week](https://discuss.elastic.co/t/bringing-elasticsearch-node-back-online-after-being-offline-for-a-week/312497)
**Author:** [@kossde](https://discuss.elastic.co/u/kossde)\ **Replies:** 4\ **Last updated:** [September 4, 2022, 6:28pm UTC](https://discuss.elastic.co/t/bringing-elasticsearch-node-back-online-after-being-offline-for-a-week/312497 "2022-09-04T18:28:16Z")
We have an Elasticsearch data node that has been offline for a week. If we bring this node back online, will the cluster try to create new replica shards for the old primaries stored on that node or, because the shards … [Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=378) [Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=380)