# Elasticsearch **URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=294 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 295 --- ## [Improve indexing performance speed by routing to a specific shard](https://discuss.elastic.co/t/improve-indexing-performance-speed-by-routing-to-a-specific-shard/326552)
**Author:** [@Itay\_Bittan](https://discuss.elastic.co/u/Itay_Bittan)\ **Replies:** 7\ **Last updated:** [February 27, 2023, 10:16am UTC](https://discuss.elastic.co/t/improve-indexing-performance-speed-by-routing-to-a-specific-shard/326552 "2023-02-27T10:16:47Z")
Hi, Let's say I have a 100GB of data that need to be indexed into a specific index with 5 shards. I don't have reads during indexing time and I want to speed up the process as much as possible. I have 5 (python) worke… --- ## [An index that inflates](https://discuss.elastic.co/t/an-index-that-inflates/326517)
**Author:** [@boazBD](https://discuss.elastic.co/u/boazBD)\ **Replies:** 4\ **Last updated:** [February 27, 2023, 9:27am UTC](https://discuss.elastic.co/t/an-index-that-inflates/326517 "2023-02-27T09:27:23Z")
Hello, I have an index that inflates more until the node crashes with a full disk error. For now, I delete the index directly from the VM because Elastic is unhealthy when it happens. It is helpful for a short period,… --- ## [Running \_forcemerge on an index that is being write on](https://discuss.elastic.co/t/running-forcemerge-on-an-index-that-is-being-write-on/326492)
**Author:** [@Tudor\_Plugaru](https://discuss.elastic.co/u/Tudor_Plugaru)\ **Replies:** 18\ **Last updated:** [February 27, 2023, 8:22am UTC](https://discuss.elastic.co/t/running-forcemerge-on-an-index-that-is-being-write-on/326492 "2023-02-27T08:22:27Z")
Hi, we are having an index with heavy updates on the documents. This leads us to having a lot of uncleaned deleted documents, for example, we can have around 400M searchable documents and around 150M of uncleaned docume… --- ## [Particular word count in particular file](https://discuss.elastic.co/t/particular-word-count-in-particular-file/326181)
**Author:** [@smitak](https://discuss.elastic.co/u/smitak)\ **Replies:** 5\ **Last updated:** [February 27, 2023, 7:10am UTC](https://discuss.elastic.co/t/particular-word-count-in-particular-file/326181 "2023-02-27T07:10:50Z")
Hello Sir, I want count of keyword occurance in a particular file in elaticsearch . --- ## [Too many tcp connection established issue](https://discuss.elastic.co/t/too-many-tcp-connection-established-issue/326545)
**Author:** [@manzoor77](https://discuss.elastic.co/u/manzoor77)\ **Replies:** 0\ **Last updated:** [February 27, 2023, 7:01am UTC](https://discuss.elastic.co/t/too-many-tcp-connection-established-issue/326545 "2023-02-27T07:01:56Z")
Hi, I have enable elasticsearch in my production chat application. There was total 500+ users that uses this application on daily bases for communication purpose. I have initialize ELS newclient once when server start … --- ## [Is my ILM policy stuck?](https://discuss.elastic.co/t/is-my-ilm-policy-stuck/326543)
**Author:** [@Shalinicts](https://discuss.elastic.co/u/Shalinicts)\ **Replies:** 0\ **Last updated:** [February 27, 2023, 6:36am UTC](https://discuss.elastic.co/t/is-my-ilm-policy-stuck/326543 "2023-02-27T06:36:44Z")
Hi Team , I have set my ILM policy to move from hot to frozen node when it reach 45 GB size in primary shard. Howver it is not yet moved and not showing any errors. But if I do Preformatted textGET /metricbeat-\*/\_ilm/e… --- ## [My ela cluster failed to load metadata when running, but I can't see the other problem. If there is the same problem, please help to take a look](https://discuss.elastic.co/t/my-ela-cluster-failed-to-load-metadata-when-running-but-i-cant-see-the-other-problem-if-there-is-the-same-problem-please-help-to-take-a-look/326286)
**Author:** [@limedong1](https://discuss.elastic.co/u/limedong1)\ **Replies:** 8\ **Last updated:** [February 27, 2023, 3:17am UTC](https://discuss.elastic.co/t/my-ela-cluster-failed-to-load-metadata-when-running-but-i-cant-see-the-other-problem-if-there-is-the-same-problem-please-help-to-take-a-look/326286 "2023-02-27T03:17:01Z")
Here is the error message： {"@timestamp":"2023-02-23T08:43:40.767Z", "log.level":"ERROR", "message":"fatal exception while booting Elasticsearch", "ecs.version": "1.2.0","service.name":"ES\_ECS","event.dataset":"elastic… --- ## [Monitoring postgres y sql server on AWS with an elastic on premises](https://discuss.elastic.co/t/monitoring-postgres-y-sql-server-on-aws-with-an-elastic-on-premises/325660)
**Author:** [@ElasticLiver](https://discuss.elastic.co/u/ElasticLiver)\ **Replies:** 2\ **Last updated:** [February 27, 2023, 3:00am UTC](https://discuss.elastic.co/t/monitoring-postgres-y-sql-server-on-aws-with-an-elastic-on-premises/325660 "2023-02-27T03:00:33Z")
It is posible to monitor postgres y sql server on aws? if it is, with wich tool? our elastic is on premises. thanks. --- ## [Find: 'elasticsearch-translog': No such file or directory](https://discuss.elastic.co/t/find-elasticsearch-translog-no-such-file-or-directory/326518)
**Author:** [@ACoder](https://discuss.elastic.co/u/ACoder)\ **Replies:** 1\ **Last updated:** [February 27, 2023, 2:10am UTC](https://discuss.elastic.co/t/find-elasticsearch-translog-no-such-file-or-directory/326518 "2023-02-27T02:10:39Z")
I think my translog is corrupted, so I'm trying to solve the problem by following this tutorial: But this tool doesn't exist in the docker image for elasticsearch at all: $ find / elasticsearch-translog ... find: 'ela… --- ## [Update existing record shuffles the data](https://discuss.elastic.co/t/update-existing-record-shuffles-the-data/326400)
**Author:** [@srb.saurabhjain](https://discuss.elastic.co/u/srb.saurabhjain)\ **Replies:** 3\ **Last updated:** [February 26, 2023, 9:42pm UTC](https://discuss.elastic.co/t/update-existing-record-shuffles-the-data/326400 "2023-02-26T21:42:11Z")
Hi team, I am trying to update a field in the below data B.B1 but the result data is randomly shuffled when I fetch again. Original { "A": { "A1": "test" }, "B": { "B1": "approved" }, … --- ## [Grep-like results on elasticsearch index](https://discuss.elastic.co/t/grep-like-results-on-elasticsearch-index/326524)
**Author:** [@John10](https://discuss.elastic.co/u/John10)\ **Replies:** 1\ **Last updated:** [February 26, 2023, 7:42pm UTC](https://discuss.elastic.co/t/grep-like-results-on-elasticsearch-index/326524 "2023-02-26T19:42:45Z")
If you have 5,000 pdf documents and you want to return every instance of the word "dog" across all of those documents (including the context where it occurs -- page number, the line before and after the match, etc.), you… --- ## [Nodes not syncing due to: master not discovered or elected yet](https://discuss.elastic.co/t/nodes-not-syncing-due-to-master-not-discovered-or-elected-yet/326434)
**Author:** [@parthmaniar](https://discuss.elastic.co/u/parthmaniar)\ **Replies:** 1\ **Last updated:** [February 26, 2023, 6:28am UTC](https://discuss.elastic.co/t/nodes-not-syncing-due-to-master-not-discovered-or-elected-yet/326434 "2023-02-26T06:28:02Z")
Hello, I have a 3-node cluster with two nodes holding data and one as the voting node thastorees not hold any data. All virtual nodes run on ESXi 8.0 with Ubuntu 22.04.1 & Elasticsearch 8.6.2. OS and data are on… --- ## [Searchable Snapshot/Cold Nodes much slower to recover 8.5+?](https://discuss.elastic.co/t/searchable-snapshot-cold-nodes-much-slower-to-recover-8-5/326458)
**Author:** [@BenB196](https://discuss.elastic.co/u/BenB196)\ **Replies:** 1\ **Last updated:** [February 25, 2023, 8:58pm UTC](https://discuss.elastic.co/t/searchable-snapshot-cold-nodes-much-slower-to-recover-8-5/326458 "2023-02-25T20:58:28Z")
Hi All, I was wondering if anyone else has noticed that since upgrading to 8.5.x (and 8.6.x), that the recovery of Searchable Snapshot/Cold nodes from a rolling restart is much slower than in lower versions? A cold nod… --- ## [Unable to enable Vnet or traffic filter for Elastic cloud](https://discuss.elastic.co/t/unable-to-enable-vnet-or-traffic-filter-for-elastic-cloud/325965)
**Author:** [@zameer712](https://discuss.elastic.co/u/zameer712)\ **Replies:** 4\ **Last updated:** [February 25, 2023, 4:14pm UTC](https://discuss.elastic.co/t/unable-to-enable-vnet-or-traffic-filter-for-elastic-cloud/325965 "2023-02-25T16:14:03Z")
Hi Team, Hope you are doing well & Safe. I have followed documentation to enabled our elastic cloud from public internet to azure networking boundaries as per the step granted as below documentation. But still we coul… --- ## [Range with script fields](https://discuss.elastic.co/t/range-with-script-fields/326487)
**Author:** [@TECHNOID](https://discuss.elastic.co/u/TECHNOID)\ **Replies:** 0\ **Last updated:** [February 25, 2023, 7:41am UTC](https://discuss.elastic.co/t/range-with-script-fields/326487 "2023-02-25T07:41:50Z")
Hello, tell me if it's possible to filter aggregation by scriptfield range search result \[hits\] =\> Array ( ... \[hits\] =\> Array ( \[0\] =\> Array … --- ## [Querying data using script query with lang=expression for remainder operation](https://discuss.elastic.co/t/querying-data-using-script-query-with-lang-expression-for-remainder-operation/325895)
**Author:** [@Rachana\_Maniyar](https://discuss.elastic.co/u/Rachana_Maniyar)\ **Replies:** 16\ **Last updated:** [February 25, 2023, 7:20am UTC](https://discuss.elastic.co/t/querying-data-using-script-query-with-lang-expression-for-remainder-operation/325895 "2023-02-25T07:20:25Z")
hi Folks, We store a field of type "long" in elastic which has value of this nature = 9048716794795431 Need to retrieve these records based on modulus expression. So the query looks like this query: {'query': {'bool':… --- ## [What is the difference between xpack.security.http.ssl.verification\_mode and xpack.http.ssl.verification\_mode](https://discuss.elastic.co/t/what-is-the-difference-between-xpack-security-http-ssl-verification-mode-and-xpack-http-ssl-verification-mode/326474)
**Author:** [@hiruni.insyncit.net](https://discuss.elastic.co/u/hiruni.insyncit.net)\ **Replies:** 0\ **Last updated:** [February 24, 2023, 9:39pm UTC](https://discuss.elastic.co/t/what-is-the-difference-between-xpack-security-http-ssl-verification-mode-and-xpack-http-ssl-verification-mode/326474 "2023-02-24T21:39:38Z")
I want to know what is the difference between xpack.security.http.ssl.verification\_mode: certificate and xpack.http.ssl.verification\_mode: certificate Also, can I use both setting at same time...? Thank you..! Hiruni --- ## [How to create many small separate indices](https://discuss.elastic.co/t/how-to-create-many-small-separate-indices/326459)
**Author:** [@tim28](https://discuss.elastic.co/u/tim28)\ **Replies:** 5\ **Last updated:** [February 24, 2023, 7:27pm UTC](https://discuss.elastic.co/t/how-to-create-many-small-separate-indices/326459 "2023-02-24T19:27:48Z")
Hi! I want to create many (~10k) indices each having a couple of hundred documents. I have read in other places that that's discouraged as it creates a shard per index which is a lot of overhead. However, I have the req… --- ## [Why does aggregation contain ID's that don't exist in the query results?](https://discuss.elastic.co/t/why-does-aggregation-contain-ids-that-dont-exist-in-the-query-results/326445)
**Author:** [@A\_K3](https://discuss.elastic.co/u/A_K3)\ **Replies:** 1\ **Last updated:** [February 24, 2023, 4:08pm UTC](https://discuss.elastic.co/t/why-does-aggregation-contain-ids-that-dont-exist-in-the-query-results/326445 "2023-02-24T16:08:10Z")
To gather data on how many documents have been prepared by some employee in a given time period, I have written this query: { "from": 0, "size": 0, "sort": \[\], "query": { "bool": { "must": \[ { … --- ## [Different values using date histogram](https://discuss.elastic.co/t/different-values-using-date-histogram/326453)
**Author:** [@bcamboim](https://discuss.elastic.co/u/bcamboim)\ **Replies:** 0\ **Last updated:** [February 24, 2023, 3:15pm UTC](https://discuss.elastic.co/t/different-values-using-date-histogram/326453 "2023-02-24T15:15:26Z")
Hi everyone. I'am using the package @elastic/elasticsearch (^7.9.1) to do queries in my cluster. I have a dashboard showing the concurrent users using my videos platform. My query is: { query: { bool: { … --- ## [Migrate backups from S3 to GCP](https://discuss.elastic.co/t/migrate-backups-from-s3-to-gcp/326447)
**Author:** [@Pete1](https://discuss.elastic.co/u/Pete1)\ **Replies:** 3\ **Last updated:** [February 24, 2023, 2:28pm UTC](https://discuss.elastic.co/t/migrate-backups-from-s3-to-gcp/326447 "2023-02-24T14:28:54Z")
Hello, I want to copy all of my backups that have been made using the s3 plugin to Google Cloud Storage. I tried to copy them just like that, but it seems that this is not the way to do it. Is there a tool or is there so… --- ## [Unable to start elasticsearch 7.11.0](https://discuss.elastic.co/t/unable-to-start-elasticsearch-7-11-0/326342)
**Author:** [@anandgavai](https://discuss.elastic.co/u/anandgavai)\ **Replies:** 6\ **Last updated:** [February 24, 2023, 2:27pm UTC](https://discuss.elastic.co/t/unable-to-start-elasticsearch-7-11-0/326342 "2023-02-24T14:27:10Z")
Hi there, am getting an ElasticsearchUncaughtExceptionHandler error and not able to start elasticsearch. All I know was there was there was an abrupt shutdown of my server and since then am not able to start the elastic… --- ## [Pyspark-Elasticsearch connectivity and latest version compatibilty](https://discuss.elastic.co/t/pyspark-elasticsearch-connectivity-and-latest-version-compatibilty/325289)
**Author:** [@Bramha](https://discuss.elastic.co/u/Bramha)\ **Replies:** 6\ **Last updated:** [February 24, 2023, 2:24pm UTC](https://discuss.elastic.co/t/pyspark-elasticsearch-connectivity-and-latest-version-compatibilty/325289 "2023-02-24T14:24:12Z")
Hello All, I'm trying to use elasticsearch as a source in my poc. I'm using Python-3.10.10, Spark 3.3.0. I'm using Jupyter notebook below is my code: from pyspark import SparkConf, SparkContext conf = SparkConf() c… --- ## [Aggregations: Getting accurate counts for filter panel](https://discuss.elastic.co/t/aggregations-getting-accurate-counts-for-filter-panel/326433)
**Author:** [@MonikaJ](https://discuss.elastic.co/u/MonikaJ)\ **Replies:** 0\ **Last updated:** [February 24, 2023, 11:23am UTC](https://discuss.elastic.co/t/aggregations-getting-accurate-counts-for-filter-panel/326433 "2023-02-24T11:23:09Z")
Many searches provide a standard filter panel on the left, that allows filtering by OR within a category and AND between categories. The logic the counts that are shown for every filter entry follows the following standa… --- ## [Records Limits on upload](https://discuss.elastic.co/t/records-limits-on-upload/326442)
**Author:** [@IceF1reX](https://discuss.elastic.co/u/IceF1reX)\ **Replies:** 0\ **Last updated:** [February 24, 2023, 1:26pm UTC](https://discuss.elastic.co/t/records-limits-on-upload/326442 "2023-02-24T13:26:18Z")
How to increase or remove records limits from simultaneous upload in C# ?? For 300 000 and more --- ## [SocketException on \_bulk request working in curl but not in restTemplate](https://discuss.elastic.co/t/socketexception-on-bulk-request-working-in-curl-but-not-in-resttemplate/326437)
**Author:** [@D1sturbance](https://discuss.elastic.co/u/D1sturbance)\ **Replies:** 0\ **Last updated:** [February 24, 2023, 12:12pm UTC](https://discuss.elastic.co/t/socketexception-on-bulk-request-working-in-curl-but-not-in-resttemplate/326437 "2023-02-24T12:12:49Z")
Hello, I have problems with \_bulk request throwing Connection reset by peer: socket write error; nested exception is javax.net.ssl.SSLProtocolException. I've read and know about bulk size and etc... So that's not an is… --- ## [Missing client level settings in high level rest client while migrating to transport client](https://discuss.elastic.co/t/missing-client-level-settings-in-high-level-rest-client-while-migrating-to-transport-client/326415)
**Author:** [@Umang\_Pachaury](https://discuss.elastic.co/u/Umang_Pachaury)\ **Replies:** 3\ **Last updated:** [February 24, 2023, 10:13am UTC](https://discuss.elastic.co/t/missing-client-level-settings-in-high-level-rest-client-while-migrating-to-transport-client/326415 "2023-02-24T10:13:52Z")
Hey Team, I am upgrading from transport client to high level rest client and there are some client level settings I could not find in high level rest client. I was able to upgrade almost all the code but was not able t… --- ## [Failed to clean async result](https://discuss.elastic.co/t/failed-to-clean-async-result/326347)
**Author:** [@INS](https://discuss.elastic.co/u/INS)\ **Replies:** 3\ **Last updated:** [February 24, 2023, 10:13am UTC](https://discuss.elastic.co/t/failed-to-clean-async-result/326347 "2023-02-24T10:13:23Z")
Hi I met the case on transport transport\_worker in my workflow ingest node (mem capacity 36GB) received data from source and the next this data should be relocated on data nodes (16GB) Can we control bulk of data betw… --- ## [Use the correct datatype fields](https://discuss.elastic.co/t/use-the-correct-datatype-fields/326290)
**Author:** [@rschirin](https://discuss.elastic.co/u/rschirin)\ **Replies:** 4\ **Last updated:** [February 24, 2023, 7:59am UTC](https://discuss.elastic.co/t/use-the-correct-datatype-fields/326290 "2023-02-24T07:59:01Z")
Hey there, I would like just to get a suggestion. If I have a field that contains only ip addresses and it is used for standard match query, should be better to map it with the ip datatype or is it not relevant? is the… --- ## [Elasticsearch document update and insertio using update api](https://discuss.elastic.co/t/elasticsearch-document-update-and-insertio-using-update-api/326401)
**Author:** [@murli\_krishna](https://discuss.elastic.co/u/murli_krishna)\ **Replies:** 0\ **Last updated:** [February 24, 2023, 5:20am UTC](https://discuss.elastic.co/t/elasticsearch-document-update-and-insertio-using-update-api/326401 "2023-02-24T05:20:58Z")
I want to ingest data using Python code, and if data is already available, I just want to update it with the given document for that ID. So far, I have tried this. Using Elasticsearch 8.6.1 import elasticsearch from … [Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=293) [Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=295)