# Elasticsearch **URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=334 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 335 --- ## [GC on elastic search data nodes and node automatically reconnect from the cluster](https://discuss.elastic.co/t/gc-on-elastic-search-data-nodes-and-node-automatically-reconnect-from-the-cluster/319426)
**Author:** [@Siva\_Karan](https://discuss.elastic.co/u/Siva_Karan)\ **Replies:** 4\ **Last updated:** [December 5, 2022, 4:23am UTC](https://discuss.elastic.co/t/gc-on-elastic-search-data-nodes-and-node-automatically-reconnect-from-the-cluster/319426 "2022-12-05T04:23:47Z")
Hi Team, we are getting the below alerts in elasticsearch data nodes. \[2022-11-20T21:27:36,237\]\[INFO \]\[o.e.m.j.JvmGcMonitorService\] \[esnode1\] \[gc\]\[438806\] overhead, spent \[276ms\] collecting in the last \[1s\] \[2022-11-2… --- ## [The limit of Data stream](https://discuss.elastic.co/t/the-limit-of-data-stream/320255)
**Author:** [@2019240081](https://discuss.elastic.co/u/2019240081)\ **Replies:** 1\ **Last updated:** [December 5, 2022, 12:37am UTC](https://discuss.elastic.co/t/the-limit-of-data-stream/320255 "2022-12-05T00:37:12Z")
I had to choose between data stream and index strategy with alias and found es doc which helps to determine whether use data stream or not If you frequently update or delete existing time series data, use an index alias… --- ## [Can't start elasticsearch 8.5 with docker](https://discuss.elastic.co/t/cant-start-elasticsearch-8-5-with-docker/318029)
**Author:** [@FatNerd](https://discuss.elastic.co/u/FatNerd)\ **Replies:** 13\ **Last updated:** [December 5, 2022, 12:36am UTC](https://discuss.elastic.co/t/cant-start-elasticsearch-8-5-with-docker/318029 "2022-12-05T00:36:46Z")
I'm trying to execute the docker-compose.yml from this page Install Elasticsearch with Docker | Elasticsearch Guide \[8.5\] | Elastic In the .env file, I left everything to default except the two passwords Ther first se… --- ## [Node is disconnected from cluster and does not join existing cluster (ES 7.16.2)](https://discuss.elastic.co/t/node-is-disconnected-from-cluster-and-does-not-join-existing-cluster-es-7-16-2/320357)
**Author:** [@Pooja2](https://discuss.elastic.co/u/Pooja2)\ **Replies:** 1\ **Last updated:** [December 4, 2022, 9:15pm UTC](https://discuss.elastic.co/t/node-is-disconnected-from-cluster-and-does-not-join-existing-cluster-es-7-16-2/320357 "2022-12-04T21:15:10Z")
Hi Team, We have an elasticsearch(ES 7.16.2) cluster of 3 nodes in which one node(node-3) is randomly disconnected from the cluster. Node info: node-1 = master, data (currently master) node-2 = master, data node-3 =… --- ## [Retrieve records and update a field at the same time](https://discuss.elastic.co/t/retrieve-records-and-update-a-field-at-the-same-time/320432)
**Author:** [@xef](https://discuss.elastic.co/u/xef)\ **Replies:** 1\ **Last updated:** [December 4, 2022, 7:12pm UTC](https://discuss.elastic.co/t/retrieve-records-and-update-a-field-at-the-same-time/320432 "2022-12-04T19:12:44Z")
We did not get a response the first time. Hopefully someone can give us some guidance this time. Is there anyway when making a query in Elasticsearch, to update a field (such as say a counter++) in each record that is s… --- ## [Modify the max bucket to report an error](https://discuss.elastic.co/t/modify-the-max-bucket-to-report-an-error/320414)
**Author:** [@Tonyhu\_T](https://discuss.elastic.co/u/Tonyhu_T)\ **Replies:** 12\ **Last updated:** [December 4, 2022, 12:51pm UTC](https://discuss.elastic.co/t/modify-the-max-bucket-to-report-an-error/320414 "2022-12-04T12:51:05Z")
I use the following command to modify max bucket: PUT \_cluster/settings { "persistent": { "search.max\_buckets": 500000 } } But received the following error message: { "error" : { "root\_cause" : \[ {… --- ## [Issues in scalling elastic search, version conflicts](https://discuss.elastic.co/t/issues-in-scalling-elastic-search-version-conflicts/320424)
**Author:** [@Manav\_Motwani](https://discuss.elastic.co/u/Manav_Motwani)\ **Replies:** 6\ **Last updated:** [December 4, 2022, 10:31am UTC](https://discuss.elastic.co/t/issues-in-scalling-elastic-search-version-conflicts/320424 "2022-12-04T10:31:15Z")
I will describe my problem as simple as possible, so we have a index which stores product details, but we have 2 primary keys one is product id (unique for every product) and other is city id (we need city id because we … --- ## [Elasticsearch best\_compression](https://discuss.elastic.co/t/elasticsearch-best-compression/320397)
**Author:** [@VamPikmin](https://discuss.elastic.co/u/VamPikmin)\ **Replies:** 4\ **Last updated:** [December 4, 2022, 3:05am UTC](https://discuss.elastic.co/t/elasticsearch-best-compression/320397 "2022-12-04T03:05:55Z")
Hello, I have a bunch of indices that I've remotely re-indexed into a single node as a sort of a backup, these won't need to be written to anymore so I'd like to make them smaller, if possible. What would be the correc… --- ## [Elasticsearch:8.5.2 InitContainers chown: /usr/share/elasticsearch/data: Operation not permitted](https://discuss.elastic.co/t/elasticsearch-8-5-2-initcontainers-chown-usr-share-elasticsearch-data-operation-not-permitted/320406)
**Author:** [@khteh](https://discuss.elastic.co/u/khteh)\ **Replies:** 0\ **Last updated:** [December 3, 2022, 8:19am UTC](https://discuss.elastic.co/t/elasticsearch-8-5-2-initcontainers-chown-usr-share-elasticsearch-data-operation-not-permitted/320406 "2022-12-03T08:19:54Z")
I am on AWS EKS 1.24 using EFS PVC. initContainers: - name: fix-volume-mount-permission image: busybox command: \["sh", "-c", "chown -R 1000:0 /usr/share/elasticsearch/data"\] v… --- ## [ElasticSearch 8: is there a "conf.d" folder to change settings without editing elasticsearch.yml?](https://discuss.elastic.co/t/elasticsearch-8-is-there-a-conf-d-folder-to-change-settings-without-editing-elasticsearch-yml/320076)
**Author:** [@ZaneCEO](https://discuss.elastic.co/u/ZaneCEO)\ **Replies:** 6\ **Last updated:** [December 3, 2022, 7:15am UTC](https://discuss.elastic.co/t/elasticsearch-8-is-there-a-conf-d-folder-to-change-settings-without-editing-elasticsearch-yml/320076 "2022-12-03T07:15:10Z")
I'd like to edit a few Elasticsearch 8 settings (for example: network.host), but I don't want to edit /etc/elasticsearch/elasticsearch.yml directly. What I'd like to do is to add my settings to my own file and put it in … --- ## [Elasticsearch-spark-30 read missing field(double type) error](https://discuss.elastic.co/t/elasticsearch-spark-30-read-missing-field-double-type-error/320112)
**Author:** [@918246180](https://discuss.elastic.co/u/918246180)\ **Replies:** 8\ **Last updated:** [December 3, 2022, 12:32am UTC](https://discuss.elastic.co/t/elasticsearch-spark-30-read-missing-field-double-type-error/320112 "2022-12-03T00:32:06Z")
hi! When I use the elasticsearch-spark-30\_2.12-7.16.1.jar to read data, I find that a field of double type is missing, which causes the exception of the Spark application. But I use elasticsearch-spark20\_ 2.11-7.6.1.… --- ## [I want to pin down Elasticsearch during Ubuntu 18.04 to 20.04 upgrade](https://discuss.elastic.co/t/i-want-to-pin-down-elasticsearch-during-ubuntu-18-04-to-20-04-upgrade/320383)
**Author:** [@menabulele](https://discuss.elastic.co/u/menabulele)\ **Replies:** 0\ **Last updated:** [December 2, 2022, 3:12pm UTC](https://discuss.elastic.co/t/i-want-to-pin-down-elasticsearch-during-ubuntu-18-04-to-20-04-upgrade/320383 "2022-12-02T15:12:47Z")
I'm trying to upgrade from ubuntu 18.04 to ubuntu 20.04 and I don't want my Elasticsearch version to change. We presently run on Elasticsearch 7.17.5 version and the upgrade is forcing a version change to 7.17.7 . We wa… --- ## [Do we need to avoid using Elastic Search as primary DB?](https://discuss.elastic.co/t/do-we-need-to-avoid-using-elastic-search-as-primary-db/320233)
**Author:** [@aswin1906](https://discuss.elastic.co/u/aswin1906)\ **Replies:** 5\ **Last updated:** [December 2, 2022, 2:55pm UTC](https://discuss.elastic.co/t/do-we-need-to-avoid-using-elastic-search-as-primary-db/320233 "2022-12-02T14:55:31Z")
We are using Elasticsearch as primary db which includes entire ELK, unfortunately last week we lost huge data from Elasticsearch during server restart. 1) Do we need to avoid using Elastic Search as primary DB? If Yes, … --- ## [Multiple Indice Search With Filters Applied Per Indice](https://discuss.elastic.co/t/multiple-indice-search-with-filters-applied-per-indice/320297)
**Author:** [@sbattGM](https://discuss.elastic.co/u/sbattGM)\ **Replies:** 3\ **Last updated:** [December 2, 2022, 2:34pm UTC](https://discuss.elastic.co/t/multiple-indice-search-with-filters-applied-per-indice/320297 "2022-12-02T14:34:17Z")
I want to perform a multiple indice search with a term search for all indices but I want to add filters for a particular indice. For example a term query like: http://0.0.0.0:9200/index\_a,index\_b/type1,type2,typ3/\_sear… --- ## [In Update action using java api client when i set few fields of java object and pass the other fields get updated](https://discuss.elastic.co/t/in-update-action-using-java-api-client-when-i-set-few-fields-of-java-object-and-pass-the-other-fields-get-updated/320325)
**Author:** [@Raghunandan](https://discuss.elastic.co/u/Raghunandan)\ **Replies:** 3\ **Last updated:** [December 2, 2022, 12:31pm UTC](https://discuss.elastic.co/t/in-update-action-using-java-api-client-when-i-set-few-fields-of-java-object-and-pass-the-other-fields-get-updated/320325 "2022-12-02T12:31:53Z")
In Update action using java API client when i set few fields of java object and pass the other fields get updated to null in Elasticsearch, and i am not sure how this happens as while sending the object i only set few f… --- ## [Rate document by term offset or location](https://discuss.elastic.co/t/rate-document-by-term-offset-or-location/320364)
**Author:** [@Ostr1969](https://discuss.elastic.co/u/Ostr1969)\ **Replies:** 0\ **Last updated:** [December 2, 2022, 11:45am UTC](https://discuss.elastic.co/t/rate-document-by-term-offset-or-location/320364 "2022-12-02T11:45:32Z")
I know that text search can show the location or offset of a term found. can I build a function that can rate or boost the doc by the offset location? for example if searching fox: "brown fox jumping over yellow fenc… --- ## [Delete old logs files](https://discuss.elastic.co/t/delete-old-logs-files/318317)
**Author:** [@Ludovic9](https://discuss.elastic.co/u/Ludovic9)\ **Replies:** 3\ **Last updated:** [December 2, 2022, 11:14am UTC](https://discuss.elastic.co/t/delete-old-logs-files/318317 "2022-12-02T11:14:52Z")
Hi I'm using an old version of elasticsearch (6.4.1). In /var/log/elasticsearch I have a lot of logs file since 2018 with log.gz extension. It seems using logrotate is not a good option, but instead, using the paramet… --- ## [Usually data are not enriched](https://discuss.elastic.co/t/usually-data-are-not-enriched/316435)
**Author:** [@Marcin\_Frankiewicz](https://discuss.elastic.co/u/Marcin_Frankiewicz)\ **Replies:** 10\ **Last updated:** [December 2, 2022, 10:04am UTC](https://discuss.elastic.co/t/usually-data-are-not-enriched/316435 "2022-12-02T10:04:59Z")
Hi, Does exists some situactions, when data are not enriched ? (i'm excluding scenario when there are no matching data) Example : Can be skipped for perfomance reasons? It is possible that enrich processor in pipeline… --- ## [BadRequestError(400, 'search\_phase\_execution\_exception', 'runtime error')](https://discuss.elastic.co/t/badrequesterror-400-search-phase-execution-exception-runtime-error/320340)
**Author:** [@sanjayk1241](https://discuss.elastic.co/u/sanjayk1241)\ **Replies:** 0\ **Last updated:** [December 2, 2022, 8:40am UTC](https://discuss.elastic.co/t/badrequesterror-400-search-phase-execution-exception-runtime-error/320340 "2022-12-02T08:40:20Z")
I am trying to implement the search functionality using the elasticsearch concept. I am getting the following error: BadRequestError(400, 'search\_phase\_execution\_exception', 'runtime error') I am not sure where I am d… --- ## [Is this a bug of Elasticsearch sorting?](https://discuss.elastic.co/t/is-this-a-bug-of-elasticsearch-sorting/320317)
**Author:** [@howe\_xiao](https://discuss.elastic.co/u/howe_xiao)\ **Replies:** 3\ **Last updated:** [December 2, 2022, 7:25am UTC](https://discuss.elastic.co/t/is-this-a-bug-of-elasticsearch-sorting/320317 "2022-12-02T07:25:46Z")
Problem Description: A field of keyword type causes a shard retrieval failure with differernt size and from value. Environment：Node-4, Shard-8, Version-8.0 This is my query DSL on Kibana: POST myIndex/\_search { "fro… --- ## [Dense vector doesn't support synthetic source](https://discuss.elastic.co/t/dense-vector-doesnt-support-synthetic-source/320321)
**Author:** [@ruslaniv](https://discuss.elastic.co/u/ruslaniv)\ **Replies:** 4\ **Last updated:** [December 2, 2022, 6:42am UTC](https://discuss.elastic.co/t/dense-vector-doesnt-support-synthetic-source/320321 "2022-12-02T06:42:59Z")
According to this: Dense vector field type | Elasticsearch Guide \[8.5\] | Elastic dense\_vector field is supposed to support synthetic source. I just tried to create an index with the mapping like this: "mappings": { … --- ## [Pushing of data into elastic search dashboard using Python](https://discuss.elastic.co/t/pushing-of-data-into-elastic-search-dashboard-using-python/320214)
**Author:** [@Shashank02](https://discuss.elastic.co/u/Shashank02)\ **Replies:** 4\ **Last updated:** [December 2, 2022, 4:54am UTC](https://discuss.elastic.co/t/pushing-of-data-into-elastic-search-dashboard-using-python/320214 "2022-12-02T04:54:50Z")
I am working on a project which collects twitter data. So, up until now, what I did is I collected some tweets and then stored them in a CSV format and uploaded it to the elastic cloud. I am now working on automatically … --- ## [How to change scroll time in spring data repository](https://discuss.elastic.co/t/how-to-change-scroll-time-in-spring-data-repository/320314)
**Author:** [@mzinboy](https://discuss.elastic.co/u/mzinboy)\ **Replies:** 0\ **Last updated:** [December 2, 2022, 2:54am UTC](https://discuss.elastic.co/t/how-to-change-scroll-time-in-spring-data-repository/320314 "2022-12-02T02:54:54Z")
Dear all, dev info: elasticsearch 7.17.1 spring boot 2.6.12 spring-data-elasticsearch 4.3.7 I have a code as below: public interface LogRepository\ extends ElasticsearchRepository\ Stream\ findScro… --- ## [Elastic search error : bad certificate](https://discuss.elastic.co/t/elastic-search-error-bad-certificate/320212)
**Author:** [@mangeshmj1992](https://discuss.elastic.co/u/mangeshmj1992)\ **Replies:** 1\ **Last updated:** [December 1, 2022, 11:03pm UTC](https://discuss.elastic.co/t/elastic-search-error-bad-certificate/320212 "2022-12-01T23:03:56Z")
Hello team, We are getting bad certificate issue in 2 elk nodes out of 7. Can you please help me to identify what is exact issue here. \[2022-12-01T14:11:59,261\]\[WARN \]\[o.e.h.AbstractHttpServerTransport\] \[ELKDPCPRD001\] … --- ## [Elasticsearch cluster setup with 7.5.1](https://discuss.elastic.co/t/elasticsearch-cluster-setup-with-7-5-1/320210)
**Author:** [@Suraj\_Jannu](https://discuss.elastic.co/u/Suraj_Jannu)\ **Replies:** 1\ **Last updated:** [December 1, 2022, 10:09pm UTC](https://discuss.elastic.co/t/elasticsearch-cluster-setup-with-7-5-1/320210 "2022-12-01T22:09:16Z")
Hello, I am trying to set up a 3-node elasticsearch cluster of version 7.5.1. I have 1 master node, 1 data node, and 1 client node. Each instance of elasticsearch.yml configuration is as below. Master node path.data:… --- ## [Date Format](https://discuss.elastic.co/t/date-format/320296)
**Author:** [@valleram](https://discuss.elastic.co/u/valleram)\ **Replies:** 0\ **Last updated:** [December 1, 2022, 9:13pm UTC](https://discuss.elastic.co/t/date-format/320296 "2022-12-01T21:13:28Z")
Hi All, I'm trying to create a mapping for a date field with following format Sun, 06 Nov 2022 05:30:03 +0060 Can you help me with the correct custom date format I need to use, please. I tried with the following for… --- ## [What can be the query for this statement in Elasticsearch DSL](https://discuss.elastic.co/t/what-can-be-the-query-for-this-statement-in-elasticsearch-dsl/320275)
**Author:** [@Aniket\_Pant](https://discuss.elastic.co/u/Aniket_Pant)\ **Replies:** 2\ **Last updated:** [December 1, 2022, 5:51pm UTC](https://discuss.elastic.co/t/what-can-be-the-query-for-this-statement-in-elasticsearch-dsl/320275 "2022-12-01T17:51:41Z")
I am trying to have this query in elasticsearch statement: (ip=xx.xx.xx.xx and status="running") or (ip=xx.xx.xx.xx and status="running") can anyone tell me how can i write this in elasticsearch. --- ## [Distance query with grouping and sorting](https://discuss.elastic.co/t/distance-query-with-grouping-and-sorting/320272)
**Author:** [@dthomas](https://discuss.elastic.co/u/dthomas)\ **Replies:** 0\ **Last updated:** [December 1, 2022, 4:44pm UTC](https://discuss.elastic.co/t/distance-query-with-grouping-and-sorting/320272 "2022-12-01T16:44:33Z")
I have a single index that represents the locations of buildings in the United States. Each buildings is owned by a company (hence the CompanyId property). The index looks something like this: (fake geo-coordinates). { … --- ## [Upgrade elasticsearch to 8.x](https://discuss.elastic.co/t/upgrade-elasticsearch-to-8-x/320250)
**Author:** [@tegerei](https://discuss.elastic.co/u/tegerei)\ **Replies:** 1\ **Last updated:** [December 1, 2022, 2:45pm UTC](https://discuss.elastic.co/t/upgrade-elasticsearch-to-8-x/320250 "2022-12-01T14:45:22Z")
Hi, I am planning to upgrade Elasticsearch from 7.10 to 8.x. However I am not sure what will happen to multiple endpoints sending logs to ES using filebeat 7.10. Will I also need to upgrade the filebeat instances? Than… --- ## [Logstash(6.5.4) elasticsearch output](https://discuss.elastic.co/t/logstash-6-5-4-elasticsearch-output/320219)
**Author:** [@gyrao\_72](https://discuss.elastic.co/u/gyrao_72)\ **Replies:** 5\ **Last updated:** [December 1, 2022, 1:10pm UTC](https://discuss.elastic.co/t/logstash-6-5-4-elasticsearch-output/320219 "2022-12-01T13:10:10Z")
My filebeat is on two servers. let's say app1 and app2 My logs are in the format jobID status data Example: app1 log 5hgsxyt3838 SCHEDULED data app2 log 5hgsxyt3838 COMPLETE data Here both these logs have the sam… [Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=333) [Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=335)