# Elasticsearch **URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=93 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 94 --- ## [Ghost Web Crawlers](https://discuss.elastic.co/t/ghost-web-crawlers/363373)
**Author:** [@mszal\_ib](https://discuss.elastic.co/u/mszal_ib)\ **Replies:** 3\ **Last updated:** [July 19, 2024, 8:20pm UTC](https://discuss.elastic.co/t/ghost-web-crawlers/363373 "2024-07-19T20:20:59Z")
I am using Elastic, Kibana, and Enterprise Search 8.14 on Elastic Cloud. I was test crawling some domains with the "Elastic Web Crawler" with multiple custom crawl schedules (top right drop down Kibana). Later, I deleted… --- ## [Laravel Elasticsearch Integration: Native Eloquent Model Extension Package](https://discuss.elastic.co/t/laravel-elasticsearch-integration-native-eloquent-model-extension-package/363357)
**Author:** [@pdphilip](https://discuss.elastic.co/u/pdphilip)\ **Replies:** 1\ **Last updated:** [July 19, 2024, 6:17pm UTC](https://discuss.elastic.co/t/laravel-elasticsearch-integration-native-eloquent-model-extension-package/363357 "2024-07-19T18:17:32Z")
Hi All, I've noticed that a few people have been asking about how to integrate Elasticsearch with Laravel. I maintain a package that integrates Elasticsearch directly into Laravel by extending Laravel's Eloquent model … --- ## [How to allow allow all ipv6 address in network in remote.reindex.whitelist](https://discuss.elastic.co/t/how-to-allow-allow-all-ipv6-address-in-network-in-remote-reindex-whitelist/363445)
**Author:** [@amrit\_singh](https://discuss.elastic.co/u/amrit_singh)\ **Replies:** 0\ **Last updated:** [July 19, 2024, 4:09pm UTC](https://discuss.elastic.co/t/how-to-allow-allow-all-ipv6-address-in-network-in-remote-reindex-whitelist/363445 "2024-07-19T16:09:26Z")
In my environment elasticsearch is over container where IP changes on pod restart. So I wanted to allow all IPv6 address (open for any ip) to the "remote.reindex.whitelist" settings, so that re-indexing can be done fro… --- ## [Distributing Load Test Driver: Does It Split Search Operations?](https://discuss.elastic.co/t/distributing-load-test-driver-does-it-split-search-operations/363437)
**Author:** [@RafaelAdao](https://discuss.elastic.co/u/RafaelAdao)\ **Replies:** 1\ **Last updated:** [July 19, 2024, 3:35pm UTC](https://discuss.elastic.co/t/distributing-load-test-driver-does-it-split-search-operations/363437 "2024-07-19T15:35:23Z")
I'm currently running benchmarks using ESRally with a distributed setup for the load test driver. When distributing the load test driver, are search operations also split across the different nodes/drivers? --- ## [Weird behaviour on document update to remove value from a field](https://discuss.elastic.co/t/weird-behaviour-on-document-update-to-remove-value-from-a-field/363427)
**Author:** [@Vijeya\_Nidhi](https://discuss.elastic.co/u/Vijeya_Nidhi)\ **Replies:** 13\ **Last updated:** [July 19, 2024, 2:52pm UTC](https://discuss.elastic.co/t/weird-behaviour-on-document-update-to-remove-value-from-a-field/363427 "2024-07-19T14:52:53Z")
Elasticsearch version 8.13.3 Assume there is a document with id test in index testindex with following fields. { "field1": "any1", "field2": "any2" } if i execute a update request like POST: \/testindex… --- ## [Boost results based of filed (number\_of\_review) with out effecting actual relevancy of results against a search query](https://discuss.elastic.co/t/boost-results-based-of-filed-number-of-review-with-out-effecting-actual-relevancy-of-results-against-a-search-query/363436)
**Author:** [@Azam\_Maqsood](https://discuss.elastic.co/u/Azam_Maqsood)\ **Replies:** 1\ **Last updated:** [July 19, 2024, 2:21pm UTC](https://discuss.elastic.co/t/boost-results-based-of-filed-number-of-review-with-out-effecting-actual-relevancy-of-results-against-a-search-query/363436 "2024-07-19T14:21:16Z")
I have a use-case of an Ecommerce website. We sell furniture and want our customer to search for different furniture items on our website. My search procedure is as follow I combine multiple attributes of a product in … --- ## [Question about knn query on nested field and similarity parameter](https://discuss.elastic.co/t/question-about-knn-query-on-nested-field-and-similarity-parameter/363294)
**Author:** [@Shaun\_Stuart](https://discuss.elastic.co/u/Shaun_Stuart)\ **Replies:** 7\ **Last updated:** [July 19, 2024, 12:52pm UTC](https://discuss.elastic.co/t/question-about-knn-query-on-nested-field-and-similarity-parameter/363294 "2024-07-19T12:52:54Z")
Hello According to the documentation (Knn query | Elasticsearch Guide \[8.14\] | Elastic), the similarity parameter can be used as a filter to only include documents that are greater than the raw similarity calculated. I'… --- ## [Merging the data column wise from two different indexes](https://discuss.elastic.co/t/merging-the-data-column-wise-from-two-different-indexes/363296)
**Author:** [@venkatkumar229](https://discuss.elastic.co/u/venkatkumar229)\ **Replies:** 6\ **Last updated:** [July 19, 2024, 10:07am UTC](https://discuss.elastic.co/t/merging-the-data-column-wise-from-two-different-indexes/363296 "2024-07-19T10:07:00Z")
Hi, I am trying to merge two indexes column wise based on a common key from both the indices. I have tried logstash ruby code, transforms but nothing seems working to me. I am getting individual records having the colum… --- ## [Java API Client Conflict? java.lang.NoSuchMethodError: org.elasticsearch.client.RequestOptions$Builder.setHttpAsyncResponseConsumerFactory](https://discuss.elastic.co/t/java-api-client-conflict-java-lang-nosuchmethoderror-org-elasticsearch-client-requestoptions-builder-sethttpasyncresponseconsumerfactory/363367)
**Author:** [@linusField](https://discuss.elastic.co/u/linusField)\ **Replies:** 1\ **Last updated:** [July 19, 2024, 9:22am UTC](https://discuss.elastic.co/t/java-api-client-conflict-java-lang-nosuchmethoderror-org-elasticsearch-client-requestoptions-builder-sethttpasyncresponseconsumerfactory/363367 "2024-07-19T09:22:08Z")
Hi! We are trying to upgrade from Elastic Search 7 to 8. We have been using the Rest High Level Client 7.17.22 and want to upgrade it to 8.14.3. As suggested by the migration guide, we should be able to have both vers… --- ## [Is it possible to forward logs from elasticsearch to qradar](https://discuss.elastic.co/t/is-it-possible-to-forward-logs-from-elasticsearch-to-qradar/362769)
**Author:** [@yar](https://discuss.elastic.co/u/yar)\ **Replies:** 3\ **Last updated:** [July 19, 2024, 7:51am UTC](https://discuss.elastic.co/t/is-it-possible-to-forward-logs-from-elasticsearch-to-qradar/362769 "2024-07-19T07:51:40Z")
Hi, I have deployed ELK stack into a couple of VMs. The logs are gathered using fleet agents, and they're being sent into elastic. Is there a way to forward the logs from Elasticsearch to Qradar on-prem deployment? Or s… --- ## [Extract nested documents to new index(non-nestify)](https://discuss.elastic.co/t/extract-nested-documents-to-new-index-non-nestify/363401)
**Author:** [@HyebinHong](https://discuss.elastic.co/u/HyebinHong)\ **Replies:** 0\ **Last updated:** [July 19, 2024, 7:46am UTC](https://discuss.elastic.co/t/extract-nested-documents-to-new-index-non-nestify/363401 "2024-07-19T07:46:39Z")
Hello! I'm wondering I can extract nested documents for the new index. For example, if there is an index of company which also containing products data as a nested field, i want to make a new product index from the fo… --- ## [Need Help with Merging Data from Two Elasticsearch Indices](https://discuss.elastic.co/t/need-help-with-merging-data-from-two-elasticsearch-indices/363343)
**Author:** [@prashant1](https://discuss.elastic.co/u/prashant1)\ **Replies:** 4\ **Last updated:** [July 19, 2024, 7:32am UTC](https://discuss.elastic.co/t/need-help-with-merging-data-from-two-elasticsearch-indices/363343 "2024-07-19T07:32:15Z")
Hi, I need to merge data from two indices (test1 and test2) based on a common key (information). Here’s a simplified example of my indices: Index test1: sample\_id information price --------- ------- ---… --- ## [Deprecation logging -- logger level](https://discuss.elastic.co/t/deprecation-logging-logger-level/363387)
**Author:** [@Edmund\_Cheng](https://discuss.elastic.co/u/Edmund_Cheng)\ **Replies:** 2\ **Last updated:** [July 19, 2024, 6:52am UTC](https://discuss.elastic.co/t/deprecation-logging-logger-level/363387 "2024-07-19T06:52:10Z")
Hi, Just wanted to understand if there is any difference in terms of the message content if the level is set to WARN or INFO for deprecation logging? For e.g { "persistent": { "logger.org.elasticsearch.deprecati… --- ## [Can you please help me to move indexes from test VPS to server?](https://discuss.elastic.co/t/can-you-please-help-me-to-move-indexes-from-test-vps-to-server/363370)
**Author:** [@filmovtv](https://discuss.elastic.co/u/filmovtv)\ **Replies:** 0\ **Last updated:** [July 18, 2024, 6:09pm UTC](https://discuss.elastic.co/t/can-you-please-help-me-to-move-indexes-from-test-vps-to-server/363370 "2024-07-18T18:09:21Z")
Hello. Don't judge me harshly, I'm new to this business, for 5 days I can't transfer indexes from the test VPS to the server. I prepared and registered a repository and create a snapshot of all indexes on VPS here: /mo… --- ## [Access field that was excluded from \_source](https://discuss.elastic.co/t/access-field-that-was-excluded-from-source/363329)
**Author:** [@Chenko](https://discuss.elastic.co/u/Chenko)\ **Replies:** 6\ **Last updated:** [July 18, 2024, 2:17pm UTC](https://discuss.elastic.co/t/access-field-that-was-excluded-from-source/363329 "2024-07-18T14:17:50Z")
Hi, As mentioned in the title, I have an index with a few fields that are not included in the \_source field. I was wondering, since we can still search on these fields, is there a way to access their values? One solut… --- ## [Recommended shard quantity](https://discuss.elastic.co/t/recommended-shard-quantity/363298)
**Author:** [@Fernando\_Oliveira](https://discuss.elastic.co/u/Fernando_Oliveira)\ **Replies:** 2\ **Last updated:** [July 18, 2024, 2:02pm UTC](https://discuss.elastic.co/t/recommended-shard-quantity/363298 "2024-07-18T14:02:07Z")
Hello. I created a cluster following some practices for redundancy : 3 - node master 2 - node hot 2 - node warm What would be the recommended amount of shard for my index? --- ## [Setup small elasticsearch cluster](https://discuss.elastic.co/t/setup-small-elasticsearch-cluster/363310)
**Author:** [@vijay\_kaali](https://discuss.elastic.co/u/vijay_kaali)\ **Replies:** 2\ **Last updated:** [July 18, 2024, 1:39pm UTC](https://discuss.elastic.co/t/setup-small-elasticsearch-cluster/363310 "2024-07-18T13:39:35Z")
Hi i would like to install a small elasticsearch for monitoring 30 servers . have few questions how many elasticsearch nodes needed \[2 is fine?\] if availability not an issue ? how much memory/core do we need to start … --- ## [DataStream creates hidden indicas](https://discuss.elastic.co/t/datastream-creates-hidden-indicas/363347)
**Author:** [@Jeyhun\_Rahimov](https://discuss.elastic.co/u/Jeyhun_Rahimov)\ **Replies:** 3\ **Last updated:** [July 18, 2024, 1:00pm UTC](https://discuss.elastic.co/t/datastream-creates-hidden-indicas/363347 "2024-07-18T13:00:13Z")
I use Elastic.Serilog.Sinks lib to send logs to Elastic with Serilog. This code sends logs to ES, but the created indexes are hidden. Why? How can I set the index unhidden? How can I set the index format? public sta… --- ## [Elasticsearch failed to start when running with PVC in OKE](https://discuss.elastic.co/t/elasticsearch-failed-to-start-when-running-with-pvc-in-oke/363340)
**Author:** [@Praveen\_Reddy](https://discuss.elastic.co/u/Praveen_Reddy)\ **Replies:** 2\ **Last updated:** [July 18, 2024, 1:00pm UTC](https://discuss.elastic.co/t/elasticsearch-failed-to-start-when-running-with-pvc-in-oke/363340 "2024-07-18T13:00:00Z")
Elastic failing to start with below error. When i don't link any mount points then it is working. But when i link with PVC it fails to start. Looks like it is related to permission issue. "failed to obtain node locks, t… --- ## [Copy routing info from old index to new index](https://discuss.elastic.co/t/copy-routing-info-from-old-index-to-new-index/363320)
**Author:** [@abhadauria](https://discuss.elastic.co/u/abhadauria)\ **Replies:** 3\ **Last updated:** [July 18, 2024, 11:33am UTC](https://discuss.elastic.co/t/copy-routing-info-from-old-index-to-new-index/363320 "2024-07-18T11:33:43Z")
Hi Team, We want to reindex the data from older version of index(6.x) to new version(7.x) We have created new index using the same settings and mapping in ES cluster 7.17, tried to initiate re-indexing using below requ… --- ## [Upgrade from 6.8.23 to 7.3.2 fails with master not discovered yet](https://discuss.elastic.co/t/upgrade-from-6-8-23-to-7-3-2-fails-with-master-not-discovered-yet/363250)
**Author:** [@elastic\_noob1](https://discuss.elastic.co/u/elastic_noob1)\ **Replies:** 4\ **Last updated:** [July 18, 2024, 8:03am UTC](https://discuss.elastic.co/t/upgrade-from-6-8-23-to-7-3-2-fails-with-master-not-discovered-yet/363250 "2024-07-18T08:03:17Z")
I am testing upgrading our cluster from 6.8.23 to 7.3.2 but the ingest nodes fail the upgrade. Both master & data work fine. As per the documentation, this upgrade only needs rolling restart and doesn't require cluster.i… --- ## [Formatting Enriched field in Java](https://discuss.elastic.co/t/formatting-enriched-field-in-java/363135)
**Author:** [@always\_improving123](https://discuss.elastic.co/u/always_improving123)\ **Replies:** 5\ **Last updated:** [July 18, 2024, 7:24am UTC](https://discuss.elastic.co/t/formatting-enriched-field-in-java/363135 "2024-07-18T07:24:16Z")
Hello, I have implemented an enrich processor and I am trying to properly format the enrich index’s docs. For example, I have a source index with a nationality and an average height. I want to enrich an index that only … --- ## [Load JSON files to Elasticsearch Index](https://discuss.elastic.co/t/load-json-files-to-elasticsearch-index/363269)
**Author:** [@Debasis\_Mallick](https://discuss.elastic.co/u/Debasis_Mallick)\ **Replies:** 3\ **Last updated:** [July 18, 2024, 7:20am UTC](https://discuss.elastic.co/t/load-json-files-to-elasticsearch-index/363269 "2024-07-18T07:20:21Z")
Hi Team, Could you please share me how we can ingest json files to a Elasticsearch Index. Thanks, Debasis --- ## [What pillars of Zero Trust have been implemented in Elastic?](https://discuss.elastic.co/t/what-pillars-of-zero-trust-have-been-implemented-in-elastic/363088)
**Author:** [@mzm1370](https://discuss.elastic.co/u/mzm1370)\ **Replies:** 4\ **Last updated:** [July 17, 2024, 2:49pm UTC](https://discuss.elastic.co/t/what-pillars-of-zero-trust-have-been-implemented-in-elastic/363088 "2024-07-17T14:49:03Z")
Strong document of zero trust pillars being implemented in Elastic --- ## [Gitlab Elastic Integrations](https://discuss.elastic.co/t/gitlab-elastic-integrations/363259)
**Author:** [@Khaled\_Saidi](https://discuss.elastic.co/u/Khaled_Saidi)\ **Replies:** 2\ **Last updated:** [July 17, 2024, 1:48pm UTC](https://discuss.elastic.co/t/gitlab-elastic-integrations/363259 "2024-07-17T13:48:29Z")
Hello, Is someone already import one of these kibana dashboards : integrations/packages/elasticsearch/kibana/dashboard at main · elastic/integrations · GitHub How do you import them in kibana ? I tried to save into a… --- ## [Issue while indexing with custom analyzers](https://discuss.elastic.co/t/issue-while-indexing-with-custom-analyzers/363265)
**Author:** [@NSGokul](https://discuss.elastic.co/u/NSGokul)\ **Replies:** 3\ **Last updated:** [July 17, 2024, 1:10pm UTC](https://discuss.elastic.co/t/issue-while-indexing-with-custom-analyzers/363265 "2024-07-17T13:10:52Z")
I've created an Elasticsearch index with custom settings and analyzers to handle various text transformations. Here are the settings for my index: "settings": { "index": { "analysis": { "filter": { "… --- ## ["UnsatisfiedLinkError: libzstd.so" upon es v8.14.1 startup](https://discuss.elastic.co/t/unsatisfiedlinkerror-libzstd-so-upon-es-v8-14-1-startup/363234)
**Author:** [@buitcj](https://discuss.elastic.co/u/buitcj)\ **Replies:** 1\ **Last updated:** [July 17, 2024, 12:56pm UTC](https://discuss.elastic.co/t/unsatisfiedlinkerror-libzstd-so-upon-es-v8-14-1-startup/363234 "2024-07-17T12:56:29Z")
Sometimes and not always, upon startup, I see the following error message, complaining that libzstd.so is not present. Indeed it is not on the image. However, what confuses me is that a) I don't see any installation requ… --- ## [Issue with Nested Sorting in Opensearch Query](https://discuss.elastic.co/t/issue-with-nested-sorting-in-opensearch-query/363264)
**Author:** [@Bhushan\_Kakulte](https://discuss.elastic.co/u/Bhushan_Kakulte)\ **Replies:** 1\ **Last updated:** [July 17, 2024, 12:49pm UTC](https://discuss.elastic.co/t/issue-with-nested-sorting-in-opensearch-query/363264 "2024-07-17T12:49:44Z")
Hi everyone, I’m encountering an issue with sorting nested fields in an Elasticsearch query. Despite following the documentation, the sorting doesn’t seem to work as expected. I’m hoping someone can point out what I’m d… --- ## [\[Error\]Remote reindex connect\_exception with Timeout](https://discuss.elastic.co/t/error-remote-reindex-connect-exception-with-timeout/363276)
**Author:** [@unumed-umbo](https://discuss.elastic.co/u/unumed-umbo)\ **Replies:** 0\ **Last updated:** [July 17, 2024, 11:33am UTC](https://discuss.elastic.co/t/error-remote-reindex-connect-exception-with-timeout/363276 "2024-07-17T11:33:59Z")
I'm trying to reindex from a remote from Self Manged instance to an Elastic cloud instance. But I'm getting a timeout error: {"error":{"root\_cause":\[{"type":"connect\_exception","reason":"Timeout connecting to \[XXXX.el… --- ## [Search for a a list of phrases in Elasticsearch](https://discuss.elastic.co/t/search-for-a-a-list-of-phrases-in-elasticsearch/363251)
**Author:** [@jahedi](https://discuss.elastic.co/u/jahedi)\ **Replies:** 4\ **Last updated:** [July 17, 2024, 7:50am UTC](https://discuss.elastic.co/t/search-for-a-a-list-of-phrases-in-elasticsearch/363251 "2024-07-17T07:50:45Z")
Hi, I was looking for a solution that I can search for a list of phrases. for example consider this list: \["foo", "bar", "the baz"\] if a give this search words as a search query in the Elasticsearch query, it will sepa… [Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=92) [Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=94)