# Elastic Search **URL:** https://discuss.elastic.co/c/search/84.md?page=11 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 12 --- ## [Datastreams losing indices](https://discuss.elastic.co/t/datastreams-losing-indices/369404)
**Author:** [@sbocquet](https://discuss.elastic.co/u/sbocquet)\ **Replies:** 3\ **Last updated:** [October 25, 2024, 9:47am UTC](https://discuss.elastic.co/t/datastreams-losing-indices/369404 "2024-10-25T09:47:12Z")
Hi, I'm facing some strange things with my ELK stack. Since 2/3 days, some datastreams have lost some indices, storage size went to 0 docs and 0b ! Those indices are random in the timeline. It also seems to not write … --- ## [Experiencing a delay in Elasticsearch index logs](https://discuss.elastic.co/t/experiencing-a-delay-in-elasticsearch-index-logs/369347)
**Author:** [@Shaista](https://discuss.elastic.co/u/Shaista)\ **Replies:** 1\ **Last updated:** [October 25, 2024, 12:37am UTC](https://discuss.elastic.co/t/experiencing-a-delay-in-elasticsearch-index-logs/369347 "2024-10-25T00:37:54Z")
We are experiencing a delay in logs being ingested into the Elasticsearch. While investigating we are getting below mentioned Error in Elasticsearch logs. Logs are being ingested from the application via Filebeat, proce… --- ## [Pipeline attachment - multiple doc](https://discuss.elastic.co/t/pipeline-attachment-multiple-doc/369345)
**Author:** [@Mire](https://discuss.elastic.co/u/Mire)\ **Replies:** 3\ **Last updated:** [October 24, 2024, 10:58am UTC](https://discuss.elastic.co/t/pipeline-attachment-multiple-doc/369345 "2024-10-24T10:58:06Z")
Hi there, im trying to post multiple attachments for index. Same example we have on official. This is my mapping: PUT \_ingest/pipeline/attachment { "description" : "Extract attachment information from arrays", "pro… --- ## [How to efficiently implement pagination along with aggregation?](https://discuss.elastic.co/t/how-to-efficiently-implement-pagination-along-with-aggregation/369281)
**Author:** [@sudhi\_desigan](https://discuss.elastic.co/u/sudhi_desigan)\ **Replies:** 0\ **Last updated:** [October 23, 2024, 11:54am UTC](https://discuss.elastic.co/t/how-to-efficiently-implement-pagination-along-with-aggregation/369281 "2024-10-23T11:54:33Z")
If I prefer composite aggregation, then for say Nth page, I need to query (n-1) times to get after\_key value which is inefficient. Can someone please suggest efficient way to achieve the same? --- ## [Best way to do a Bulk update with script](https://discuss.elastic.co/t/best-way-to-do-a-bulk-update-with-script/369017)
**Author:** [@Matt\_Shallow](https://discuss.elastic.co/u/Matt_Shallow)\ **Replies:** 6\ **Last updated:** [October 22, 2024, 6:06pm UTC](https://discuss.elastic.co/t/best-way-to-do-a-bulk-update-with-script/369017 "2024-10-22T18:06:49Z")
I have been following a bulk update example to do a bulk update on my index however I get the following error: Validation Failed: 1: can't provide both script and doc; The below code is what is giving the error. var… --- ## [Backup and restore a managed ELK to Azure Blob](https://discuss.elastic.co/t/backup-and-restore-a-managed-elk-to-azure-blob/369199)
**Author:** [@hegazy](https://discuss.elastic.co/u/hegazy)\ **Replies:** 0\ **Last updated:** [October 22, 2024, 9:05am UTC](https://discuss.elastic.co/t/backup-and-restore-a-managed-elk-to-azure-blob/369199 "2024-10-22T09:05:15Z")
We have a managed ELK instance on elastic.co with URL similar to: randomname.us-central1.gcp.cloud..io:9243 The instance is fully managed by Elastic and we dont have a server access. We want to backup the indexes to… --- ## [Elastic crawler metadata content extraction](https://discuss.elastic.co/t/elastic-crawler-metadata-content-extraction/369160)
**Author:** [@pngworkforce](https://discuss.elastic.co/u/pngworkforce)\ **Replies:** 2\ **Last updated:** [October 21, 2024, 3:03pm UTC](https://discuss.elastic.co/t/elastic-crawler-metadata-content-extraction/369160 "2024-10-21T15:03:21Z")
Hello! Is there a way to extract html metadata fields with the elastic crawler without setting the class=“elastic” on them? We have inherited a large flat file html site we would like to index and it would take signifi… --- ## [Ignoring robots noindex / nofollow in Elastic crawler](https://discuss.elastic.co/t/ignoring-robots-noindex-nofollow-in-elastic-crawler/369104)
**Author:** [@pngworkforce](https://discuss.elastic.co/u/pngworkforce)\ **Replies:** 3\ **Last updated:** [October 21, 2024, 2:57pm UTC](https://discuss.elastic.co/t/ignoring-robots-noindex-nofollow-in-elastic-crawler/369104 "2024-10-21T14:57:48Z")
Hello! Is there a way to ignore the meta robots nofollow / noindex in the Elastic crawler settings? If not, is there some other way to filter these meta fields out? We have a development site with these robots meta ta… --- ## [How to restrict documents to only include the wildcard search phrase?](https://discuss.elastic.co/t/how-to-restrict-documents-to-only-include-the-wildcard-search-phrase/368949)
**Author:** [@dev8100](https://discuss.elastic.co/u/dev8100)\ **Replies:** 6\ **Last updated:** [October 18, 2024, 5:57pm UTC](https://discuss.elastic.co/t/how-to-restrict-documents-to-only-include-the-wildcard-search-phrase/368949 "2024-10-18T17:57:14Z")
I want to do a wild card search below to return results that only include the phrase "joe smith". This works but it also includes records without his name. I've played with the "min\_score" value to help on this but I wa… --- ## [Bulk insert from file, SSL record too big](https://discuss.elastic.co/t/bulk-insert-from-file-ssl-record-too-big/366839)
**Author:** [@Terry\_Lowery](https://discuss.elastic.co/u/Terry_Lowery)\ **Replies:** 13\ **Last updated:** [October 18, 2024, 3:53pm UTC](https://discuss.elastic.co/t/bulk-insert-from-file-ssl-record-too-big/366839 "2024-10-18T15:53:09Z")
Hello all, I am trying to following along with an acloud.guru ES deep dive and there is a section that you bulk insert ndjson files. I also tried the curl examples from elasic.co I receive the follow from curl: \* Ab… --- ## [Exception occur while fetching data from elastic: Error for search request](https://discuss.elastic.co/t/exception-occur-while-fetching-data-from-elastic-error-for-search-request/369040)
**Author:** [@Shaista](https://discuss.elastic.co/u/Shaista)\ **Replies:** 3\ **Last updated:** [October 18, 2024, 10:05am UTC](https://discuss.elastic.co/t/exception-occur-while-fetching-data-from-elastic-error-for-search-request/369040 "2024-10-18T10:05:26Z")
Hi Team, We are facing below issue for the Elasticsearch. Can you tell me why this issue occur and how can it resolved. Exception occur while fetching data from elastic: Error for search request: SearchRequest (searchT… --- ## [Is an index template required when storing 64-bit unsigned integers](https://discuss.elastic.co/t/is-an-index-template-required-when-storing-64-bit-unsigned-integers/369029)
**Author:** [@Ken\_Rowland](https://discuss.elastic.co/u/Ken_Rowland)\ **Replies:** 1\ **Last updated:** [October 18, 2024, 2:11am UTC](https://discuss.elastic.co/t/is-an-index-template-required-when-storing-64-bit-unsigned-integers/369029 "2024-10-18T02:11:05Z")
Hello, I am working on a C++ native component that will store metric data in Elastic Search. From what I can tell, dynamic data mapping will not handle unsigned 64-bit numbers. So, my conclusion is that I need an index … --- ## [Vector databases with LlamaIndex & Elastic](https://discuss.elastic.co/t/vector-databases-with-llamaindex-elastic/369014)
**Author:** [@Maysen\_Holder](https://discuss.elastic.co/u/Maysen_Holder)\ **Replies:** 0\ **Last updated:** [October 17, 2024, 4:28pm UTC](https://discuss.elastic.co/t/vector-databases-with-llamaindex-elastic/369014 "2024-10-17T16:28:48Z")
Hey there everyone! We are starting a thread to discuss a recent webinar we hosted with LlamaIndex on vector databases. Add in your questions for Elastic and LlamaIndex here! --- ## [GeoIP DB update issue](https://discuss.elastic.co/t/geoip-db-update-issue/368776)
**Author:** [@rahulm](https://discuss.elastic.co/u/rahulm)\ **Replies:** 4\ **Last updated:** [October 17, 2024, 1:53pm UTC](https://discuss.elastic.co/t/geoip-db-update-issue/368776 "2024-10-17T13:53:37Z")
Hi, I have an issue of geoip DB not automatically updating. i use ubuntu 22 and i had set up a proxy. Proxy details are set up in /etc/environment. in elasticsearch.yml i had added poll.interval="1d", so that an upda… --- ## [Prefix query not matching any documents](https://discuss.elastic.co/t/prefix-query-not-matching-any-documents/368943)
**Author:** [@michalderlatka](https://discuss.elastic.co/u/michalderlatka)\ **Replies:** 3\ **Last updated:** [October 17, 2024, 12:56pm UTC](https://discuss.elastic.co/t/prefix-query-not-matching-any-documents/368943 "2024-10-17T12:56:38Z")
I have a document with name field containing "CT17 TRANSPARENT GRUNT 2L HENKEL" text. I'm trying to do match\_bool\_prefix query and I've got weird results. If i search for "ct17 grunt hen" it gives me this document. Sam… --- ## [To run self managed elastic connector natively](https://discuss.elastic.co/t/to-run-self-managed-elastic-connector-natively/368836)
**Author:** [@rahul5](https://discuss.elastic.co/u/rahul5)\ **Replies:** 1\ **Last updated:** [October 15, 2024, 3:04pm UTC](https://discuss.elastic.co/t/to-run-self-managed-elastic-connector-natively/368836 "2024-10-15T15:04:35Z")
I am trying to run elastic sharepoint connector from docker. Could someone guide me how to run and setup stack and connector locally on WINDOWS, windows is hard requirement .Thanks --- ## [How do I hire a consultant to help design one integration](https://discuss.elastic.co/t/how-do-i-hire-a-consultant-to-help-design-one-integration/368839)
**Author:** [@Patrick\_Bonnereau](https://discuss.elastic.co/u/Patrick_Bonnereau)\ **Replies:** 1\ **Last updated:** [October 15, 2024, 12:03pm UTC](https://discuss.elastic.co/t/how-do-i-hire-a-consultant-to-help-design-one-integration/368839 "2024-10-15T12:03:38Z")
My startup tolky.to uses Supabase to operante RAG with semantic Search. Now, we need to deal with big ammounts of data and also we need to filter the data before ranking It. The Arquitectura we already have is not trivi… --- ## [Why ES allow indexing numerical values with double quotes, when field type is set to double and dynamic mapping is off (strict)?](https://discuss.elastic.co/t/why-es-allow-indexing-numerical-values-with-double-quotes-when-field-type-is-set-to-double-and-dynamic-mapping-is-off-strict/368745)
**Author:** [@luoczeng](https://discuss.elastic.co/u/luoczeng)\ **Replies:** 4\ **Last updated:** [October 15, 2024, 2:41am UTC](https://discuss.elastic.co/t/why-es-allow-indexing-numerical-values-with-double-quotes-when-field-type-is-set-to-double-and-dynamic-mapping-is-off-strict/368745 "2024-10-15T02:41:24Z")
Hi folks, I was having a question recently that why ES would allow indexing numerical values with double quotes, when field type is set to double and dynamic mapping is off (strict)? Below are my dummy index settings: … --- ## [Latest unique transform missing documents](https://discuss.elastic.co/t/latest-unique-transform-missing-documents/368700)
**Author:** [@Phil\_McLachlan](https://discuss.elastic.co/u/Phil_McLachlan)\ **Replies:** 1\ **Last updated:** [October 11, 2024, 9:18pm UTC](https://discuss.elastic.co/t/latest-unique-transform-missing-documents/368700 "2024-10-11T21:18:05Z")
We have what I believe to be a straightforward transform to pick out unique documents ordered by an ingest pipeline timestamp. We apply it to several programs (customers) index data, but with larger data it is missing d… --- ## [Rolling upgrade 6.8 cluster to 7.10, node cannot connect back to cluster](https://discuss.elastic.co/t/rolling-upgrade-6-8-cluster-to-7-10-node-cannot-connect-back-to-cluster/368649)
**Author:** [@lhiboudoux](https://discuss.elastic.co/u/lhiboudoux)\ **Replies:** 1\ **Last updated:** [October 10, 2024, 11:13pm UTC](https://discuss.elastic.co/t/rolling-upgrade-6-8-cluster-to-7-10-node-cannot-connect-back-to-cluster/368649 "2024-10-10T23:13:28Z")
Hello, Currently trying to upgrade a bare metal cluster, with 3 master/data nodes. All of which are running CentOS 7, and containing similar hardware. Data is stored on a separate raid volume. I had been following the … --- ## [Elser service can't index large amount of data](https://discuss.elastic.co/t/elser-service-cant-index-large-amount-of-data/368527)
**Author:** [@overflowalligator](https://discuss.elastic.co/u/overflowalligator)\ **Replies:** 2\ **Last updated:** [October 10, 2024, 2:23pm UTC](https://discuss.elastic.co/t/elser-service-cant-index-large-amount-of-data/368527 "2024-10-10T14:23:49Z")
I am creating an index with semantic serach using the semantic\_text field type and following this tutorial here. I've created the inference endpoint deployment with the following configurations: { "inference\_id": "my… --- ## [NEWBIE: Choosing right solution for document indexing](https://discuss.elastic.co/t/newbie-choosing-right-solution-for-document-indexing/368617)
**Author:** [@Andre72](https://discuss.elastic.co/u/Andre72)\ **Replies:** 4\ **Last updated:** [October 10, 2024, 12:05pm UTC](https://discuss.elastic.co/t/newbie-choosing-right-solution-for-document-indexing/368617 "2024-10-10T12:05:03Z")
Hi, I like to use elasticsearch for indexing word documents. Now I research what is the best enviroment for setup. What I need is one node for each language of docs. A simple web interface for searching would be also… --- ## [Elasticsearch 8.15.1 and Connectors 9.0.0 are incompatible](https://discuss.elastic.co/t/elasticsearch-8-15-1-and-connectors-9-0-0-are-incompatible/368581)
**Author:** [@Andy\_Ryu](https://discuss.elastic.co/u/Andy_Ryu)\ **Replies:** 2\ **Last updated:** [October 10, 2024, 5:44am UTC](https://discuss.elastic.co/t/elasticsearch-8-15-1-and-connectors-9-0-0-are-incompatible/368581 "2024-10-10T05:44:49Z")
Why do I get the following error? Please help. user@USER-PC:~/connectors$ make run python3 -m venv .venv .venv/bin/pip install --upgrade pip Requirement already satisfied: pip in ./.venv/lib/python3.12/site-packages … --- ## [Match\_phrase vs simple\_query\_string](https://discuss.elastic.co/t/match-phrase-vs-simple-query-string/368560)
**Author:** [@sdmccorm](https://discuss.elastic.co/u/sdmccorm)\ **Replies:** 2\ **Last updated:** [October 9, 2024, 10:18pm UTC](https://discuss.elastic.co/t/match-phrase-vs-simple-query-string/368560 "2024-10-09T22:18:48Z")
Folks - I'm not even sure what kind of search this is called. I'm searching some logs, but the problem is each log starts with the same text - but the string can end with other text. Is there a way to do this without r… --- ## [Basic sync rules with subfield](https://discuss.elastic.co/t/basic-sync-rules-with-subfield/368494)
**Author:** [@Ankur\_Mathur](https://discuss.elastic.co/u/Ankur_Mathur)\ **Replies:** 2\ **Last updated:** [October 9, 2024, 10:42am UTC](https://discuss.elastic.co/t/basic-sync-rules-with-subfield/368494 "2024-10-09T10:42:18Z")
Basic sync rules of fields having subfield is not working. For example If there is an object field manager with a subfield age , then a basic rule to exclude manager.age \> 30 is not workig. What could be wrong here? --- ## [Elastic Connector cannot talk to ElasticSearch at 9200](https://discuss.elastic.co/t/elastic-connector-cannot-talk-to-elasticsearch-at-9200/368430)
**Author:** [@sami-obvio](https://discuss.elastic.co/u/sami-obvio)\ **Replies:** 2\ **Last updated:** [October 8, 2024, 10:48am UTC](https://discuss.elastic.co/t/elastic-connector-cannot-talk-to-elasticsearch-at-9200/368430 "2024-10-08T10:48:18Z")
I have an Elastic node running on https://localhost:9200 using Docker (using the tutorial on elastic's website here: Install Elasticsearch with Docker | Elasticsearch Guide \[8.15\] | Elastic) I can curl to it using a ca\_… --- ## [Elastic native connector - SharePoint](https://discuss.elastic.co/t/elastic-native-connector-sharepoint/368316)
**Author:** [@hogono\_comm](https://discuss.elastic.co/u/hogono_comm)\ **Replies:** 1\ **Last updated:** [October 7, 2024, 11:17am UTC](https://discuss.elastic.co/t/elastic-native-connector-sharepoint/368316 "2024-10-07T11:17:22Z")
I am trying to run the Elastic search native Sharepoint connector from my Elastic cloud account. I have made all the necessary configuration as per documentation guidelines and granted all the required permission in my S… --- ## [Elastic Connector framework](https://discuss.elastic.co/t/elastic-connector-framework/368163)
**Author:** [@rahul5](https://discuss.elastic.co/u/rahul5)\ **Replies:** 1\ **Last updated:** [October 3, 2024, 9:28pm UTC](https://discuss.elastic.co/t/elastic-connector-framework/368163 "2024-10-03T21:28:28Z")
Hii , Does anyone have any good documentation where how elastic connector testing works and how to do it. In official documentation there is very small part. --- ## [Best APIs to Visualize Suricata Logs and Setup Alerts in ELK-Django Stack - Useful Aggregations](https://discuss.elastic.co/t/best-apis-to-visualize-suricata-logs-and-setup-alerts-in-elk-django-stack-useful-aggregations/368051)
**Author:** [@Chungsup\_Lim](https://discuss.elastic.co/u/Chungsup_Lim)\ **Replies:** 1\ **Last updated:** [October 1, 2024, 9:30am UTC](https://discuss.elastic.co/t/best-apis-to-visualize-suricata-logs-and-setup-alerts-in-elk-django-stack-useful-aggregations/368051 "2024-10-01T09:30:29Z")
Hi, I'm working on a group project where we use Suricata for network security monitoring and have integrated it with the ELK stack (Elasticsearch, Logstash, Kibana, and Filebeat) and Django to create a real-time securit… --- ## [Data cannot be queried by querying the time part of the log](https://discuss.elastic.co/t/data-cannot-be-queried-by-querying-the-time-part-of-the-log/366783)
**Author:** [@canli12138](https://discuss.elastic.co/u/canli12138)\ **Replies:** 7\ **Last updated:** [September 30, 2024, 6:15am UTC](https://discuss.elastic.co/t/data-cannot-be-queried-by-querying-the-time-part-of-the-log/366783 "2024-09-30T06:15:04Z")
The data cannot be queried by querying the time part of the log. For example, the log content is XX:2024-08-22 17:53:05.947(35561|35863) XXXX:XXXXX, and the data cannot be queried by log:17:53:05. // log:17:53:05 [Previous page](https://discuss.elastic.co/c/search/84.md?page=10) [Next page](https://discuss.elastic.co/c/search/84.md?page=12)