# Elasticsearch **URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=497 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 498 --- ## [How to mock responses in Nest like IndexResponse](https://discuss.elastic.co/t/how-to-mock-responses-in-nest-like-indexresponse/296609)
**Author:** [@Another-Ralf](https://discuss.elastic.co/u/Another-Ralf)\ **Replies:** 0\ **Last updated:** [February 8, 2022, 1:54pm UTC](https://discuss.elastic.co/t/how-to-mock-responses-in-nest-like-indexresponse/296609 "2022-02-08T13:54:35Z")
I'm using the .Net Nest client to connect to an Elasticsearch instance. I want to test my code that is calling Nest and wanted to mock Nest away. Currently fighting with mocking the ElasticClient.IndexAsync method. It… --- ## [GROK Expression Invalid JSON](https://discuss.elastic.co/t/grok-expression-invalid-json/296603)
**Author:** [@jamesm1](https://discuss.elastic.co/u/jamesm1)\ **Replies:** 1\ **Last updated:** [February 8, 2022, 1:39pm UTC](https://discuss.elastic.co/t/grok-expression-invalid-json/296603 "2022-02-08T13:39:40Z")
Hello - I am attempting to create a GROK expression for an APACHE log. I have gotten the expression working in the GROK debugger and other tools - However when i try to add it in as a line into the Ingestion Pipeline i … --- ## [Help: Format The Watcher Email Body Section](https://discuss.elastic.co/t/help-format-the-watcher-email-body-section/295565)
**Author:** [@appleyin1](https://discuss.elastic.co/u/appleyin1)\ **Replies:** 1\ **Last updated:** [February 8, 2022, 1:36pm UTC](https://discuss.elastic.co/t/help-format-the-watcher-email-body-section/295565 "2022-02-08T13:36:04Z")
Hi there: I'm currently using this code {{ctx.payload.payload\_result}} in my email body to print out the health check status but the format is not ideal (see below), is there a way I can organize it nicely(see proposed … --- ## [Use JSON in Watcher webhook body](https://discuss.elastic.co/t/use-json-in-watcher-webhook-body/295349)
**Author:** [@rosaLux161](https://discuss.elastic.co/u/rosaLux161)\ **Replies:** 1\ **Last updated:** [February 8, 2022, 1:35pm UTC](https://discuss.elastic.co/t/use-json-in-watcher-webhook-body/295349 "2022-02-08T13:35:03Z")
How is it possible to use plain JSON in Watcher webhook body? Just putting the plain JSON in the body { \[...\] "actions":{ "opsgenie":{ "webhook":{ "method":"POST", "ho… --- ## [Access denied error message for mail IDs](https://discuss.elastic.co/t/access-denied-error-message-for-mail-ids/295540)
**Author:** [@Diyatom](https://discuss.elastic.co/u/Diyatom)\ **Replies:** 1\ **Last updated:** [February 8, 2022, 1:34pm UTC](https://discuss.elastic.co/t/access-denied-error-message-for-mail-ids/295540 "2022-02-08T13:34:17Z")
Hi Everyone, I am trying to send a mail from a watcher alert to my personal mail iD but it gives the following error : "type": "s\_m\_t\_p\_address\_failed\_exception", "reason": "554 5.7.1 \:… --- ## [Limit privileges for ElasticSearch Service API Key](https://discuss.elastic.co/t/limit-privileges-for-elasticsearch-service-api-key/296599)
**Author:** [@sz\_bb](https://discuss.elastic.co/u/sz_bb)\ **Replies:** 0\ **Last updated:** [February 8, 2022, 1:21pm UTC](https://discuss.elastic.co/t/limit-privileges-for-elasticsearch-service-api-key/296599 "2022-02-08T13:21:35Z")
Elastic Cloud. need to be able to register secrets in the Elasticsearch Keystore. This can be done with the ElasticSearch Service API. However, in order to use this API you create an Api Key. The API key has no expira… --- ## [Aggregating object keys to achieve a sum](https://discuss.elastic.co/t/aggregating-object-keys-to-achieve-a-sum/296193)
**Author:** [@hugomeloo](https://discuss.elastic.co/u/hugomeloo)\ **Replies:** 5\ **Last updated:** [February 8, 2022, 1:10pm UTC](https://discuss.elastic.co/t/aggregating-object-keys-to-achieve-a-sum/296193 "2022-02-08T13:10:32Z")
I am trying to make an aggregation in which I can sum a number from a specific key of an object. As an example: curl -XPUT "localhost:9200/products/\_mapping" -H 'Content-Type: application/json' -d' { "properties": { … --- ## [With final\_pipeline and a pipeline specified, the final pipeline appears to be running twice with index date math processor](https://discuss.elastic.co/t/with-final-pipeline-and-a-pipeline-specified-the-final-pipeline-appears-to-be-running-twice-with-index-date-math-processor/296593)
**Author:** [@ed.yoo](https://discuss.elastic.co/u/ed.yoo)\ **Replies:** 0\ **Last updated:** [February 8, 2022, 12:20pm UTC](https://discuss.elastic.co/t/with-final-pipeline-and-a-pipeline-specified-the-final-pipeline-appears-to-be-running-twice-with-index-date-math-processor/296593 "2022-02-08T12:20:13Z")
Testing on 7.6.2, the following code works fine in using a final\_pipeline and a pipeline for the index. Using the same code and updated index template code, it actually appears to run twice on 7.15.2 (and 7.16.0). The … --- ## [Transforms on data older than a specific timestamp: checkpoints are not created](https://discuss.elastic.co/t/transforms-on-data-older-than-a-specific-timestamp-checkpoints-are-not-created/296483)
**Author:** [@paulov](https://discuss.elastic.co/u/paulov)\ **Replies:** 2\ **Last updated:** [February 8, 2022, 10:29am UTC](https://discuss.elastic.co/t/transforms-on-data-older-than-a-specific-timestamp-checkpoints-are-not-created/296483 "2022-02-08T10:29:09Z")
Continuing the discussion from ES Continuous Transforms Checkpoint not updating: Hi, I'm creating a transform job that transforms data in an index and takes all documents OLDER THAN 6 days (calculating averages etc). … --- ## [Why doesn't we run 'Basic' any longer, but 'Trial'?](https://discuss.elastic.co/t/why-doesnt-we-run-basic-any-longer-but-trial/296572)
**Author:** [@fribse](https://discuss.elastic.co/u/fribse)\ **Replies:** 0\ **Last updated:** [February 8, 2022, 10:10am UTC](https://discuss.elastic.co/t/why-doesnt-we-run-basic-any-longer-but-trial/296572 "2022-02-08T10:10:45Z")
I followed this guide (to set up Elasticsearch with ssl, which I understand is now required for 7.16.+): Encrypting communications in an Elasticsearch Docker Container | Elasticsearch Guide \[7.17\] | Elastic It sets it u… --- ## [The latch in BulkRequestHandler.execute is unnecessary](https://discuss.elastic.co/t/the-latch-in-bulkrequesthandler-execute-is-unnecessary/296570)
**Author:** [@asce0705](https://discuss.elastic.co/u/asce0705)\ **Replies:** 0\ **Last updated:** [February 8, 2022, 9:45am UTC](https://discuss.elastic.co/t/the-latch-in-bulkrequesthandler-execute-is-unnecessary/296570 "2022-02-08T09:45:15Z")
The latch in BulkRequestHandler is added before to ensure that the new handler executes a bulk request and awaits for the completion if the BulkProcessor was configured with a concurrentRequests setting of 0. The related… --- ## [Editing elasticsearch.yml file](https://discuss.elastic.co/t/editing-elasticsearch-yml-file/296561)
**Author:** [@Abhi\_Abhishek](https://discuss.elastic.co/u/Abhi_Abhishek)\ **Replies:** 1\ **Last updated:** [February 8, 2022, 9:00am UTC](https://discuss.elastic.co/t/editing-elasticsearch-yml-file/296561 "2022-02-08T09:00:50Z")
Hello Greetings of the day @Lisa\_Jung @warkolm @xeraa Is it possible to edit Elasticsearch.yml file through API in Kibana? If their is a way please help me. --- ## [Detect update in Elastic index and call an action](https://discuss.elastic.co/t/detect-update-in-elastic-index-and-call-an-action/296509)
**Author:** [@Laetitia\_RICHARD](https://discuss.elastic.co/u/Laetitia_RICHARD)\ **Replies:** 2\ **Last updated:** [February 8, 2022, 8:04am UTC](https://discuss.elastic.co/t/detect-update-in-elastic-index-and-call-an-action/296509 "2022-02-08T08:04:38Z")
Hello, I'd like to detect updates in my index (updated, created or deleted document) and call an Amazon API Gateway. First, I thought about using Watcher but it seems that I can't detect real time modifications in my ind… --- ## [Es7.16, two indexes have same field cost conflicting type?](https://discuss.elastic.co/t/es7-16-two-indexes-have-same-field-cost-conflicting-type/295667)
**Author:** [@zhanghaocai](https://discuss.elastic.co/u/zhanghaocai)\ **Replies:** 8\ **Last updated:** [February 8, 2022, 7:37am UTC](https://discuss.elastic.co/t/es7-16-two-indexes-have-same-field-cost-conflicting-type/295667 "2022-02-08T07:37:44Z")
I have two indexes. PUT /test1 { "settings": { "number\_of\_shards": 1, "number\_of\_replicas": 0 }, "mappings": { "properties": { "name": { "type": "text" } } } } PUT /test2 { "settings": {… --- ## [Failed to load plugin class \[org.elasticsearch.xpack.core.XPackPlugin\]](https://discuss.elastic.co/t/failed-to-load-plugin-class-org-elasticsearch-xpack-core-xpackplugin/296531)
**Author:** [@Ravi\_Bhushan](https://discuss.elastic.co/u/Ravi_Bhushan)\ **Replies:** 7\ **Last updated:** [February 8, 2022, 4:28am UTC](https://discuss.elastic.co/t/failed-to-load-plugin-class-org-elasticsearch-xpack-core-xpackplugin/296531 "2022-02-08T04:28:11Z")
Hi All, I am trying to install Elasticsearch 6.8.23 Opensource version in Docker swarm. What I understand from document i that xpack is available in free version to implement node & http communication. Please correct m… --- ## [Slow query for high frequency terms](https://discuss.elastic.co/t/slow-query-for-high-frequency-terms/296528)
**Author:** [@Brodin](https://discuss.elastic.co/u/Brodin)\ **Replies:** 0\ **Last updated:** [February 7, 2022, 9:55pm UTC](https://discuss.elastic.co/t/slow-query-for-high-frequency-terms/296528 "2022-02-07T21:55:12Z")
In a index with movie titles there area vast majority with the word “the” in them. Doing a match query for said word leads to a very slow operation due to the expensive ranking that has to be done on a large part or the… --- ## [Exist any limitations on how a \_id document field could be](https://discuss.elastic.co/t/exist-any-limitations-on-how-a-id-document-field-could-be/296344)
**Author:** [@Silver137](https://discuss.elastic.co/u/Silver137)\ **Replies:** 3\ **Last updated:** [February 7, 2022, 9:15pm UTC](https://discuss.elastic.co/t/exist-any-limitations-on-how-a-id-document-field-could-be/296344 "2022-02-07T21:15:18Z")
I always notice that the \_id field of any index created is normaly a uuid, hash value or a simple numeric sucession depending of the use case. My question is if there are any limitation in the form and aspect when choos… --- ## [Elastic agent / fleet server fails to install /connect to elastic search - Error: certificate is required when certificate private key is provided](https://discuss.elastic.co/t/elastic-agent-fleet-server-fails-to-install-connect-to-elastic-search-error-certificate-is-required-when-certificate-private-key-is-provided/296516)
**Author:** [@ajj31](https://discuss.elastic.co/u/ajj31)\ **Replies:** 0\ **Last updated:** [February 7, 2022, 7:15pm UTC](https://discuss.elastic.co/t/elastic-agent-fleet-server-fails-to-install-connect-to-elastic-search-error-certificate-is-required-when-certificate-private-key-is-provided/296516 "2022-02-07T19:15:24Z")
sudo ./elastic-agent install --url=https://szu.azhszzz.com:8220 --fleet-server-es=https://szu.azhszzz.com:9200 --fleet-server-service-token=AAEAAWVsYXN0aWMvZmxlZXQtc2VydmVyL3Rva2VuLTE2NDQxNDU0Njc3NDY6eDR4UTVSZ3lUbi1F… --- ## [Un-Assigned Shards after the restart of the ES cluster on Kubernetes](https://discuss.elastic.co/t/un-assigned-shards-after-the-restart-of-the-es-cluster-on-kubernetes/296423)
**Author:** [@pulir](https://discuss.elastic.co/u/pulir)\ **Replies:** 8\ **Last updated:** [February 7, 2022, 5:08pm UTC](https://discuss.elastic.co/t/un-assigned-shards-after-the-restart-of-the-es-cluster-on-kubernetes/296423 "2022-02-07T17:08:04Z")
I am using Elasticsearch 7.10.2 deployed on k8s cluster. The master and data nodes are backed by PVs for persisting the data. I have created a Cluster of 3 master and 3 data nodes, with 2 client nodes dedicated. My probl… --- ## [Elasticsearch: Automatically setting index level settings for daily indexes](https://discuss.elastic.co/t/elasticsearch-automatically-setting-index-level-settings-for-daily-indexes/296505)
**Author:** [@ege](https://discuss.elastic.co/u/ege)\ **Replies:** 2\ **Last updated:** [February 7, 2022, 5:35pm UTC](https://discuss.elastic.co/t/elasticsearch-automatically-setting-index-level-settings-for-daily-indexes/296505 "2022-02-07T17:35:52Z")
I need to increase the, maximum value of documents retrieved by an Elasticsearch query maximum number of script\_fields that are allowed in a query After refering this, I used the update-index-settings API as below, fo… --- ## [Query String on version 6 and above](https://discuss.elastic.co/t/query-string-on-version-6-and-above/296498)
**Author:** [@guilherme\_maranhao](https://discuss.elastic.co/u/guilherme_maranhao)\ **Replies:** 0\ **Last updated:** [February 7, 2022, 4:27pm UTC](https://discuss.elastic.co/t/query-string-on-version-6-and-above/296498 "2022-02-07T16:27:23Z")
Hi everybody, I'm currently working with ES 5.5 and using query\_string as my full-text search DSL. Our search contains multiple fields, with multiple boosts, and some of them are short string fields and other ones are … --- ## [Data Node Roles](https://discuss.elastic.co/t/data-node-roles/296482)
**Author:** [@Enis\_Kollugil](https://discuss.elastic.co/u/Enis_Kollugil)\ **Replies:** 1\ **Last updated:** [February 7, 2022, 3:16pm UTC](https://discuss.elastic.co/t/data-node-roles/296482 "2022-02-07T15:16:52Z")
Hello everyone, We need some hints for a situation. We have an Elasticsearch cluster with version 7.10 and we configure it for data nodes as follows. node.master: false node.data: true node.ingest: true However, when… --- ## [Roll Up for \_size field / Archive \_size field for statistics](https://discuss.elastic.co/t/roll-up-for-size-field-archive-size-field-for-statistics/296485)
**Author:** [@Kosodrom](https://discuss.elastic.co/u/Kosodrom)\ **Replies:** 0\ **Last updated:** [February 7, 2022, 2:48pm UTC](https://discuss.elastic.co/t/roll-up-for-size-field-archive-size-field-for-statistics/296485 "2022-02-07T14:48:54Z")
Hi folks, I want to archive the \_size field (along with some other fields such as kubernetes.namespace) in a dedicated archive index. From here I have learned that this could be done using Roll Ups. However I am not su… --- ## [Required to avoid below search patterns from the search results in Elastic Search](https://discuss.elastic.co/t/required-to-avoid-below-search-patterns-from-the-search-results-in-elastic-search/296469)
**Author:** [@sangasur](https://discuss.elastic.co/u/sangasur)\ **Replies:** 0\ **Last updated:** [February 7, 2022, 12:50pm UTC](https://discuss.elastic.co/t/required-to-avoid-below-search-patterns-from-the-search-results-in-elastic-search/296469 "2022-02-07T12:50:41Z")
We have a requirement to search the availability of any sensitive data without masking (like firstName, lastName, eMail etc..) from the kibana/Elasticsearch logs from the field full\_message . Usually these details will b… --- ## [WARN: o.e.t.ThreadPool - absolute clock went backwards…](https://discuss.elastic.co/t/warn-o-e-t-threadpool-absolute-clock-went-backwards/296320)
**Author:** [@MSN](https://discuss.elastic.co/u/MSN)\ **Replies:** 3\ **Last updated:** [February 7, 2022, 12:46pm UTC](https://discuss.elastic.co/t/warn-o-e-t-threadpool-absolute-clock-went-backwards/296320 "2022-02-07T12:46:16Z")
Hi, after a fresh installation this log entry shows up on every node once a minute. absolute clock went backwards by \[300ms/300ms\] while timer thread was sleeping I already searched the forum and the Elasticsearch doc… --- ## [Can it replace Prometheus?](https://discuss.elastic.co/t/can-it-replace-prometheus/296417)
**Author:** [@xodn0812](https://discuss.elastic.co/u/xodn0812)\ **Replies:** 1\ **Last updated:** [February 7, 2022, 12:40pm UTC](https://discuss.elastic.co/t/can-it-replace-prometheus/296417 "2022-02-07T12:40:53Z")
I use Prometheus to gather k8s' resources. The resource data pipeline is as follows. k8s -\> Prometheus -\> Java app -\> Elasticsearch -\> (search) Java app Here I have a question. Why use Prometheus? Wouldn't Prometheus no… --- ## [Question about strange behaviour with Fuzzy query in elasticsearch](https://discuss.elastic.co/t/question-about-strange-behaviour-with-fuzzy-query-in-elasticsearch/296362)
**Author:** [@psydow](https://discuss.elastic.co/u/psydow)\ **Replies:** 4\ **Last updated:** [February 7, 2022, 12:30pm UTC](https://discuss.elastic.co/t/question-about-strange-behaviour-with-fuzzy-query-in-elasticsearch/296362 "2022-02-07T12:30:07Z")
Hello everyone, I am new to the elastic stack and fulltext search for this reason there came up a question regarding some fuzzy queries I was working with the last Weeks. For context I want to realise a system where th… --- ## [Index houskeeping (ILM)](https://discuss.elastic.co/t/index-houskeeping-ilm/296270)
**Author:** [@humartinez](https://discuss.elastic.co/u/humartinez)\ **Replies:** 5\ **Last updated:** [February 7, 2022, 11:11am UTC](https://discuss.elastic.co/t/index-houskeeping-ilm/296270 "2022-02-07T11:11:56Z")
Hi, I have this question on my mind for a long time. I have many indexes on a Elastic cluster, this cluster is used for application logging so I have plenty of indices separated by application because of they use case. … --- ## [Elasticsearch Python](https://discuss.elastic.co/t/elasticsearch-python/296356)
**Author:** [@harsh19](https://discuss.elastic.co/u/harsh19)\ **Replies:** 2\ **Last updated:** [February 7, 2022, 10:39am UTC](https://discuss.elastic.co/t/elasticsearch-python/296356 "2022-02-07T10:39:36Z")
Here is my code, from datetime import datetime from elasticsearch import Elasticsearch, helpers from pprint import pprint import json import time es = Elasticsearch(\['http://localhost:9200'\], http\_auth=('elastic', … --- ## [Nested queries (or secondary query)](https://discuss.elastic.co/t/nested-queries-or-secondary-query/296452)
**Author:** [@eladf](https://discuss.elastic.co/u/eladf)\ **Replies:** 0\ **Last updated:** [February 7, 2022, 10:21am UTC](https://discuss.elastic.co/t/nested-queries-or-secondary-query/296452 "2022-02-07T10:21:17Z")
Hi all, I encountered an issue and will appreciate your help with it. I have a huge index (~0.5B documents) with a mapping that includes numeric fields (enum values), one keyword field and a nested field. The nested f… [Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=496) [Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=498)