# Elasticsearch **URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=874 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 875 --- ## [Watcher : Email Action : How to use attributes with special characters in the name](https://discuss.elastic.co/t/watcher-email-action-how-to-use-attributes-with-special-characters-in-the-name/239532)
**Author:** [@Lalit\_Negi](https://discuss.elastic.co/u/Lalit_Negi)\ **Replies:** 0\ **Last updated:** [July 1, 2020, 7:02pm UTC](https://discuss.elastic.co/t/watcher-email-action-how-to-use-attributes-with-special-characters-in-the-name/239532 "2020-07-01T19:02:03Z")
I have a query result where the source has some attributes with speical chars in name ctx.payload.hits.hits\[0\].\_source\['@msg'\] and I want to send these attributes in a watcher email action. however these kind of attr… --- ## [OIDC based user level authorization without Kibana](https://discuss.elastic.co/t/oidc-based-user-level-authorization-without-kibana/239530)
**Author:** [@soumendra](https://discuss.elastic.co/u/soumendra)\ **Replies:** 0\ **Last updated:** [July 1, 2020, 6:48pm UTC](https://discuss.elastic.co/t/oidc-based-user-level-authorization-without-kibana/239530 "2020-07-01T18:48:33Z")
Please help us with the following issue. Current scenario: UI A --\> OIDC provider --\> UI B (SU) --\> Kibana dashboard We have a custom OIDC provider through which users get authenticated in Kibana. In UI B we use Angul… --- ## [Enable TLS on 6.8.6 for Oauth Integration](https://discuss.elastic.co/t/enable-tls-on-6-8-6-for-oauth-integration/237545)
**Author:** [@elk\_follower](https://discuss.elastic.co/u/elk_follower)\ **Replies:** 6\ **Last updated:** [July 1, 2020, 5:05pm UTC](https://discuss.elastic.co/t/enable-tls-on-6-8-6-for-oauth-integration/237545 "2020-07-01T17:05:26Z")
Hi, I need to integrate an ELK cluster running in K8 with keycloak for User Authentication. Seems first i need to enable TLS security for which i have already created the certificates and copied them. Also i have set a… --- ## [Generate Certificates For TLS Encryption for cluster in Kubernetes](https://discuss.elastic.co/t/generate-certificates-for-tls-encryption-for-cluster-in-kubernetes/238577)
**Author:** [@elk\_follower](https://discuss.elastic.co/u/elk_follower)\ **Replies:** 1\ **Last updated:** [July 1, 2020, 5:00pm UTC](https://discuss.elastic.co/t/generate-certificates-for-tls-encryption-for-cluster-in-kubernetes/238577 "2020-07-01T17:00:13Z")
Hi There, i have a elastic 7.7.1 cluster with following architecture: Ingest nodes - These are kubernetes deployment with a service called elastic-client running on port 9200 Data nodes - These are kubernetes stateful… --- ## [Installing from the APT repository](https://discuss.elastic.co/t/installing-from-the-apt-repository/239391)
**Author:** [@Anthony\_Allen](https://discuss.elastic.co/u/Anthony_Allen)\ **Replies:** 2\ **Last updated:** [July 1, 2020, 4:32pm UTC](https://discuss.elastic.co/t/installing-from-the-apt-repository/239391 "2020-07-01T16:32:14Z")
I have been unable to install ES 7.8 per the instructions here Steps: wget -qO - https://artifacts.elastic.co/GPG-KEY-elasticsearch | sudo apt-key add - sudo apt-get install apt-transport-https echo "deb https://arti… --- ## [Nodes go out of memory in domino effect](https://discuss.elastic.co/t/nodes-go-out-of-memory-in-domino-effect/239489)
**Author:** [@vurus](https://discuss.elastic.co/u/vurus)\ **Replies:** 1\ **Last updated:** [July 1, 2020, 4:29pm UTC](https://discuss.elastic.co/t/nodes-go-out-of-memory-in-domino-effect/239489 "2020-07-01T16:29:57Z")
Hi fellas, I got an elasticsearch cluster (6.4.2) with hundreds of monthly indices each of which has a varying size between 500 gigabytes and 1 terabyte consisting of 5 primary and 5 replica shards (default). The quest… --- ## [Extended\_stats with nested buckets](https://discuss.elastic.co/t/extended-stats-with-nested-buckets/239470)
**Author:** [@Camilo\_Salomon](https://discuss.elastic.co/u/Camilo_Salomon)\ **Replies:** 0\ **Last updated:** [July 1, 2020, 11:25am UTC](https://discuss.elastic.co/t/extended-stats-with-nested-buckets/239470 "2020-07-01T11:25:50Z")
Hi everyone, I'm new to elastic, so this question could be quite trivial for you, but here I go: I'm using kibana\_sample\_data\_ecommerce, which documents have a mapping like this { ... "order\_date" : \ "tax… --- ## [Update by query with params](https://discuss.elastic.co/t/update-by-query-with-params/239413)
**Author:** [@AsfK](https://discuss.elastic.co/u/AsfK)\ **Replies:** 2\ **Last updated:** [July 1, 2020, 2:19pm UTC](https://discuss.elastic.co/t/update-by-query-with-params/239413 "2020-07-01T14:19:56Z")
\[ESK 7.6.2\] We're set country name by phone prefix. if for some reason we hanve't the prefix we're putting "Missing Country Name" string. I built a simple update by query in Kiban dev-tool and it's worked, now I want t… --- ## [ES ingest pipeline does not working as expected](https://discuss.elastic.co/t/es-ingest-pipeline-does-not-working-as-expected/239513)
**Author:** [@sfenman](https://discuss.elastic.co/u/sfenman)\ **Replies:** 0\ **Last updated:** [July 1, 2020, 3:08pm UTC](https://discuss.elastic.co/t/es-ingest-pipeline-does-not-working-as-expected/239513 "2020-07-01T15:08:40Z")
Hello, I created an ingest pipeline for my filebeat logs: POST /\_ingest/pipeline/\_simulate { "pipeline": { "processors": \[ { "dissect": { "field": "message", "pattern": "%{\*p1}=… --- ## [Watcher action returns some payload, but not others](https://discuss.elastic.co/t/watcher-action-returns-some-payload-but-not-others/236365)
**Author:** [@ptamba](https://discuss.elastic.co/u/ptamba)\ **Replies:** 2\ **Last updated:** [July 1, 2020, 2:57pm UTC](https://discuss.elastic.co/t/watcher-action-returns-some-payload-but-not-others/236365 "2020-07-01T14:57:59Z")
Hi , I have the following watcher action : "send\_email": { "transform": { "script": { "source": """ def documents = ctx.payload.hits.hits.stream(… --- ## [Nest Bulk Delete With Retry and Size Like BulkAllObservable](https://discuss.elastic.co/t/nest-bulk-delete-with-retry-and-size-like-bulkallobservable/239508)
**Author:** [@dary](https://discuss.elastic.co/u/dary)\ **Replies:** 0\ **Last updated:** [July 1, 2020, 2:47pm UTC](https://discuss.elastic.co/t/nest-bulk-delete-with-retry-and-size-like-bulkallobservable/239508 "2020-07-01T14:47:14Z")
Hello, I am trying to delete using the bulk api and DeleteMany method (using NEST) something like this var response = \_elasticClient.Bulk(b =\> b .DeleteMany(products) but i want to add retry and size to divide in chun… --- ## [I need help! Elasticsearch does not match my regexp, wildcard, or query\_string queries](https://discuss.elastic.co/t/i-need-help-elasticsearch-does-not-match-my-regexp-wildcard-or-query-string-queries/239473)
**Author:** [@Simon\_Moller](https://discuss.elastic.co/u/Simon_Moller)\ **Replies:** 4\ **Last updated:** [July 1, 2020, 2:29pm UTC](https://discuss.elastic.co/t/i-need-help-elasticsearch-does-not-match-my-regexp-wildcard-or-query-string-queries/239473 "2020-07-01T14:29:57Z")
I use elasticsearch version: "7.8.0, Build: default/deb/757314695644ea9a1dc2fecd26d1a43856725e65/2020-06-14T19:35:50.234439Z, JVM: 14.0.1" and I have the following document according to the packetbeat index (I have cut i… --- ## [Regression in ES 7.7.0 with es-rally http\_logs Track](https://discuss.elastic.co/t/regression-in-es-7-7-0-with-es-rally-http-logs-track/235954)
**Author:** [@Astro-es](https://discuss.elastic.co/u/Astro-es)\ **Replies:** 6\ **Last updated:** [July 1, 2020, 2:23pm UTC](https://discuss.elastic.co/t/regression-in-es-7-7-0-with-es-rally-http-logs-track/235954 "2020-07-01T14:23:47Z")
Elasticsearch 7.7.0 shows regression when benchmarked against 7.2.0 for the following challenges in es-rally: Es-Rally Version: 2.0 Track: http\_logs Challenge: append-sorted-no-conflicts Total Regressions: 18 ES Ver… --- ## [Return specified fields using spring data elastic search](https://discuss.elastic.co/t/return-specified-fields-using-spring-data-elastic-search/239465)
**Author:** [@mohsin](https://discuss.elastic.co/u/mohsin)\ **Replies:** 2\ **Last updated:** [July 1, 2020, 2:11pm UTC](https://discuss.elastic.co/t/return-specified-fields-using-spring-data-elastic-search/239465 "2020-07-01T14:11:27Z")
I have a document User having fields like User(id, name, address, List ) etc. depending upon request we want to return either these three: id, name, address or all the fields, by default ElasticsearchRepository find\*\* m… --- ## [Snapshot and restore Documentation unclear](https://discuss.elastic.co/t/snapshot-and-restore-documentation-unclear/239483)
**Author:** [@Marco\_Phillips](https://discuss.elastic.co/u/Marco_Phillips)\ **Replies:** 5\ **Last updated:** [July 1, 2020, 2:08pm UTC](https://discuss.elastic.co/t/snapshot-and-restore-documentation-unclear/239483 "2020-07-01T14:08:24Z")
Hi, I feel like the Snapshot documentation is not clear on if it is possible to register a repository locally on a member of a cluster (master) without this being accessible from the other members (non-masters). This p… --- ## [Watcher sending alert when condition not met](https://discuss.elastic.co/t/watcher-sending-alert-when-condition-not-met/237169)
**Author:** [@andywt123](https://discuss.elastic.co/u/andywt123)\ **Replies:** 4\ **Last updated:** [July 1, 2020, 2:04pm UTC](https://discuss.elastic.co/t/watcher-sending-alert-when-condition-not-met/237169 "2020-07-01T14:04:33Z")
I want to send an alert if a cron job has not run in the last 10 minutes. I set the following up in watcher: "query": { "bool": { "must": \[ { "terms": { … --- ## [How to not store the completion suggester in the index in Elasticsearch](https://discuss.elastic.co/t/how-to-not-store-the-completion-suggester-in-the-index-in-elasticsearch/239450)
**Author:** [@gitterhh](https://discuss.elastic.co/u/gitterhh)\ **Replies:** 1\ **Last updated:** [July 1, 2020, 1:50pm UTC](https://discuss.elastic.co/t/how-to-not-store-the-completion-suggester-in-the-index-in-elasticsearch/239450 "2020-07-01T13:50:07Z")
I want to have a field tags as completion, and I do not want this field to participate in the scoring, so I am trying to apply the mapping "tags": { "type": "completion", "index": false } And I am getting an er… --- ## [Elastic Search Group by a single column - Term Aggregation - TrackTotalHits](https://discuss.elastic.co/t/elastic-search-group-by-a-single-column-term-aggregation-tracktotalhits/239361)
**Author:** [@Naveena1](https://discuss.elastic.co/u/Naveena1)\ **Replies:** 0\ **Last updated:** [June 30, 2020, 6:31pm UTC](https://discuss.elastic.co/t/elastic-search-group-by-a-single-column-term-aggregation-tracktotalhits/239361 "2020-06-30T18:31:46Z")
Can someone please help me on the below requirement ? I am able to group by single field using Term aggregation but I always end up with fetching top 10 buckets since size defaults to 10. Is there a way where I can … --- ## [Retrive parent data inside child doc from index](https://discuss.elastic.co/t/retrive-parent-data-inside-child-doc-from-index/239495)
**Author:** [@Sagar\_Darekar](https://discuss.elastic.co/u/Sagar_Darekar)\ **Replies:** 0\ **Last updated:** [July 1, 2020, 1:33pm UTC](https://discuss.elastic.co/t/retrive-parent-data-inside-child-doc-from-index/239495 "2020-07-01T13:33:04Z")
We have a requirement that we need to retrieve parent fields inside the child document. Actually we have a mapping for the index as below: { "mappings": { "properties": { "relation\_type": { … --- ## [Elasticsearch IP Filtering Not Working](https://discuss.elastic.co/t/elasticsearch-ip-filtering-not-working/239486)
**Author:** [@rameshkokare1](https://discuss.elastic.co/u/rameshkokare1)\ **Replies:** 1\ **Last updated:** [July 1, 2020, 1:01pm UTC](https://discuss.elastic.co/t/elasticsearch-ip-filtering-not-working/239486 "2020-07-01T13:01:05Z")
Hello, Trying to white list IP's using XPACK security but not workign as expected My config is as below cluster.name: elasticsearch-acsrep node.name: ES1 path.data: /home/ematoacs/data/ path.logs: /home/ematoacs/lo… --- ## [Unable to create Index Patterns "Error fetching fields for index pattern "](https://discuss.elastic.co/t/unable-to-create-index-patterns-error-fetching-fields-for-index-pattern/239487)
**Author:** [@tenet\_testuser1](https://discuss.elastic.co/u/tenet_testuser1)\ **Replies:** 0\ **Last updated:** [July 1, 2020, 12:38pm UTC](https://discuss.elastic.co/t/unable-to-create-index-patterns-error-fetching-fields-for-index-pattern/239487 "2020-07-01T12:38:55Z")
Trying to understand what the issue is and how to solve this. I had an index it elasticsearch, and a index pattern in kibana based on that index. I had created reports based on this. I felt on QC that somehow the data… --- ## [Passing from in suggest queries](https://discuss.elastic.co/t/passing-from-in-suggest-queries/239461)
**Author:** [@guruprasadkk](https://discuss.elastic.co/u/guruprasadkk)\ **Replies:** 0\ **Last updated:** [July 1, 2020, 10:45am UTC](https://discuss.elastic.co/t/passing-from-in-suggest-queries/239461 "2020-07-01T10:45:38Z")
We are using from and size in normal searches to support pagination for our clients. But we also have to support size and from for typeahead queries. For supporting typeahead queries we are using CompletionSuggestionBu… --- ## [Threshold selection - How to define it?](https://discuss.elastic.co/t/threshold-selection-how-to-define-it/239433)
**Author:** [@Thomas74](https://discuss.elastic.co/u/Thomas74)\ **Replies:** 6\ **Last updated:** [July 1, 2020, 10:16am UTC](https://discuss.elastic.co/t/threshold-selection-how-to-define-it/239433 "2020-07-01T10:16:10Z")
Hi, I have 4 data nodes with 25 Tb on each for a total of 100Tb of storage. I want to change the cluster threshold because, by default, the option cluster.routing.allocation.disk.watermark.flood\_stage is at 95%. Tha… --- ## [Email fields in ECS 1.5](https://discuss.elastic.co/t/email-fields-in-ecs-1-5/239359)
**Author:** [@sidahmed](https://discuss.elastic.co/u/sidahmed)\ **Replies:** 3\ **Last updated:** [July 1, 2020, 10:11am UTC](https://discuss.elastic.co/t/email-fields-in-ecs-1-5/239359 "2020-07-01T10:11:43Z")
I have some email fields that i'm indexing. My problem is, fields like CC, Subject ...; don't seem to fit in ECS (Elastic Common Schema). Is ELK team willing to add these fiels in next ECS versions ? or should I use cus… --- ## [Group by aggregation on nested document](https://discuss.elastic.co/t/group-by-aggregation-on-nested-document/239439)
**Author:** [@davidker](https://discuss.elastic.co/u/davidker)\ **Replies:** 0\ **Last updated:** [July 1, 2020, 8:35am UTC](https://discuss.elastic.co/t/group-by-aggregation-on-nested-document/239439 "2020-07-01T08:35:13Z")
Let's say I have five document with some nested data: Doc 1 : { id:1, facilities:\[ { type:"hospital" } \], investigator:\[{ name"Robert" }, { … --- ## [Frozen Index/Node questions](https://discuss.elastic.co/t/frozen-index-node-questions/239435)
**Author:** [@defalt](https://discuss.elastic.co/u/defalt)\ **Replies:** 5\ **Last updated:** [July 1, 2020, 9:17am UTC](https://discuss.elastic.co/t/frozen-index-node-questions/239435 "2020-07-01T09:17:36Z")
Hi, I have some questions regarding frozen indices. Is there a possibility to declare a node as a "frozen node"? I have a cluster with 3 nodes and I am wondering if I could ad a node which takes all the indices that… --- ## [Reducing the deleted docs in the index stats](https://discuss.elastic.co/t/reducing-the-deleted-docs-in-the-index-stats/239431)
**Author:** [@shinji\_kun](https://discuss.elastic.co/u/shinji_kun)\ **Replies:** 0\ **Last updated:** [July 1, 2020, 7:51am UTC](https://discuss.elastic.co/t/reducing-the-deleted-docs-in-the-index-stats/239431 "2020-07-01T07:51:22Z")
Hello, i'm want to import CVE Entrys from a feed. The feed consists of several Files, which gets generate every hour. In each File is a list of CVE Entrys. Most of the newly generated CVE Entrys(JSON), will get enriche… --- ## [Filter Based On Average Score](https://discuss.elastic.co/t/filter-based-on-average-score/239429)
**Author:** [@zamkinos](https://discuss.elastic.co/u/zamkinos)\ **Replies:** 0\ **Last updated:** [July 1, 2020, 7:49am UTC](https://discuss.elastic.co/t/filter-based-on-average-score/239429 "2020-07-01T07:49:54Z")
Hi, I have an index keeps items. My search structure like below: QueryContainer filterDescription = null; QueryContainer filterItemNo = null; QueryContainer filterModelNo = null; QueryContainer… --- ## [Circuit\_breaking\_exception \[parent\] Data too large, data for \[\\]](https://discuss.elastic.co/t/circuit-breaking-exception-parent-data-too-large-data-for-http-request/239423)
**Author:** [@Netanel\_Malka](https://discuss.elastic.co/u/Netanel_Malka)\ **Replies:** 0\ **Last updated:** [July 1, 2020, 7:22am UTC](https://discuss.elastic.co/t/circuit-breaking-exception-parent-data-too-large-data-for-http-request/239423 "2020-07-01T07:22:58Z")
I'm trying to insert bulk of data( ~60M docs) using spark(39 partitions, 10 concurrent) and I get the following exception: org.elasticsearch.hadoop.rest.EsHadoopInvalidRequest: org.elasticsearch.hadoop.rest.EsHadoopRe… --- ## [Transforms API - 8.0 and future releases](https://discuss.elastic.co/t/transforms-api-8-0-and-future-releases/239324)
**Author:** [@tg295](https://discuss.elastic.co/u/tg295)\ **Replies:** 1\ **Last updated:** [July 1, 2020, 6:55am UTC](https://discuss.elastic.co/t/transforms-api-8-0-and-future-releases/239324 "2020-07-01T06:55:58Z")
Can anyone confirm whether the Transforms API will still be available in 8.0 and future releases, and whether it will still be part of X-Pack or a regular feature? Thanks, [Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=873) [Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=875)