# Elasticsearch **URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=617 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 618 --- ## [Elasticsearch mapper-size plugin disadvantages/cost?](https://discuss.elastic.co/t/elasticsearch-mapper-size-plugin-disadvantages-cost/277585)
**Author:** [@Divit\_Sharma](https://discuss.elastic.co/u/Divit_Sharma)\ **Replies:** 1\ **Last updated:** [July 1, 2021, 9:25pm UTC](https://discuss.elastic.co/t/elasticsearch-mapper-size-plugin-disadvantages-cost/277585 "2021-07-01T21:25:02Z")
Is there any disadvantage or significant cost to the elasticsearch cluster if I use mapper-size plugin on all indices ? Suppose our daily ingestion in 1.5 TB. --- ## [Runtime scripts](https://discuss.elastic.co/t/runtime-scripts/277596)
**Author:** [@andremarzo](https://discuss.elastic.co/u/andremarzo)\ **Replies:** 0\ **Last updated:** [July 1, 2021, 8:53pm UTC](https://discuss.elastic.co/t/runtime-scripts/277596 "2021-07-01T20:53:09Z")
I ran a runtime script but i want delete it. How can i do it? --- ## [Aggregations to show all values with filter](https://discuss.elastic.co/t/aggregations-to-show-all-values-with-filter/277591)
**Author:** [@saiteja](https://discuss.elastic.co/u/saiteja)\ **Replies:** 0\ **Last updated:** [July 1, 2021, 7:48pm UTC](https://discuss.elastic.co/t/aggregations-to-show-all-values-with-filter/277591 "2021-07-01T19:48:37Z")
Hello, I am trying to get all aggregations on specific field with filter same as exclude facet in solr If I run below query GET /measurement/\_search { "query": { "query\_string": { "query": "\*" } }, … --- ## [Elastic has a large number os rejections search](https://discuss.elastic.co/t/elastic-has-a-large-number-os-rejections-search/277097)
**Author:** [@guimap](https://discuss.elastic.co/u/guimap)\ **Replies:** 8\ **Last updated:** [July 1, 2021, 6:31pm UTC](https://discuss.elastic.co/t/elastic-has-a-large-number-os-rejections-search/277097 "2021-07-01T18:31:10Z")
Hi guys Recently my elasticsearch are returning 429 HTTP code for all \_search requests, after few search, i noticed that has a large number of rejected search in my threads node\_name name active rejected … --- ## [How to interact with .NET NEST object methods from powershell?](https://discuss.elastic.co/t/how-to-interact-with-net-nest-object-methods-from-powershell/276568)
**Author:** [@dreic](https://discuss.elastic.co/u/dreic)\ **Replies:** 7\ **Last updated:** [July 1, 2021, 4:53pm UTC](https://discuss.elastic.co/t/how-to-interact-with-net-nest-object-methods-from-powershell/276568 "2021-07-01T16:53:05Z")
How to call method of .NET object in powershell (Elasticsearch NEST .NET client). This is basic example of .NET code for NEST client and I am trying to write PS equivalent but I am failing in setting object value. Is thi… --- ## [Dynamic custom fields with numeric and date range queries](https://discuss.elastic.co/t/dynamic-custom-fields-with-numeric-and-date-range-queries/277574)
**Author:** [@nbiondic](https://discuss.elastic.co/u/nbiondic)\ **Replies:** 0\ **Last updated:** [July 1, 2021, 3:14pm UTC](https://discuss.elastic.co/t/dynamic-custom-fields-with-numeric-and-date-range-queries/277574 "2021-07-01T15:14:51Z")
We have a requirement to support custom search fields for our users. Each user should have an ability to create their own fields which can than be searched through by using our built-in filtering mechanism Our initial i… --- ## [Индексы](https://discuss.elastic.co/t/topic/277567)
**Author:** [@\_LA](https://discuss.elastic.co/u/_LA)\ **Replies:** 0\ **Last updated:** [July 1, 2021, 2:58pm UTC](https://discuss.elastic.co/t/topic/277567 "2021-07-01T14:58:26Z")
Подскажите пожалуйста, как и где в эластике посмотреть уже имеющуюся взаимосвязь индексов со всеми полями? --- ## [Slow Performance of Elastic Search with Spark](https://discuss.elastic.co/t/slow-performance-of-elastic-search-with-spark/277101)
**Author:** [@Hardik\_Aggarwal](https://discuss.elastic.co/u/Hardik_Aggarwal)\ **Replies:** 3\ **Last updated:** [July 1, 2021, 2:48pm UTC](https://discuss.elastic.co/t/slow-performance-of-elastic-search-with-spark/277101 "2021-07-01T14:48:46Z")
I am trying to read the data from Elastic Search into a dataframe using Java ES-Spark-connector.. Now when I try to execute a query for example count() on the dataframe, the performance is dismal. For a 3Gb data it takes… --- ## [How to ignore URL when searching using ElasticSearch？](https://discuss.elastic.co/t/how-to-ignore-url-when-searching-using-elasticsearch/277443)
**Author:** [@bobfang1992](https://discuss.elastic.co/u/bobfang1992)\ **Replies:** 1\ **Last updated:** [July 1, 2021, 2:27pm UTC](https://discuss.elastic.co/t/how-to-ignore-url-when-searching-using-elasticsearch/277443 "2021-07-01T14:27:54Z")
Hi，I have a set of documents which may contains some texts, but may have URLs inside them: Lorem ipsum dolor sit amet, consectetur adipiscing elit. Nullam tincidunt metus a convallis imperdiet. Praesent interdum magna u… --- ## [Need a script field tag to calculate time difference](https://discuss.elastic.co/t/need-a-script-field-tag-to-calculate-time-difference/277438)
**Author:** [@vikram.sablok](https://discuss.elastic.co/u/vikram.sablok)\ **Replies:** 1\ **Last updated:** [July 1, 2021, 2:27pm UTC](https://discuss.elastic.co/t/need-a-script-field-tag-to-calculate-time-difference/277438 "2021-07-01T14:27:05Z")
\-(minus) this will give me overall time taken for a request. I can use this field to show average time over a period of time. --- ## [Difference range query between numeric type and range type](https://discuss.elastic.co/t/difference-range-query-between-numeric-type-and-range-type/277527)
**Author:** [@kr\_junhodo](https://discuss.elastic.co/u/kr_junhodo)\ **Replies:** 1\ **Last updated:** [July 1, 2021, 2:21pm UTC](https://discuss.elastic.co/t/difference-range-query-between-numeric-type-and-range-type/277527 "2021-07-01T14:21:17Z")
i Think this article says that range type is better way for range query. example 1) doc mapping : start\_date(date) and end\_date(date) query description : start\_date \< criteria && criteria \< end\_date via range query … --- ## [Ingest pipeline add field with date in the future](https://discuss.elastic.co/t/ingest-pipeline-add-field-with-date-in-the-future/277489)
**Author:** [@sam3546](https://discuss.elastic.co/u/sam3546)\ **Replies:** 2\ **Last updated:** [July 1, 2021, 2:11pm UTC](https://discuss.elastic.co/t/ingest-pipeline-add-field-with-date-in-the-future/277489 "2021-07-01T14:11:16Z")
Via an ingest pipeline using a processor such as a script (similar to this) or another processor is it simple to add a field with the date x days (a field on the ingested doc) after its ingested. Such that a doc field:… --- ## [Watcher rule query on the same row data](https://discuss.elastic.co/t/watcher-rule-query-on-the-same-row-data/277463)
**Author:** [@manikandanid](https://discuss.elastic.co/u/manikandanid)\ **Replies:** 1\ **Last updated:** [July 1, 2021, 2:06pm UTC](https://discuss.elastic.co/t/watcher-rule-query-on-the-same-row-data/277463 "2021-07-01T14:06:53Z")
I have a use case where i fetch set of records from elastic search in my Webhook watcher rule. The retrieved records contains two column (say x & y), In the watcher rule body i would like to loop the data and include on… --- ## [Elasticsearch cannot up because /org/freedesktop/PolicyKit1/AuthenticationAgent Blocked](https://discuss.elastic.co/t/elasticsearch-cannot-up-because-org-freedesktop-policykit1-authenticationagent-blocked/277464)
**Author:** [@kemalkolcuoglu](https://discuss.elastic.co/u/kemalkolcuoglu)\ **Replies:** 2\ **Last updated:** [July 1, 2021, 1:18pm UTC](https://discuss.elastic.co/t/elasticsearch-cannot-up-because-org-freedesktop-policykit1-authenticationagent-blocked/277464 "2021-07-01T13:18:11Z")
Hello Everyone, Cluster version: 7.7.0 OS Version: Centos 7.9 Java Version: Java 8 We have an issue with Elasticsearch when we try to up the service. journalctl -xe output: Jun 30 08:59:10 elk-master-2 systemd\[1\]: … --- ## [ES 7.11 Heap Out of memory error](https://discuss.elastic.co/t/es-7-11-heap-out-of-memory-error/277478)
**Author:** [@tmathew](https://discuss.elastic.co/u/tmathew)\ **Replies:** 4\ **Last updated:** [July 1, 2021, 1:01pm UTC](https://discuss.elastic.co/t/es-7-11-heap-out-of-memory-error/277478 "2021-07-01T13:01:04Z")
Hi ! We upgraded from 2.4 to 7.11, we are having below issues all around the ES. ES data nodes are going down alternatively, and it is due to Heap Out of memory issues. Today morning we did re-indexing around 100k/s a… --- ## [How to fetch Kibana APi logs in Dashboard using Powershell](https://discuss.elastic.co/t/how-to-fetch-kibana-api-logs-in-dashboard-using-powershell/277369)
**Author:** [@Sahithi\_V](https://discuss.elastic.co/u/Sahithi_V)\ **Replies:** 2\ **Last updated:** [July 1, 2021, 12:34pm UTC](https://discuss.elastic.co/t/how-to-fetch-kibana-api-logs-in-dashboard-using-powershell/277369 "2021-07-01T12:34:43Z")
Recently part of automation we are trying to fetch kibana dashboard apis through any script lang ie Python /powershell . Tried to fetch with Rest APis, but through unable to connect. Server of Elastic search looks somet… --- ## [Cirrus Search setting with elastic search in mediawiki , not showing auto suggest when typing in search engine](https://discuss.elastic.co/t/cirrus-search-setting-with-elastic-search-in-mediawiki-not-showing-auto-suggest-when-typing-in-search-engine/277546)
**Author:** [@Pooja\_Sharma](https://discuss.elastic.co/u/Pooja_Sharma)\ **Replies:** 0\ **Last updated:** [July 1, 2021, 11:38am UTC](https://discuss.elastic.co/t/cirrus-search-setting-with-elastic-search-in-mediawiki-not-showing-auto-suggest-when-typing-in-search-engine/277546 "2021-07-01T11:38:29Z")
Hi iam using, MediaWiki1.35.1 \[PHP\]7.4.15 \[Elasticsearch\] 6.5.4 Iam geeting result from my search engine.But ,not showing auto suggest when typing in search engine. In console iam able to see error {"error":{"code":… --- ## [Query\_string with "fields" option behaves unexpectedly](https://discuss.elastic.co/t/query-string-with-fields-option-behaves-unexpectedly/277529)
**Author:** [@andreas123](https://discuss.elastic.co/u/andreas123)\ **Replies:** 1\ **Last updated:** [July 1, 2021, 10:30am UTC](https://discuss.elastic.co/t/query-string-with-fields-option-behaves-unexpectedly/277529 "2021-07-01T10:30:26Z")
Hey, i would like to understand why my search query behaves that unexpectedly. I have an index with 3 docs: { "\_index" : "test\_index", "\_type" : "\_doc", "\_id" : "2", "\_score" : 1.0, … --- ## [Index not deleting according ilm policy](https://discuss.elastic.co/t/index-not-deleting-according-ilm-policy/276265)
**Author:** [@vikramdayma](https://discuss.elastic.co/u/vikramdayma)\ **Replies:** 11\ **Last updated:** [July 1, 2021, 10:30am UTC](https://discuss.elastic.co/t/index-not-deleting-according-ilm-policy/276265 "2021-07-01T10:30:04Z")
Hi, I created an ILM policy and applied to system index (.monitoring-es-7-2021.06.10). But index is not deleting after ILM time. It is showing error. illegal\_argument\_exception: setting \[index.lifecycle.rollover\_alia… --- ## [Flatten Array in Ingest Pipeline with Painless](https://discuss.elastic.co/t/flatten-array-in-ingest-pipeline-with-painless/277383)
**Author:** [@nicjp](https://discuss.elastic.co/u/nicjp)\ **Replies:** 2\ **Last updated:** [July 1, 2021, 10:15am UTC](https://discuss.elastic.co/t/flatten-array-in-ingest-pipeline-with-painless/277383 "2021-07-01T10:15:58Z")
Hi all, I'm working on getting some logs onboarded and I'm having an issue with a field that contains Key/Values inside an array. (For reference please see below) { "redis\_cache\_read\_bytes": 741, "format": "json", … --- ## [Resolved attribute is missing ... but is not!](https://discuss.elastic.co/t/resolved-attribute-is-missing-but-is-not/277510)
**Author:** [@priamai](https://discuss.elastic.co/u/priamai)\ **Replies:** 1\ **Last updated:** [July 1, 2021, 6:07am UTC](https://discuss.elastic.co/t/resolved-attribute-is-missing-but-is-not/277510 "2021-07-01T06:07:53Z")
I am on ELK 7.13.0 with the Hadoop 7.13.0 library. I have the following schema: root |-- @timestamp: timestamp (nullable = true) |-- AuthenticationPackage: string (nullable = true) |-- Destination: string (nullable … --- ## [Monitoring API query](https://discuss.elastic.co/t/monitoring-api-query/277200)
**Author:** [@priamai](https://discuss.elastic.co/u/priamai)\ **Replies:** 3\ **Last updated:** [July 1, 2021, 5:30am UTC](https://discuss.elastic.co/t/monitoring-api-query/277200 "2021-07-01T05:30:31Z")
Hi there, I am with ELK 7.13.0 the basic free licence. Is there a way to monitor the queries that are performed via the Elastic API? Even to keep the last N most recent ones for example. I basically have different pyt… --- ## [Max number of shard a elastic node can hold](https://discuss.elastic.co/t/max-number-of-shard-a-elastic-node-can-hold/277434)
**Author:** [@lusynda](https://discuss.elastic.co/u/lusynda)\ **Replies:** 5\ **Last updated:** [July 1, 2021, 4:17am UTC](https://discuss.elastic.co/t/max-number-of-shard-a-elastic-node-can-hold/277434 "2021-07-01T04:17:59Z")
Hi all What is the max number of shard that an elastic node can hold. and i dont mean per index or anything i mean the max number of shard for all index that a node can hold. --- ## [Add date math support in index-pattern for rollup job](https://discuss.elastic.co/t/add-date-math-support-in-index-pattern-for-rollup-job/277321)
**Author:** [@wangqinghuan](https://discuss.elastic.co/u/wangqinghuan)\ **Replies:** 0\ **Last updated:** [June 29, 2021, 8:31am UTC](https://discuss.elastic.co/t/add-date-math-support-in-index-pattern-for-rollup-job/277321 "2021-06-29T08:31:37Z")
Currently, we can specify index-pattern to match a series of daily indices when create a rollup job. However, when a lot of indices exists in Elasticsearch, rollup job will scan all exists indices to filter data although… --- ## [Delete Index from Cluster State](https://discuss.elastic.co/t/delete-index-from-cluster-state/277343)
**Author:** [@daksh0225](https://discuss.elastic.co/u/daksh0225)\ **Replies:** 1\ **Last updated:** [July 1, 2021, 2:02am UTC](https://discuss.elastic.co/t/delete-index-from-cluster-state/277343 "2021-07-01T02:02:05Z")
Hello!! I am trying to ensure that indices created during testing do not persist in elasticsearch when it is restarted. To achieve this, I have modiifed the doStop() function of IndicesService in the following manner: … --- ## [Elasticsearch heap Memory WARNING in elk docker](https://discuss.elastic.co/t/elasticsearch-heap-memory-warning-in-elk-docker/277419)
**Author:** [@ranu\_shekhar](https://discuss.elastic.co/u/ranu_shekhar)\ **Replies:** 4\ **Last updated:** [July 1, 2021, 1:53am UTC](https://discuss.elastic.co/t/elasticsearch-heap-memory-warning-in-elk-docker/277419 "2021-07-01T01:53:15Z")
Hi, I am using elasticsearch 7.10.0. I have 3 nodes in my cluster. But in one of the node among 3, we are receiving given below warning logs: \*\*{"type": "server", "timestamp": "2021-06-30T04:01:53,805Z", "level": "WAR… --- ## [Removing subfield in the elasticsearch output display](https://discuss.elastic.co/t/removing-subfield-in-the-elasticsearch-output-display/277494)
**Author:** [@gisellecarballo](https://discuss.elastic.co/u/gisellecarballo)\ **Replies:** 3\ **Last updated:** [July 1, 2021, 1:25am UTC](https://discuss.elastic.co/t/removing-subfield-in-the-elasticsearch-output-display/277494 "2021-07-01T01:25:13Z")
Hi, Anyone knows how to remove the subfield alone in the elasticsearch display output. In the output there are fields "host: 192.x.x.x" "host.keyword: 192.x.x.x" I want to remove the host.keyword field. Current filter… --- ## [Loop throught context (ctx) data model result at action template in SLACK text field](https://discuss.elastic.co/t/loop-throught-context-ctx-data-model-result-at-action-template-in-slack-text-field/277406)
**Author:** [@Tania\_Raquel\_Stormov](https://discuss.elastic.co/u/Tania_Raquel_Stormov)\ **Replies:** 0\ **Last updated:** [June 30, 2021, 4:31am UTC](https://discuss.elastic.co/t/loop-throught-context-ctx-data-model-result-at-action-template-in-slack-text-field/277406 "2021-06-30T04:31:27Z")
How can loop over array result when integrate with slack using message template? At kibana monitor to over an array example: {{#ctx.results.0.hits.hits}} // Loop over hits {{\_source.message}} {{\_source.module\_nam… --- ## [Can the rest client be on a lower version than the elastic searver](https://discuss.elastic.co/t/can-the-rest-client-be-on-a-lower-version-than-the-elastic-searver/277501)
**Author:** [@reddroid](https://discuss.elastic.co/u/reddroid)\ **Replies:** 1\ **Last updated:** [June 30, 2021, 11:55pm UTC](https://discuss.elastic.co/t/can-the-rest-client-be-on-a-lower-version-than-the-elastic-searver/277501 "2021-06-30T23:55:11Z")
Hi , Can I use elastic client 7.10 with elastic server 7.10.2 ? --- ## [Error building elasticsearch-hadoop from github](https://discuss.elastic.co/t/error-building-elasticsearch-hadoop-from-github/277486)
**Author:** [@Hardik\_Aggarwal](https://discuss.elastic.co/u/Hardik_Aggarwal)\ **Replies:** 0\ **Last updated:** [June 30, 2021, 4:44pm UTC](https://discuss.elastic.co/t/error-building-elasticsearch-hadoop-from-github/277486 "2021-06-30T16:44:10Z")
Pardon me I am new to ElasticSearch and hadoop. I am trying to build GitHub - elastic/elasticsearch-hadoop: Elasticsearch real-time search and analytics natively integrated with Hadoop this repo locally . I did gradle d… [Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=616) [Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=618)