# Elastic Stack

**URL:** https://discuss.elastic.co/c/elastic-stack/81.md?page=1222

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1223

---

## [Load balancing Kibana](https://discuss.elastic.co/t/load-balancing-kibana/284932)

<div class="topic-metadata">

**Author:** [@vee](https://discuss.elastic.co/u/vee)\
**Replies:** 5\
**Last updated:** [September 28, 2021, 9:50am UTC](https://discuss.elastic.co/t/load-balancing-kibana/284932 "2021-09-28T09:50:24Z")

</div>

Hi - we have 3 clusters in our prod spread across three diff Data centers. Each cluster setup: One instance of Kibana -\> 2 client nodes for load balancing -\> data nodes Since dashboards and visualizations are local to…

---

## [After Split again merge the json object](https://discuss.elastic.co/t/after-split-again-merge-the-json-object/285333)

<div class="topic-metadata">

**Author:** [@ansgoya](https://discuss.elastic.co/u/ansgoya)\
**Replies:** 0\
**Last updated:** [September 28, 2021, 9:25am UTC](https://discuss.elastic.co/t/after-split-again-merge-the-json-object/285333 "2021-09-28T09:25:33Z")

</div>

Hi Team, I am splitting the data and mutate the fields but i want to again merge the objects so filter { if \[data\] { split { field =\> "data" target =\> "indexData" } if !("" in \[indexData\]\[bcd\])…

---

## [Enable secure connection from Kibana to Elasticsearch](https://discuss.elastic.co/t/enable-secure-connection-from-kibana-to-elasticsearch/285255)

<div class="topic-metadata">

**Author:** [@ls4074](https://discuss.elastic.co/u/ls4074)\
**Replies:** 1\
**Last updated:** [September 28, 2021, 9:10am UTC](https://discuss.elastic.co/t/enable-secure-connection-from-kibana-to-elasticsearch/285255 "2021-09-28T09:10:39Z")

</div>

I have xpack enabled on Elasticsearch (ES) on both http layer and transport layer. Now I am trying to enable the secure connection from Kibana to ES. I have added these in Kibana.yaml elasticsearchHosts: "https://elasti…

---

## [Facing some issues in creating index patterns using the python elasticsearch API](https://discuss.elastic.co/t/facing-some-issues-in-creating-index-patterns-using-the-python-elasticsearch-api/285305)

<div class="topic-metadata">

**Author:** [@Rahul\_Kulhalli](https://discuss.elastic.co/u/Rahul_Kulhalli)\
**Replies:** 1\
**Last updated:** [September 28, 2021, 9:06am UTC](https://discuss.elastic.co/t/facing-some-issues-in-creating-index-patterns-using-the-python-elasticsearch-api/285305 "2021-09-28T09:06:41Z")

</div>

Hello, I want to create an index pattern on Kibana through the python API also set the default timeFieldName to @timestamp. However, I am a little confused in regards to the API documentation provided by Elasticsearch-p…

---

## [What's the difference between terms and term(with bool should)?](https://discuss.elastic.co/t/whats-the-difference-between-terms-and-term-with-bool-should/285186)

<div class="topic-metadata">

**Author:** [@yeziblo](https://discuss.elastic.co/u/yeziblo)\
**Replies:** 4\
**Last updated:** [September 28, 2021, 8:50am UTC](https://discuss.elastic.co/t/whats-the-difference-between-terms-and-term-with-bool-should/285186 "2021-09-28T08:50:24Z")

</div>

I've always wondered, for example, about the following statements. A: { "bool": { "should": \[ { "term": { "userType": { "value": 0 } } }, { "term": { "userType": { "value": 1 } } }, { "term": { "use…

---

## [Translate plugin, iterate\_on and item id on fallback](https://discuss.elastic.co/t/translate-plugin-iterate-on-and-item-id-on-fallback/284205)

<div class="topic-metadata">

**Author:** [@elastic\_user\_forum](https://discuss.elastic.co/u/elastic_user_forum)\
**Replies:** 3\
**Last updated:** [September 28, 2021, 8:23am UTC](https://discuss.elastic.co/t/translate-plugin-iterate-on-and-item-id-on-fallback/284205 "2021-09-28T08:23:20Z")

</div>

Hi everyone, I'm using ELK 7.13 and I have a question about the translate filter plugin. I have the following dictionary.json { "TUTU": {"identifiant": "TRANSLATE VALUE FOR TUTU"}, "TOTO": {"identifiant": "TRANSLATE…

---

## [Kibana Dashboard not loaded in AWS ES](https://discuss.elastic.co/t/kibana-dashboard-not-loaded-in-aws-es/285321)

<div class="topic-metadata">

**Author:** [@Balaji\_Arumugam](https://discuss.elastic.co/u/Balaji_Arumugam)\
**Replies:** 1\
**Last updated:** [September 28, 2021, 8:06am UTC](https://discuss.elastic.co/t/kibana-dashboard-not-loaded-in-aws-es/285321 "2021-09-28T08:06:16Z")

</div>

Hi, I have 3 master and 2 data nodes in amazon Elasticsearch. we have some production servers and installed filebeat and are able to push logs in Elasticsearch. For now we have installed metricbeat on one of the produc…

---

## [Filebeat: Unable to create dynamic Kafka topic name using Kubernetes metadata](https://discuss.elastic.co/t/filebeat-unable-to-create-dynamic-kafka-topic-name-using-kubernetes-metadata/285316)

<div class="topic-metadata">

**Author:** [@arunporwal](https://discuss.elastic.co/u/arunporwal)\
**Replies:** 1\
**Last updated:** [September 28, 2021, 8:04am UTC](https://discuss.elastic.co/t/filebeat-unable-to-create-dynamic-kafka-topic-name-using-kubernetes-metadata/285316 "2021-09-28T08:04:16Z")

</div>

I am trying to push Kubernetes logs to the Kafka cluster but while pushing logs I want to create a dynamic topic for all the corresponding Kubernetes namespaces. I am using the below configuration but getting errors whi…

---

## [Error : Logstash shut down](https://discuss.elastic.co/t/error-logstash-shut-down/285307)

<div class="topic-metadata">

**Author:** [@Busra\_Duygu](https://discuss.elastic.co/u/Busra_Duygu)\
**Replies:** 9\
**Last updated:** [September 28, 2021, 7:59am UTC](https://discuss.elastic.co/t/error-logstash-shut-down/285307 "2021-09-28T07:59:03Z")

</div>

Hello friends, I got this error while trying to transfer data to Elasticsearch with logstash. Actually, the transfer started, some data was transferred, but then it gave this error. Does anyone have an idea what could be…

---

## [Join two index ( metricbeat & business )](https://discuss.elastic.co/t/join-two-index-metricbeat-business/285318)

<div class="topic-metadata">

**Author:** [@rodri.gz](https://discuss.elastic.co/u/rodri.gz)\
**Replies:** 2\
**Last updated:** [September 28, 2021, 7:40am UTC](https://discuss.elastic.co/t/join-two-index-metricbeat-business/285318 "2021-09-28T07:40:31Z")

</div>

Hello! I will explain my case with an example. I have 2 indexes, one of them is the created by metricbeat and the other is an index that contains business data of my company. I would like to create a canvas. This canv…

---

## [How to delete logs from elasticsearch automatically](https://discuss.elastic.co/t/how-to-delete-logs-from-elasticsearch-automatically/284078)

<div class="topic-metadata">

**Author:** [@SRIGURU\_VEL](https://discuss.elastic.co/u/SRIGURU_VEL)\
**Replies:** 4\
**Last updated:** [September 28, 2021, 6:58am UTC](https://discuss.elastic.co/t/how-to-delete-logs-from-elasticsearch-automatically/284078 "2021-09-28T06:58:45Z")

</div>

HI Experts, We are using Elasticsearch 7.9 . We need to purge automatically the logs that we persist in Elasticsearch index based on a frequency/date I need a proper guide for that. thanks, Sriguruvel.

---

## [Cannot read properties of undefined (reading 'statusCode')](https://discuss.elastic.co/t/cannot-read-properties-of-undefined-reading-statuscode/285141)

<div class="topic-metadata">

**Author:** [@Mohammad.ali](https://discuss.elastic.co/u/Mohammad.ali)\
**Replies:** 4\
**Last updated:** [September 28, 2021, 7:25am UTC](https://discuss.elastic.co/t/cannot-read-properties-of-undefined-reading-statuscode/285141 "2021-09-28T07:25:03Z")

</div>

Hello everyone currently iam using kibana 7.6.1..i have a index with more than 4k fields and what i need to do is to refresh field list regarding our developer created new fields ..when i do that it takes long time and…

---

## [Async delete by query in elastic search spawns never ending tasks](https://discuss.elastic.co/t/async-delete-by-query-in-elastic-search-spawns-never-ending-tasks/285226)

<div class="topic-metadata">

**Author:** [@ThijsBM](https://discuss.elastic.co/u/ThijsBM)\
**Replies:** 4\
**Last updated:** [September 28, 2021, 7:09am UTC](https://discuss.elastic.co/t/async-delete-by-query-in-elastic-search-spawns-never-ending-tasks/285226 "2021-09-28T07:09:11Z")

</div>

We have a lot of data in our index that is tagged by an ownerId which resembles a customer. Every customer has the ability to define its own retention period. After the retention period is passed all the documents that a…

---

## [Why the thread\_pool.bulk.size must be \<= 17](https://discuss.elastic.co/t/why-the-thread-pool-bulk-size-must-be-17/285315)

<div class="topic-metadata">

**Author:** [@dzw-tw](https://discuss.elastic.co/u/dzw-tw)\
**Replies:** 1\
**Last updated:** [September 28, 2021, 7:05am UTC](https://discuss.elastic.co/t/why-the-thread-pool-bulk-size-must-be-17/285315 "2021-09-28T07:05:58Z")

</div>

---

## [Loop through "source": "\['message': ctx.payload.hits.hits.0.\_source \]",](https://discuss.elastic.co/t/loop-through-source-message-ctx-payload-hits-hits-0-source/285317)

<div class="topic-metadata">

**Author:** [@dilshanviso](https://discuss.elastic.co/u/dilshanviso)\
**Replies:** 0\
**Last updated:** [September 28, 2021, 7:02am UTC](https://discuss.elastic.co/t/loop-through-source-message-ctx-payload-hits-hits-0-source/285317 "2021-09-28T07:02:00Z")

</div>

Hi, Attached herewith is my watcher script to ingest all hits into an index and email action every hit. Currently I am able to do that to only for the first result/first hit using the following piece of code ""transfo…

---

## [Timestamp is wrong](https://discuss.elastic.co/t/timestamp-is-wrong/285310)

<div class="topic-metadata">

**Author:** [@cjw0202](https://discuss.elastic.co/u/cjw0202)\
**Replies:** 1\
**Last updated:** [September 28, 2021, 6:52am UTC](https://discuss.elastic.co/t/timestamp-is-wrong/285310 "2021-09-28T06:52:59Z")

</div>

ES 7.4 i use my custom timestamp, but the response timestamp is started at 1970 mapping: { "properties": { "hostName": { "type": "text", "fields": { "keyword": { "ignore\_above": …

---

## [Hyperlink or drilldown for a metric in Table Visualisation](https://discuss.elastic.co/t/hyperlink-or-drilldown-for-a-metric-in-table-visualisation/285001)

<div class="topic-metadata">

**Author:** [@Anuj\_Zope](https://discuss.elastic.co/u/Anuj_Zope)\
**Replies:** 4\
**Last updated:** [September 28, 2021, 6:45am UTC](https://discuss.elastic.co/t/hyperlink-or-drilldown-for-a-metric-in-table-visualisation/285001 "2021-09-28T06:45:12Z")

</div>

Hi! I am using Kibana 7.10.2. So I am making a dashboard with tickets data. For certain tables, the last column is the 'Count of Tickets'. What I need it that for every table I make with this column, I want to make the…

---

## [Enrich fields in new index from other index present in kibana using logstash](https://discuss.elastic.co/t/enrich-fields-in-new-index-from-other-index-present-in-kibana-using-logstash/284397)

<div class="topic-metadata">

**Author:** [@Divyank\_Mahalle](https://discuss.elastic.co/u/Divyank_Mahalle)\
**Replies:** 6\
**Last updated:** [September 27, 2021, 1:16pm UTC](https://discuss.elastic.co/t/enrich-fields-in-new-index-from-other-index-present-in-kibana-using-logstash/284397 "2021-09-27T13:16:48Z")

</div>

Hi , I am using logstash to create a new index from csv file which is having the index name-"therapy" Another index is "participation" already present in kibana with other fields. Both participation and therapy index …

---

## [CSV export: Reporting features are not yet ready](https://discuss.elastic.co/t/csv-export-reporting-features-are-not-yet-ready/285163)

<div class="topic-metadata">

**Author:** [@drnw](https://discuss.elastic.co/u/drnw)\
**Replies:** 5\
**Last updated:** [September 28, 2021, 4:30am UTC](https://discuss.elastic.co/t/csv-export-reporting-features-are-not-yet-ready/285163 "2021-09-28T04:30:38Z")

</div>

Please advise regards my failure to get CSV export working with an on-premise basic installation. Mac OSX install of Kibana from Homebrew (elastic/tap/kibana-full: stable 7.15.0) is throwing the following error: "tags"…

---

## [Help sending emails separately with only one watcher running (using forearch)](https://discuss.elastic.co/t/help-sending-emails-separately-with-only-one-watcher-running-using-forearch/285296)

<div class="topic-metadata">

**Author:** [@RaonyO](https://discuss.elastic.co/u/RaonyO)\
**Replies:** 0\
**Last updated:** [September 28, 2021, 2:01am UTC](https://discuss.elastic.co/t/help-sending-emails-separately-with-only-one-watcher-running-using-forearch/285296 "2021-09-28T02:01:49Z")

</div>

I need help in the structure of my watcher, I'm trying to create an alert where a notification is sent by email, but the notifications are going in message form (in the same initial email) and when it reaches 100, it's c…

---

## [Monitoring Process in Windows](https://discuss.elastic.co/t/monitoring-process-in-windows/285291)

<div class="topic-metadata">

**Author:** [@bevano](https://discuss.elastic.co/u/bevano)\
**Replies:** 2\
**Last updated:** [September 28, 2021, 1:46am UTC](https://discuss.elastic.co/t/monitoring-process-in-windows/285291 "2021-09-28T01:46:18Z")

</div>

Hi All, Currently trying to figure out how to monitor whether a Windows application is Up or Down. Currently using a filter to narrow down it to a specific agent.name (My Server) and process.name (application name) and…

---

## [Decommissioning a node using cluster.routing.allocation.exclude.\_name](https://discuss.elastic.co/t/decommissioning-a-node-using-cluster-routing-allocation-exclude-name/284946)

<div class="topic-metadata">

**Author:** [@linkerc](https://discuss.elastic.co/u/linkerc)\
**Replies:** 2\
**Last updated:** [September 28, 2021, 12:16am UTC](https://discuss.elastic.co/t/decommissioning-a-node-using-cluster-routing-allocation-exclude-name/284946 "2021-09-28T00:16:27Z")

</div>

Why doesn't the primary shard switched away from the node being decommissioned? When I use cluster.routing.allocation.exclude.\_name to exclude a node from participating the cluster (and be removed eventually), I noticed…

---

## [Configuring Spaces - Identifying Permissions for Role Access](https://discuss.elastic.co/t/configuring-spaces-identifying-permissions-for-role-access/285107)

<div class="topic-metadata">

**Author:** [@tthiry](https://discuss.elastic.co/u/tthiry)\
**Replies:** 5\
**Last updated:** [September 28, 2021, 12:11am UTC](https://discuss.elastic.co/t/configuring-spaces-identifying-permissions-for-role-access/285107 "2021-09-28T00:11:04Z")

</div>

Hello, Short time reader, first time caller... I am new to Elasticsearch and I am stumbling around. I am following the best practice of creating separate spaces for different user groups. For example I have a space for…

---

## [Single character column width in table view](https://discuss.elastic.co/t/single-character-column-width-in-table-view/285290)

<div class="topic-metadata">

**Author:** [@Chris\_Stone](https://discuss.elastic.co/u/Chris_Stone)\
**Replies:** 2\
**Last updated:** [September 27, 2021, 11:22pm UTC](https://discuss.elastic.co/t/single-character-column-width-in-table-view/285290 "2021-09-27T23:22:33Z")

</div>

After upgrading to 7.15 from 7.13, I see that many records in Discovery have a width of 1 character for the "field" column in table view. The json view looks fine. I see the issue in both the "classic" and updated views.…

---

## [\[request query.pattern\]: expected value of type \[string\] but got \[undefined\]](https://discuss.elastic.co/t/request-query-pattern-expected-value-of-type-string-but-got-undefined/284953)

<div class="topic-metadata">

**Author:** [@ewitkop](https://discuss.elastic.co/u/ewitkop)\
**Replies:** 6\
**Last updated:** [September 27, 2021, 10:58pm UTC](https://discuss.elastic.co/t/request-query-pattern-expected-value-of-type-string-but-got-undefined/284953 "2021-09-27T22:58:48Z")

</div>

I cannot seem to create an index pattern. There are over 600 fields and I cannot tell which one Kibana has an issue with. I have Kibana logging to stdout. And I can't get a idea of which field it has an issue with. Any …

---

## [GrokPraseFailure - JSON log - Success on Grokdebugger](https://discuss.elastic.co/t/grokprasefailure-json-log-success-on-grokdebugger/285282)

<div class="topic-metadata">

**Author:** [@Athul\_Devkar](https://discuss.elastic.co/u/Athul_Devkar)\
**Replies:** 3\
**Last updated:** [September 27, 2021, 10:48pm UTC](https://discuss.elastic.co/t/grokprasefailure-json-log-success-on-grokdebugger/285282 "2021-09-27T22:48:15Z")

</div>

I am facing issues while trying to parse this log. I have tried multiple options but nothing seems to work. No error message in the logs, except for this \_grokprasefailure tag in the records. Can you please help with wha…

---

## [Multiple elk stack structure](https://discuss.elastic.co/t/multiple-elk-stack-structure/285223)

<div class="topic-metadata">

**Author:** [@escking](https://discuss.elastic.co/u/escking)\
**Replies:** 0\
**Last updated:** [September 27, 2021, 11:41am UTC](https://discuss.elastic.co/t/multiple-elk-stack-structure/285223 "2021-09-27T11:41:08Z")

</div>

Hi all, I have a cluster about elastic stack using kafka connector . I want to migrate to kubernetes infrastructure to provide high availability. So my filebeat's output must send to data other kafka connector. Is it po…

---

## [\_grokparsefailure - Success in Grok Debugger - Log with Double quotes JSON](https://discuss.elastic.co/t/grokparsefailure-success-in-grok-debugger-log-with-double-quotes-json/285012)

<div class="topic-metadata">

**Author:** [@Athul\_Devkar](https://discuss.elastic.co/u/Athul_Devkar)\
**Replies:** 7\
**Last updated:** [September 27, 2021, 9:14pm UTC](https://discuss.elastic.co/t/grokparsefailure-success-in-grok-debugger-log-with-double-quotes-json/285012 "2021-09-27T21:14:42Z")

</div>

I am facing issues while trying to parse this log. I have tried multiple options but nothing seems to work. No error message in the logs, except for this tag in the records. Can you please help with what I am missing her…

---

## [SLM not starting](https://discuss.elastic.co/t/slm-not-starting/285231)

<div class="topic-metadata">

**Author:** [@dazevedo](https://discuss.elastic.co/u/dazevedo)\
**Replies:** 9\
**Last updated:** [September 27, 2021, 9:13pm UTC](https://discuss.elastic.co/t/slm-not-starting/285231 "2021-09-27T21:13:16Z")

</div>

good morning, I'm trying to configure my slm policies to automatically snapshot in my nfs repository of a NetApp storage, but I'm not able to activate the policy because it says that my \_slm index was not started... Any…

---

## [Separate Indexes Per Log File From Two Different Servers (Filebeat -\> Logstash - \> Elastic -\> Kibana)](https://discuss.elastic.co/t/separate-indexes-per-log-file-from-two-different-servers-filebeat-logstash-elastic-kibana/285262)

<div class="topic-metadata">

**Author:** [@kingmilo](https://discuss.elastic.co/u/kingmilo)\
**Replies:** 5\
**Last updated:** [September 27, 2021, 8:50pm UTC](https://discuss.elastic.co/t/separate-indexes-per-log-file-from-two-different-servers-filebeat-logstash-elastic-kibana/285262 "2021-09-27T20:50:28Z")

</div>

I have two servers configured with Filebeat to send logs to Logstash which is working properly. I would now like to view each of those logs separately under their respective indexes within Kibana Discover but I am strugg…

[Previous page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1221)

[Next page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1223)
