# Elastic Stack

**URL:** https://discuss.elastic.co/c/elastic-stack/81.md?page=1587

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1588

---

## [What regex to use to exclude 30s status messages](https://discuss.elastic.co/t/what-regex-to-use-to-exclude-30s-status-messages/262219)

<div class="topic-metadata">

**Author:** [@Peter\_Boos](https://discuss.elastic.co/u/Peter_Boos)\
**Replies:** 0\
**Last updated:** [January 26, 2021, 10:46am UTC](https://discuss.elastic.co/t/what-regex-to-use-to-exclude-30s-status-messages/262219 "2021-01-26T10:46:33Z")

</div>

What should be the working regex to exclude the 30s filebeat status updates The 30s status starts with, (but are quite a bit longer) : 2021-01-26T05:29:10.562-0500#011INFO#011\[monitoring\]#011log/log.go:145#011Non-zero…

---

## [Can I define the color of each value in Kibana visualization by assigning it specific RGB?](https://discuss.elastic.co/t/can-i-define-the-color-of-each-value-in-kibana-visualization-by-assigning-it-specific-rgb/261401)

<div class="topic-metadata">

**Author:** [@Shalhevet](https://discuss.elastic.co/u/Shalhevet)\
**Replies:** 4\
**Last updated:** [January 26, 2021, 9:44am UTC](https://discuss.elastic.co/t/can-i-define-the-color-of-each-value-in-kibana-visualization-by-assigning-it-specific-rgb/261401 "2021-01-26T09:44:34Z")

</div>

hi, I have a data set which includes x and y position of each measurement, and its corresponding RGB. is there a way to Visualize it with Kibana? This is actually a heat map where each point has x and y values, but th…

---

## [Can I filter an array in elastic?](https://discuss.elastic.co/t/can-i-filter-an-array-in-elastic/262198)

<div class="topic-metadata">

**Author:** [@ShreyaBhat](https://discuss.elastic.co/u/ShreyaBhat)\
**Replies:** 2\
**Last updated:** [January 26, 2021, 8:33am UTC](https://discuss.elastic.co/t/can-i-filter-an-array-in-elastic/262198 "2021-01-26T08:33:41Z")

</div>

is there a way to filter an array in elastic ? I have inserted the following data into elastic "\_source":{ "FileName": "fileName.log" "logData": \[ { "LineNumber": 1, …

---

## [Filtering out unwanted infobeat hartbeat 30s](https://discuss.elastic.co/t/filtering-out-unwanted-infobeat-hartbeat-30s/262202)

<div class="topic-metadata">

**Author:** [@Peter\_Boos](https://discuss.elastic.co/u/Peter_Boos)\
**Replies:** 0\
**Last updated:** [January 26, 2021, 8:11am UTC](https://discuss.elastic.co/t/filtering-out-unwanted-infobeat-hartbeat-30s/262202 "2021-01-26T08:11:09Z")

</div>

I'd like to remove the log that filebeat generates every 30s, It starts with : 021-01-18T08:29:59.656-0500#011INFO#011\[monitoring\]#011log/log.go:145#011Non-zero metrics in the last 30s#011{"monitoring": {"metrics": {"b…

---

## [Sort by every element of array](https://discuss.elastic.co/t/sort-by-every-element-of-array/262201)

<div class="topic-metadata">

**Author:** [@Dmitrii](https://discuss.elastic.co/u/Dmitrii)\
**Replies:** 0\
**Last updated:** [January 26, 2021, 8:02am UTC](https://discuss.elastic.co/t/sort-by-every-element-of-array/262201 "2021-01-26T08:02:50Z")

</div>

Hello, I have some problems with sorting by element of array. If I have for example 2 documents like: { "\_id" : "1", "\_source" : { "users" : \[{"name" : "John"},{"name" : "Paul"}\] } } { "\_id" : "2", "\_so…

---

## [How customizable Is Tooltip when tooltips=false in the configuration?](https://discuss.elastic.co/t/how-customizable-is-tooltip-when-tooltips-false-in-the-configuration/259563)

<div class="topic-metadata">

**Author:** [@m-amano](https://discuss.elastic.co/u/m-amano)\
**Replies:** 2\
**Last updated:** [January 26, 2021, 7:41am UTC](https://discuss.elastic.co/t/how-customizable-is-tooltip-when-tooltips-false-in-the-configuration/259563 "2021-01-26T07:41:27Z")

</div>

I am using Elasticsearch and Kibana v.7.6.1 and Vega v.4.3.0. I added tooltips:false in configuration of Vega to show full length of text in tooltips. Unless I add this code, the text does not show up in full length if …

---

## [Docker services stop working when loosing connection from elastic-logging-plugin to ElasticDB](https://discuss.elastic.co/t/docker-services-stop-working-when-loosing-connection-from-elastic-logging-plugin-to-elasticdb/262196)

<div class="topic-metadata">

**Author:** [@LeeAn](https://discuss.elastic.co/u/LeeAn)\
**Replies:** 0\
**Last updated:** [January 26, 2021, 6:38am UTC](https://discuss.elastic.co/t/docker-services-stop-working-when-loosing-connection-from-elastic-logging-plugin-to-elasticdb/262196 "2021-01-26T06:38:03Z")

</div>

Hi, Im using Elastic-logging-plugin to collect logs from my docker containers and send them to Kibana but sometime the connection to ElasticDB got lost for reasons like internal error from ElasticDB server or network p…

---

## [Pagination with HighLevelRestClient](https://discuss.elastic.co/t/pagination-with-highlevelrestclient/262146)

<div class="topic-metadata">

**Author:** [@filmac79](https://discuss.elastic.co/u/filmac79)\
**Replies:** 8\
**Last updated:** [January 26, 2021, 6:18am UTC](https://discuss.elastic.co/t/pagination-with-highlevelrestclient/262146 "2021-01-26T06:18:47Z")

</div>

Hello, I would like to use HighLevelRestClient to fetch all results matching a given query using pagination. Now, checking on the rest api I can found that scroll api have been replaced by search\_after. So I checked th…

---

## [Kibana service fails regularly and following errors are displayed at startup](https://discuss.elastic.co/t/kibana-service-fails-regularly-and-following-errors-are-displayed-at-startup/262172)

<div class="topic-metadata">

**Author:** [@Daniel\_Haverporth](https://discuss.elastic.co/u/Daniel_Haverporth)\
**Replies:** 1\
**Last updated:** [January 26, 2021, 5:28am UTC](https://discuss.elastic.co/t/kibana-service-fails-regularly-and-following-errors-are-displayed-at-startup/262172 "2021-01-26T05:28:50Z")

</div>

Hello: The Kibana service fails regularly and when I go to restart Kibana the following errors are displayed in the log: log \[21:15:09.874\] \[error\]\[data\]\[elasticsearch\] \[version\_conflict\_engine\_exception\]: \[task:Len…

---

## [Kibana field Aliases](https://discuss.elastic.co/t/kibana-field-aliases/261588)

<div class="topic-metadata">

**Author:** [@griffer98](https://discuss.elastic.co/u/griffer98)\
**Replies:** 3\
**Last updated:** [January 26, 2021, 5:10am UTC](https://discuss.elastic.co/t/kibana-field-aliases/261588 "2021-01-26T05:10:36Z")

</div>

I have two indices that have a field with the same name. I want to join both into one data table. I know I can change the display name in a table but I wont know which index each one is coming from to name appropriately.…

---

## [Adding config for custom log integration on an agent](https://discuss.elastic.co/t/adding-config-for-custom-log-integration-on-an-agent/262181)

<div class="topic-metadata">

**Author:** [@Tim\_Estes](https://discuss.elastic.co/u/Tim_Estes)\
**Replies:** 5\
**Last updated:** [January 26, 2021, 4:55am UTC](https://discuss.elastic.co/t/adding-config-for-custom-log-integration-on-an-agent/262181 "2021-01-26T04:55:08Z")

</div>

Hello, I'm trying to index json logs with a Fleet-managed agent using a custom log configuration. I successfully downloaded the agent to my computer and specified a path where the log files live. However, when I genera…

---

## [Issue using searchable snapshots in an ILM policy](https://discuss.elastic.co/t/issue-using-searchable-snapshots-in-an-ilm-policy/262001)

<div class="topic-metadata">

**Author:** [@3266miles](https://discuss.elastic.co/u/3266miles)\
**Replies:** 2\
**Last updated:** [January 26, 2021, 3:33am UTC](https://discuss.elastic.co/t/issue-using-searchable-snapshots-in-an-ilm-policy/262001 "2021-01-26T03:33:40Z")

</div>

Taking searchable snapshots as part of an ILM policy for a spin, the indexes seem to be moving through the stages fine until it reaches the cold stage, where it takes the snapshot but then utterly fails to mount it. Run…

---

## [If condition Statement](https://discuss.elastic.co/t/if-condition-statement/262167)

<div class="topic-metadata">

**Author:** [@hzarrabi](https://discuss.elastic.co/u/hzarrabi)\
**Replies:** 2\
**Last updated:** [January 26, 2021, 2:53am UTC](https://discuss.elastic.co/t/if-condition-statement/262167 "2021-01-26T02:53:35Z")

</div>

Hi All, Could you please tell me what is wrong with the following IF condition if \[ DOCUMENT\_MODEL \] == "10000" { mutate { replace =\> { "DOCUMENT\_MODEL" =\> "INVOICE" } } } Even though the DOCUM…

---

## [How to import Nested JSON?](https://discuss.elastic.co/t/how-to-import-nested-json/262183)

<div class="topic-metadata">

**Author:** [@hourtest](https://discuss.elastic.co/u/hourtest)\
**Replies:** 0\
**Last updated:** [January 26, 2021, 1:33am UTC](https://discuss.elastic.co/t/how-to-import-nested-json/262183 "2021-01-26T01:33:43Z")

</div>

Nested JSON like this { "boolean\_key": "--- true\\n", "empty\_string\_translation": "", "key\_with\_description": "Check it out! This key has a description! (At least in some formats)", "key\_with\_line-break": "This …

---

## [Kibana 7.10: how can I pass a custom parameter/header in response.redirect](https://discuss.elastic.co/t/kibana-7-10-how-can-i-pass-a-custom-parameter-header-in-response-redirect/262139)

<div class="topic-metadata">

**Author:** [@Prathibha\_Y](https://discuss.elastic.co/u/Prathibha_Y)\
**Replies:** 1\
**Last updated:** [January 26, 2021, 12:00am UTC](https://discuss.elastic.co/t/kibana-7-10-how-can-i-pass-a-custom-parameter-header-in-response-redirect/262139 "2021-01-26T00:00:45Z")

</div>

Hi, I am trying to use redirect method as below, const urlToADashboard = core.http.basePath.prepend(/app/dashboards#/list); response.redirected({ headers: { location: urlToADashboard,authorization:authorizParams } })…

---

## [Global index settings](https://discuss.elastic.co/t/global-index-settings/262176)

<div class="topic-metadata">

**Author:** [@cdalexndr](https://discuss.elastic.co/u/cdalexndr)\
**Replies:** 0\
**Last updated:** [January 25, 2021, 11:07pm UTC](https://discuss.elastic.co/t/global-index-settings/262176 "2021-01-25T23:07:30Z")

</div>

I want to apply some global index settings (index.number\_of\_replicas, index.codec) to any new created index. From https://discuss.elastic.co/t/index-settings-in-configuration-file-does-not-take-effect/113120 I understan…

---

## [Is there any Latency module/merticset available across beats family](https://discuss.elastic.co/t/is-there-any-latency-module-merticset-available-across-beats-family/261804)

<div class="topic-metadata">

**Author:** [@Ishaan](https://discuss.elastic.co/u/Ishaan)\
**Replies:** 10\
**Last updated:** [January 25, 2021, 10:14pm UTC](https://discuss.elastic.co/t/is-there-any-latency-module-merticset-available-across-beats-family/261804 "2021-01-25T22:14:30Z")

</div>

Hello, I would like to know if there is any Latency module/metricset available across beats family to pull latency data from the different OS platforms? Thanks

---

## [Can't change timestamp of logstash to timestamp of log](https://discuss.elastic.co/t/cant-change-timestamp-of-logstash-to-timestamp-of-log/262134)

<div class="topic-metadata">

**Author:** [@vladik22](https://discuss.elastic.co/u/vladik22)\
**Replies:** 2\
**Last updated:** [January 25, 2021, 9:20pm UTC](https://discuss.elastic.co/t/cant-change-timestamp-of-logstash-to-timestamp-of-log/262134 "2021-01-25T21:20:33Z")

</div>

Can't replace timestamp of logstash with timestamp of log file csv and send to elasticsearch. in debugger all work. When I change output to elasticsearch it's write that is work but after I create index patern in kiban…

---

## [Combine multiple views into one graph](https://discuss.elastic.co/t/combine-multiple-views-into-one-graph/262127)

<div class="topic-metadata">

**Author:** [@morbidel](https://discuss.elastic.co/u/morbidel)\
**Replies:** 1\
**Last updated:** [January 25, 2021, 8:50pm UTC](https://discuss.elastic.co/t/combine-multiple-views-into-one-graph/262127 "2021-01-25T20:50:10Z")

</div>

Hello, I'm using Kibana & Elastic search (version 7.0) for a while now, for various reports. For some reason, I'm unable to combine some charts which should obviously and easily be possible to combine as they share the…

---

## [Path config for custom log integration?](https://discuss.elastic.co/t/path-config-for-custom-log-integration/262158)

<div class="topic-metadata">

**Author:** [@Tim\_Estes](https://discuss.elastic.co/u/Tim_Estes)\
**Replies:** 4\
**Last updated:** [January 25, 2021, 8:16pm UTC](https://discuss.elastic.co/t/path-config-for-custom-log-integration/262158 "2021-01-25T20:16:53Z")

</div>

Hello, I'm trying out the elastic agent feature in a test cluster but I haven't been able to figure out how to ship custom logs to it. In the integration, I've specified the log path to be path/to/my/logs: I was abl…

---

## [Viewing EPS graph in Kibana](https://discuss.elastic.co/t/viewing-eps-graph-in-kibana/261665)

<div class="topic-metadata">

**Author:** [@Falikou1](https://discuss.elastic.co/u/Falikou1)\
**Replies:** 10\
**Last updated:** [January 25, 2021, 8:09pm UTC](https://discuss.elastic.co/t/viewing-eps-graph-in-kibana/261665 "2021-01-25T20:09:04Z")

</div>

I want to display a graph of the EPS in kibana. But, it displays a graph every 30 seconds over 1 hour that I defined. While I have set by second. Is there a possibility for it to display per second? Thanks for your h…

---

## [Help in visualizing custom query/aggregation](https://discuss.elastic.co/t/help-in-visualizing-custom-query-aggregation/261881)

<div class="topic-metadata">

**Author:** [@Christoph\_Quadt](https://discuss.elastic.co/u/Christoph_Quadt)\
**Replies:** 7\
**Last updated:** [January 25, 2021, 7:41pm UTC](https://discuss.elastic.co/t/help-in-visualizing-custom-query-aggregation/261881 "2021-01-25T19:41:18Z")

</div>

Hi there, I am having trouble in visualizing the following elasticsearch query: { "query": { "exists": { "field": "log\_transaction\_status" } }, "size": 0, "aggs": {…

---

## [Difference between nested in bool and bool in nested](https://discuss.elastic.co/t/difference-between-nested-in-bool-and-bool-in-nested/262161)

<div class="topic-metadata">

**Author:** [@Anton\_Shuvaev](https://discuss.elastic.co/u/Anton_Shuvaev)\
**Replies:** 0\
**Last updated:** [January 25, 2021, 7:14pm UTC](https://discuss.elastic.co/t/difference-between-nested-in-bool-and-bool-in-nested/262161 "2021-01-25T19:14:26Z")

</div>

Is there a difference in terms of performance and cache between nested query inside bool query and vice versa? For example, { "query": { "bool": { "filter": \[ { "nested": { "pa…

---

## [How to get elastic search \_score in the response without script\_score being applied](https://discuss.elastic.co/t/how-to-get-elastic-search-score-in-the-response-without-script-score-being-applied/262085)

<div class="topic-metadata">

**Author:** [@oo7\_manju](https://discuss.elastic.co/u/oo7_manju)\
**Replies:** 0\
**Last updated:** [January 25, 2021, 11:20am UTC](https://discuss.elastic.co/t/how-to-get-elastic-search-score-in-the-response-without-script-score-being-applied/262085 "2021-01-25T11:20:59Z")

</div>

Hi, We are looking for fetching \_score value from elastic search response., but looks like \_score value always includes the applied script\_score. We have script\_score to boost the relevancy in the query, and the requi…

---

## [Kibana saved objects create api is taking for ever, cluster tasks pending for a long time](https://discuss.elastic.co/t/kibana-saved-objects-create-api-is-taking-for-ever-cluster-tasks-pending-for-a-long-time/261710)

<div class="topic-metadata">

**Author:** [@rajkumar.m](https://discuss.elastic.co/u/rajkumar.m)\
**Replies:** 2\
**Last updated:** [January 25, 2021, 6:25pm UTC](https://discuss.elastic.co/t/kibana-saved-objects-create-api-is-taking-for-ever-cluster-tasks-pending-for-a-long-time/261710 "2021-01-25T18:25:59Z")

</div>

Hi Team, Kibana saved objects create api is taking forever, cluster tasks are pending for a long time. I am trying to create search, visualization, dashboards using kibana saved objects api. observed that it is dead s…

---

## [Elastic Search Aggregations](https://discuss.elastic.co/t/elastic-search-aggregations/262009)

<div class="topic-metadata">

**Author:** [@Srini12](https://discuss.elastic.co/u/Srini12)\
**Replies:** 1\
**Last updated:** [January 25, 2021, 6:01pm UTC](https://discuss.elastic.co/t/elastic-search-aggregations/262009 "2021-01-25T18:01:20Z")

</div>

Hi I am trying to build small app with facets, I am using NEST to get aggregations. When I execute the aggregations query using cURL iam getting expected results: my cURL is POST product/\_search { "aggs": { "g…

---

## [Fixing Legacy 'Self Monitoring' for Docker containers](https://discuss.elastic.co/t/fixing-legacy-self-monitoring-for-docker-containers/262151)

<div class="topic-metadata">

**Author:** [@doyelese](https://discuss.elastic.co/u/doyelese)\
**Replies:** 1\
**Last updated:** [January 25, 2021, 5:56pm UTC](https://discuss.elastic.co/t/fixing-legacy-self-monitoring-for-docker-containers/262151 "2021-01-25T17:56:29Z")

</div>

I am getting the warning that Self Monitoring will not be supported in 8.0. My elastic environment is configured via 5 ElasticSearch container nodes and 1 Kibana container. How do I migrate away from self monitoring the…

---

## [Elasticsearch moving a replica shard between nodes](https://discuss.elastic.co/t/elasticsearch-moving-a-replica-shard-between-nodes/262042)

<div class="topic-metadata">

**Author:** [@vikasp](https://discuss.elastic.co/u/vikasp)\
**Replies:** 6\
**Last updated:** [January 25, 2021, 5:10pm UTC](https://discuss.elastic.co/t/elasticsearch-moving-a-replica-shard-between-nodes/262042 "2021-01-25T17:10:24Z")

</div>

Hi, I have a cluster with almost all nodes 111 shards and only 2 nodes 108. I understand that ES balance the cluster with shard count. cluster has around 19 nodes, 3 master eligible of them 2 data as well and 16 data…

---

## [Kibana string manipulation](https://discuss.elastic.co/t/kibana-string-manipulation/262132)

<div class="topic-metadata">

**Author:** [@zaeemmasood](https://discuss.elastic.co/u/zaeemmasood)\
**Replies:** 1\
**Last updated:** [January 25, 2021, 5:08pm UTC](https://discuss.elastic.co/t/kibana-string-manipulation/262132 "2021-01-25T17:08:04Z")

</div>

Hello. We are using ELK 7.6.2 stack. Fields from a particular log file gets displayed nice and proper in Kibana. One of the fields is "message" which in itself contains lot of information. Example from the log is as b…

---

## [Does the PIT API allow scrolling backward?](https://discuss.elastic.co/t/does-the-pit-api-allow-scrolling-backward/260129)

<div class="topic-metadata">

**Author:** [@F\_eq\_kx](https://discuss.elastic.co/u/F_eq_kx)\
**Replies:** 4\
**Last updated:** [January 25, 2021, 5:05pm UTC](https://discuss.elastic.co/t/does-the-pit-api-allow-scrolling-backward/260129 "2021-01-25T17:05:02Z")

</div>

The deprecated Scroll API didn't allow scrolling backward. Now that it is being replaced, is there a way to do that with PIT?

[Previous page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1586)

[Next page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1588)
