# Elastic Stack

**URL:** https://discuss.elastic.co/c/elastic-stack/81.md?page=1829

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1830

---

## [Access configuration values in new platform plugin](https://discuss.elastic.co/t/access-configuration-values-in-new-platform-plugin/247261)

<div class="topic-metadata">

**Author:** [@Elaak](https://discuss.elastic.co/u/Elaak)\
**Replies:** 2\
**Last updated:** [September 2, 2020, 4:31pm UTC](https://discuss.elastic.co/t/access-configuration-values-in-new-platform-plugin/247261 "2020-09-02T16:31:05Z")

</div>

I have defined a visualization plugin for the new platform currently running on Kibana 7.8.2 (github version). Now I have realized I need to let users enter some configuration values in order to make the usage more dynam…

---

## [Not able to do sum operation (Sum operation getting error)](https://discuss.elastic.co/t/not-able-to-do-sum-operation-sum-operation-getting-error/247262)

<div class="topic-metadata">

**Author:** [@Moksha20](https://discuss.elastic.co/u/Moksha20)\
**Replies:** 0\
**Last updated:** [September 2, 2020, 4:07pm UTC](https://discuss.elastic.co/t/not-able-to-do-sum-operation-sum-operation-getting-error/247262 "2020-09-02T16:07:54Z")

</div>

Hi , Recently I have migrated to grafana 7.0+ .The same query I used to run previously is not running now. Sample JSON LOG: \<2020-07-31 06:31:56\>:\<Item\_Des\_doc\_id\>:\<High\>:\<Pen\>:\<Datbase\>:\<location\>:\<Item\_Des\>:\<Item\_Id\>…

---

## [How to extract key-value pairs automatically from mixed type of message](https://discuss.elastic.co/t/how-to-extract-key-value-pairs-automatically-from-mixed-type-of-message/247264)

<div class="topic-metadata">

**Author:** [@kelk](https://discuss.elastic.co/u/kelk)\
**Replies:** 0\
**Last updated:** [September 2, 2020, 4:17pm UTC](https://discuss.elastic.co/t/how-to-extract-key-value-pairs-automatically-from-mixed-type-of-message/247264 "2020-09-02T16:17:25Z")

</div>

hi We have a mixed set of message coming from filebeat. The message is some form of "YAML/json" mix \[WARN \] 2020-09-02 16:03:55.966 \[\[pipline\_id\]\>worker6\] elasticsearch - Could not index event to Elasticsearch. {:statu…

---

## [Check the target object of a local\_lookup for jdbc\_static](https://discuss.elastic.co/t/check-the-target-object-of-a-local-lookup-for-jdbc-static/246975)

<div class="topic-metadata">

**Author:** [@chapmantrain](https://discuss.elastic.co/u/chapmantrain)\
**Replies:** 2\
**Last updated:** [September 2, 2020, 4:04pm UTC](https://discuss.elastic.co/t/check-the-target-object-of-a-local-lookup-for-jdbc-static/246975 "2020-09-02T16:04:10Z")

</div>

How would I check to see if the local\_lookup found the host name in the following conf snip. I tried an if statement just before the add\_fields but logstash did not like that. if \[device\] {...} = Expected one of \[ \\t\\r\\…

---

## [Not able to use ts-react-google-login-component node package in plugin for authentication in 7.8 OSS version](https://discuss.elastic.co/t/not-able-to-use-ts-react-google-login-component-node-package-in-plugin-for-authentication-in-7-8-oss-version/247131)

<div class="topic-metadata">

**Author:** [@Jayanth\_Mogadampalli](https://discuss.elastic.co/u/Jayanth_Mogadampalli)\
**Replies:** 1\
**Last updated:** [September 2, 2020, 3:56pm UTC](https://discuss.elastic.co/t/not-able-to-use-ts-react-google-login-component-node-package-in-plugin-for-authentication-in-7-8-oss-version/247131 "2020-09-02T15:56:12Z")

</div>

Right now, I am using elastic/kibana 7.8 OSS version code I am trying to implement authentication using Google auth by developing a plugin. For that I have installed the 'react-google-login' package using yarn and impo…

---

## [Elasticsearch composite aggregate query on nested fields](https://discuss.elastic.co/t/elasticsearch-composite-aggregate-query-on-nested-fields/247260)

<div class="topic-metadata">

**Author:** [@MCRj](https://discuss.elastic.co/u/MCRj)\
**Replies:** 0\
**Last updated:** [September 2, 2020, 3:47pm UTC](https://discuss.elastic.co/t/elasticsearch-composite-aggregate-query-on-nested-fields/247260 "2020-09-02T15:47:21Z")

</div>

I've a question on an aggregation on nested objects. Document is like: { "features": \[{ "key": "key1", "values": \["A", "B"\] }, { "key": "key2", "values…

---

## [Can't access index](https://discuss.elastic.co/t/cant-access-index/247253)

<div class="topic-metadata">

**Author:** [@headtea](https://discuss.elastic.co/u/headtea)\
**Replies:** 2\
**Last updated:** [September 2, 2020, 3:43pm UTC](https://discuss.elastic.co/t/cant-access-index/247253 "2020-09-02T15:43:35Z")

</div>

I can't seem to access my filebeat-\* index. I gets this message which once expanded says: "type": "illegal\_argument\_exception", "reason": "Field \[Date\] of type \[keyword\] does not support custom formats" i T…

---

## [Missing Fields](https://discuss.elastic.co/t/missing-fields/247198)

<div class="topic-metadata">

**Author:** [@Erroll16](https://discuss.elastic.co/u/Erroll16)\
**Replies:** 1\
**Last updated:** [September 2, 2020, 3:37pm UTC](https://discuss.elastic.co/t/missing-fields/247198 "2020-09-02T15:37:47Z")

</div>

Good Afternon I'm currently having some isues activating some filters on Kibana. I can see the ones i want to select but they are greyed out. IS there some sort of fix action for this isue. Thanks in advance

---

## [Output when have multiple logstash servers in cluster](https://discuss.elastic.co/t/output-when-have-multiple-logstash-servers-in-cluster/247251)

<div class="topic-metadata">

**Author:** [@nnovaes](https://discuss.elastic.co/u/nnovaes)\
**Replies:** 0\
**Last updated:** [September 2, 2020, 2:47pm UTC](https://discuss.elastic.co/t/output-when-have-multiple-logstash-servers-in-cluster/247251 "2020-09-02T14:47:18Z")

</div>

If i have, let's say, 3 servers in a logstash cluster, can i coordinate them somehow so when i configure syslog output only one of those servers will actually send the syslog message? otherwise all 3 would send and the r…

---

## [Alert and action -- Less than condition is not working](https://discuss.elastic.co/t/alert-and-action-less-than-condition-is-not-working/247069)

<div class="topic-metadata">

**Author:** [@msszafar](https://discuss.elastic.co/u/msszafar)\
**Replies:** 10\
**Last updated:** [September 2, 2020, 2:44pm UTC](https://discuss.elastic.co/t/alert-and-action-less-than-condition-is-not-working/247069 "2020-09-02T14:44:38Z")

</div>

Hi All, Thank you for this great support where we get reply in few minutes. We're very grateful to all of you guys. We're using latest version of ELK. In alert and action \> Log Threshold, less than feature doesn't work…

---

## [Java RestHighLevelClient missing get single task](https://discuss.elastic.co/t/java-resthighlevelclient-missing-get-single-task/247243)

<div class="topic-metadata">

**Author:** [@Leynch](https://discuss.elastic.co/u/Leynch)\
**Replies:** 2\
**Last updated:** [September 2, 2020, 2:27pm UTC](https://discuss.elastic.co/t/java-resthighlevelclient-missing-get-single-task/247243 "2020-09-02T14:27:15Z")

</div>

Which is the preferred way to get a single running task by ID? I'm looking at these two documentations (v7.9) for using Tasks: REST API Java Client but i can't find a way to get a single Task through the Java client.…

---

## [When adding a script\_field to a result, it results in not being able to compile](https://discuss.elastic.co/t/when-adding-a-script-field-to-a-result-it-results-in-not-being-able-to-compile/247119)

<div class="topic-metadata">

**Author:** [@meadows.120](https://discuss.elastic.co/u/meadows.120)\
**Replies:** 2\
**Last updated:** [September 2, 2020, 2:23pm UTC](https://discuss.elastic.co/t/when-adding-a-script-field-to-a-result-it-results-in-not-being-able-to-compile/247119 "2020-09-02T14:23:43Z")

</div>

ES Version: 7.8 I am trying to use the following to check if a value is present in an array of strings, but I get a runtime error every time: { "script": { "source": "doc\['mediaDetails.tags'\].values.contains('Hig…

---

## [Any of metricbeat modules require JDK?](https://discuss.elastic.co/t/any-of-metricbeat-modules-require-jdk/247246)

<div class="topic-metadata">

**Author:** [@Prashant\_Achari](https://discuss.elastic.co/u/Prashant_Achari)\
**Replies:** 1\
**Last updated:** [September 2, 2020, 2:17pm UTC](https://discuss.elastic.co/t/any-of-metricbeat-modules-require-jdk/247246 "2020-09-02T14:17:38Z")

</div>

I need to install metricbeat with modules ( MQ,Jolokia,apache,oracle) on multiple servers is jdk mandatory before we install beat ?

---

## [Elasticsearch with ingress received plaintext http traffic on an https channel](https://discuss.elastic.co/t/elasticsearch-with-ingress-received-plaintext-http-traffic-on-an-https-channel/246549)

<div class="topic-metadata">

**Author:** [@dcanales](https://discuss.elastic.co/u/dcanales)\
**Replies:** 2\
**Last updated:** [September 2, 2020, 1:47pm UTC](https://discuss.elastic.co/t/elasticsearch-with-ingress-received-plaintext-http-traffic-on-an-https-channel/246549 "2020-09-02T13:47:56Z")

</div>

Hi, i have the config from https://github.com/elastic/helm-charts/tree/7.9/elasticsearch/examples/security with the next ingress in my values.yaml: ingress: enabled: true annotations: kubernetes.io/ingress.clas…

---

## [Ingesting CloudTrail logs from multiple AWS accounts](https://discuss.elastic.co/t/ingesting-cloudtrail-logs-from-multiple-aws-accounts/246999)

<div class="topic-metadata">

**Author:** [@vishakh](https://discuss.elastic.co/u/vishakh)\
**Replies:** 3\
**Last updated:** [September 2, 2020, 1:43pm UTC](https://discuss.elastic.co/t/ingesting-cloudtrail-logs-from-multiple-aws-accounts/246999 "2020-09-02T13:43:49Z")

</div>

Brief: We do have multiple AWS accounts and we would prefer to ingest cloudtrail logs from all our accounts via Filebeat's AWS Module. (filebeat from same/single server & single agent) ELK-Stack: 7.8.0 Filebeat: 7.8.0 …

---

## [Need advice on shards for my index](https://discuss.elastic.co/t/need-advice-on-shards-for-my-index/247143)

<div class="topic-metadata">

**Author:** [@jcannell](https://discuss.elastic.co/u/jcannell)\
**Replies:** 14\
**Last updated:** [September 2, 2020, 1:29pm UTC](https://discuss.elastic.co/t/need-advice-on-shards-for-my-index/247143 "2020-09-02T13:29:27Z")

</div>

Hello all, Setting up an elasticsearch cluster for the first time here. I need some advice on creating my index. This index will store information about emails. The plan is to retain about 10 years worth of message dat…

---

## [Can we send logs to webhook URL?](https://discuss.elastic.co/t/can-we-send-logs-to-webhook-url/247100)

<div class="topic-metadata">

**Author:** [@Aishvarya\_Suryawansh](https://discuss.elastic.co/u/Aishvarya_Suryawansh)\
**Replies:** 2\
**Last updated:** [September 2, 2020, 12:59pm UTC](https://discuss.elastic.co/t/can-we-send-logs-to-webhook-url/247100 "2020-09-02T12:59:06Z")

</div>

Can we have webhook URL as destination URL in outputs need to send logstash data to Victorops eg: something like this output { webhook { hosts =\> \[""\] } }

---

## [Fortinet message field not being parsed correctly](https://discuss.elastic.co/t/fortinet-message-field-not-being-parsed-correctly/247236)

<div class="topic-metadata">

**Author:** [@tocheeba](https://discuss.elastic.co/u/tocheeba)\
**Replies:** 0\
**Last updated:** [September 2, 2020, 1:05pm UTC](https://discuss.elastic.co/t/fortinet-message-field-not-being-parsed-correctly/247236 "2020-09-02T13:05:04Z")

</div>

I've been trying to get this working for the past 3 weeks, and have read literally every forum post, reddit post, etc., on this. I'm spinning my wheels and can't figure out what is going wrong. I've tried using Filebeat…

---

## [New way in which java\_execution breaks the aggregate filter](https://discuss.elastic.co/t/new-way-in-which-java-execution-breaks-the-aggregate-filter/239377)

<div class="topic-metadata">

**Author:** [@Badger](https://discuss.elastic.co/u/Badger)\
**Replies:** 4\
**Last updated:** [September 2, 2020, 12:47pm UTC](https://discuss.elastic.co/t/new-way-in-which-java-execution-breaks-the-aggregate-filter/239377 "2020-09-02T12:47:45Z")

</div>

When java\_execution is enabled, the periodic\_flush does not occur, so you cannot use a timeout to trigger flushing an event from an aggregate filter. I do not think the final flush occurs either. This is in 7.8.0, and I …

---

## [InitiatingHeapOccupancyPercent tuning parameter value modification ( 75 to 30 )from 7.0.1 version to 7.8.0 in G1GC for elasticsearch](https://discuss.elastic.co/t/initiatingheapoccupancypercent-tuning-parameter-value-modification-75-to-30-from-7-0-1-version-to-7-8-0-in-g1gc-for-elasticsearch/245760)

<div class="topic-metadata">

**Author:** [@pratiksha](https://discuss.elastic.co/u/pratiksha)\
**Replies:** 2\
**Last updated:** [September 2, 2020, 12:22pm UTC](https://discuss.elastic.co/t/initiatingheapoccupancypercent-tuning-parameter-value-modification-75-to-30-from-7-0-1-version-to-7-8-0-in-g1gc-for-elasticsearch/245760 "2020-09-02T12:22:32Z")

</div>

"InitiatingHeapOccupancyPercent" parameter is set to 75 for elasticsearch 7.0.1, which is now updated to 30. Please state the reason why was it changed and what effect did it have. 7.0.1 version's jvm.options snippet: #…

---

## [Beats return conflicting mapping](https://discuss.elastic.co/t/beats-return-conflicting-mapping/247227)

<div class="topic-metadata">

**Author:** [@a\_maze](https://discuss.elastic.co/u/a_maze)\
**Replies:** 0\
**Last updated:** [September 2, 2020, 11:59am UTC](https://discuss.elastic.co/t/beats-return-conflicting-mapping/247227 "2020-09-02T11:59:25Z")

</div>

Hello, I am struggling to get a very basic ElasticStack / filebeat setup running. Everything was ok while I was using 7.8.1, but since I upgraded to 7.9.0 the Beats have been creating conflicts in my indexes. It's onl…

---

## [Create metricset failed](https://discuss.elastic.co/t/create-metricset-failed/247162)

<div class="topic-metadata">

**Author:** [@icaruswu](https://discuss.elastic.co/u/icaruswu)\
**Replies:** 3\
**Last updated:** [September 2, 2020, 11:46am UTC](https://discuss.elastic.co/t/create-metricset-failed/247162 "2020-09-02T11:46:32Z")

</div>

Help!! I git clone the beats source codes, and cd into the metricbeat to execute 'make create-metricset', then failed: icaruswu@icaruswu-B460MDS3H:~/go/src/beats/metricbeat$ make create-metricset mage createMetricset …

---

## [How can I get old archive of : analysis-icu-linux-x86\_64-6.8.12.zip](https://discuss.elastic.co/t/how-can-i-get-old-archive-of-analysis-icu-linux-x86-64-6-8-12-zip/247216)

<div class="topic-metadata">

**Author:** [@narutobaka1](https://discuss.elastic.co/u/narutobaka1)\
**Replies:** 1\
**Last updated:** [September 2, 2020, 11:37am UTC](https://discuss.elastic.co/t/how-can-i-get-old-archive-of-analysis-icu-linux-x86-64-6-8-12-zip/247216 "2020-09-02T11:37:04Z")

</div>

Hi I'm installing an old version of Elasticsearch : Blockquote \[root@pod2 elasticsearch\]# /usr/share/elasticsearch/bin/elasticsearch --version Version: 6.8.12, Build: default/rpm/7a15d2a/2020-08-12T07:27:20.804867Z, …

---

## [Primary Indices replicating to Warm Node](https://discuss.elastic.co/t/primary-indices-replicating-to-warm-node/246029)

<div class="topic-metadata">

**Author:** [@ajesh](https://discuss.elastic.co/u/ajesh)\
**Replies:** 9\
**Last updated:** [September 2, 2020, 11:15am UTC](https://discuss.elastic.co/t/primary-indices-replicating-to-warm-node/246029 "2020-09-02T11:15:23Z")

</div>

Hi There, Our current Elasticsearch stack is a 3 node testing cluster with 2 Data and 1 Warm node. All three are master. As per the cluster re-balancing policy its creating index replicas (Primary and replica) on the Wa…

---

## [Deleting Snapshots very slow after update](https://discuss.elastic.co/t/deleting-snapshots-very-slow-after-update/247025)

<div class="topic-metadata">

**Author:** [@Andrew\_DS](https://discuss.elastic.co/u/Andrew_DS)\
**Replies:** 6\
**Last updated:** [September 2, 2020, 11:13am UTC](https://discuss.elastic.co/t/deleting-snapshots-very-slow-after-update/247025 "2020-09-02T11:13:27Z")

</div>

Has anyone else had any issues deleting snapshots after upgrading? I upgraded from 7.5.1 -\> 7.9.0, and now REST calls to DELETE /snapshot/repo-name/snapshot-name take exactly 3 minutes to return. If I call GET /snapsh…

---

## [Lost data on docker](https://discuss.elastic.co/t/lost-data-on-docker/246924)

<div class="topic-metadata">

**Author:** [@alireza\_Rahmani\_khal](https://discuss.elastic.co/u/alireza_Rahmani_khal)\
**Replies:** 7\
**Last updated:** [September 2, 2020, 10:07am UTC](https://discuss.elastic.co/t/lost-data-on-docker/246924 "2020-09-02T10:07:47Z")

</div>

hello this my docker-compose : search: image: docker.elastic.co/elasticsearch/elasticsearch:7.8.1 environment: - container\_name:es01 - bootstrap.memory\_lock:true - "ES\_JAVA\_OPTS=-Xms2g -Xmx2…

---

## [Error Messages handling In Kibana UI](https://discuss.elastic.co/t/error-messages-handling-in-kibana-ui/247187)

<div class="topic-metadata">

**Author:** [@prashant1](https://discuss.elastic.co/u/prashant1)\
**Replies:** 2\
**Last updated:** [September 2, 2020, 10:05am UTC](https://discuss.elastic.co/t/error-messages-handling-in-kibana-ui/247187 "2020-09-02T10:05:21Z")

</div>

Hi, When unauthenticated user logs in to view the indices, Kibana prompt the Message saying No Permission. After that the correct index selected, still the error message visible. We have to click explicitly 'ok' to can…

---

## [Would like to create a visulization that show ERROR, WARN and INFO](https://discuss.elastic.co/t/would-like-to-create-a-visulization-that-show-error-warn-and-info/247189)

<div class="topic-metadata">

**Author:** [@111363](https://discuss.elastic.co/u/111363)\
**Replies:** 5\
**Last updated:** [September 2, 2020, 10:04am UTC](https://discuss.elastic.co/t/would-like-to-create-a-visulization-that-show-error-warn-and-info/247189 "2020-09-02T10:04:28Z")

</div>

Hi, I am trying to create visualization that show per specific log the count of ERROR, WARN & INFO messages. I have tried to create the json input for getting all to message filed that contains \[ERROR\] but it did not …

---

## [Dashboards through logstash](https://discuss.elastic.co/t/dashboards-through-logstash/247207)

<div class="topic-metadata">

**Author:** [@headtea](https://discuss.elastic.co/u/headtea)\
**Replies:** 0\
**Last updated:** [September 2, 2020, 9:55am UTC](https://discuss.elastic.co/t/dashboards-through-logstash/247207 "2020-09-02T09:55:43Z")

</div>

I'm directing my beats (auditbeat & filebeat) output directly to logstash. In both beats' configs I have dashboards enabled. The problem is that the dashboards data doesn't seem to end up in kibana if I output to logsta…

---

## [Reindexing elastic search does not return all documents](https://discuss.elastic.co/t/reindexing-elastic-search-does-not-return-all-documents/246687)

<div class="topic-metadata">

**Author:** [@byc-art](https://discuss.elastic.co/u/byc-art)\
**Replies:** 1\
**Last updated:** [September 2, 2020, 9:44am UTC](https://discuss.elastic.co/t/reindexing-elastic-search-does-not-return-all-documents/246687 "2020-09-02T09:44:01Z")

</div>

0 I have about 1.5 million documents in my elastic search. I'm hoping to reindex them so that each index filters documents containing certain keywords, and one ( null index ) that do not contain any of the keywords I sp…

[Previous page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1828)

[Next page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1830)
