# Elastic Stack

**URL:** https://discuss.elastic.co/c/elastic-stack/81.md?page=1963

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1964

---

## [Is it possible to suppress gc logs in filebeat elasticsearch module?](https://discuss.elastic.co/t/is-it-possible-to-suppress-gc-logs-in-filebeat-elasticsearch-module/239066)

<div class="topic-metadata">

**Author:** [@Webtrend\_Inc](https://discuss.elastic.co/u/Webtrend_Inc)\
**Replies:** 1\
**Last updated:** [June 30, 2020, 2:48am UTC](https://discuss.elastic.co/t/is-it-possible-to-suppress-gc-logs-in-filebeat-elasticsearch-module/239066 "2020-06-30T02:48:56Z")

</div>

I tried editing the elasticsearch.yml file in modules.d folder but it does not seem to be working I tried both commenting out gc section and tried gc.enabled: false but none of them seem to be working. When this module…

---

## [ILM alias does not point to index](https://discuss.elastic.co/t/ilm-alias-does-not-point-to-index/238567)

<div class="topic-metadata">

**Author:** [@craigothy](https://discuss.elastic.co/u/craigothy)\
**Replies:** 1\
**Last updated:** [June 30, 2020, 12:55am UTC](https://discuss.elastic.co/t/ilm-alias-does-not-point-to-index/238567 "2020-06-30T00:55:35Z")

</div>

Can someone explain why I am getting the following error regarding the default builtin ILM policy. I've seen this for different beats (winlogbeat,packetbeat,filebeat). They all go into an "error" state. I've basically ju…

---

## [Monitoring cluster logstash error](https://discuss.elastic.co/t/monitoring-cluster-logstash-error/238795)

<div class="topic-metadata">

**Author:** [@bevano](https://discuss.elastic.co/u/bevano)\
**Replies:** 4\
**Last updated:** [June 30, 2020, 12:53am UTC](https://discuss.elastic.co/t/monitoring-cluster-logstash-error/238795 "2020-06-30T00:53:18Z")

</div>

Hi all, I currently have a ELK stack in product and have metricbeat setup on every node logstash instances pushing metric and monitoring data to a separate monitoring cluster. Everything was working in 7.7.1, but since…

---

## [How to implement handlers to render my own data with Search UI](https://discuss.elastic.co/t/how-to-implement-handlers-to-render-my-own-data-with-search-ui/239204)

<div class="topic-metadata">

**Author:** [@spadel](https://discuss.elastic.co/u/spadel)\
**Replies:** 0\
**Last updated:** [June 30, 2020, 12:14am UTC](https://discuss.elastic.co/t/how-to-implement-handlers-to-render-my-own-data-with-search-ui/239204 "2020-06-30T00:14:15Z")

</div>

I worked through the Elastic Search UI on github and finally found what I need, to render my own data: It seems like I can implement a handler, that takes the search query, so that I can send it to my API and render m…

---

## [Dashboard Filters Don't Get Applied To Timelion](https://discuss.elastic.co/t/dashboard-filters-dont-get-applied-to-timelion/235088)

<div class="topic-metadata">

**Author:** [@Alsheh](https://discuss.elastic.co/u/Alsheh)\
**Replies:** 2\
**Last updated:** [June 30, 2020, 12:07am UTC](https://discuss.elastic.co/t/dashboard-filters-dont-get-applied-to-timelion/235088 "2020-06-30T00:07:03Z")

</div>

In Kibana 6.8.2 dashboards filters get applied to Timelion visualizations. However, after upgrading to Kibana 7.7.0, dashboards filters don't seem to be applied to Timelion visualizations. Is this a bug or expected behav…

---

## [How schedule periodic task but execute when Logstash instance starts?](https://discuss.elastic.co/t/how-schedule-periodic-task-but-execute-when-logstash-instance-starts/238899)

<div class="topic-metadata">

**Author:** [@Fabio\_Naspolini](https://discuss.elastic.co/u/Fabio_Naspolini)\
**Replies:** 3\
**Last updated:** [June 29, 2020, 10:35pm UTC](https://discuss.elastic.co/t/how-schedule-periodic-task-but-execute-when-logstash-instance-starts/238899 "2020-06-29T22:35:29Z")

</div>

How schedule periodic task but execute on Logstash instance starts? I need to schedule tasks to execute every hour, but I need force re-execute this when Logstash service restarted. How to do this? Thank you!

---

## [Sflow data into Kafka?](https://discuss.elastic.co/t/sflow-data-into-kafka/236613)

<div class="topic-metadata">

**Author:** [@ceekay](https://discuss.elastic.co/u/ceekay)\
**Replies:** 1\
**Last updated:** [June 29, 2020, 9:45pm UTC](https://discuss.elastic.co/t/sflow-data-into-kafka/236613 "2020-06-29T21:45:25Z")

</div>

HI there, I'm shipping sflow data into my Elastic Stack, using Elastiflow's filters and dashboards. Input is UDP with sflow codec. My architecture has Logstash ingress nodes which are only doing minimal processing, and…

---

## [Update 2 million record with a correct format of country prefix in phone number field](https://discuss.elastic.co/t/update-2-million-record-with-a-correct-format-of-country-prefix-in-phone-number-field/239152)

<div class="topic-metadata">

**Author:** [@meena](https://discuss.elastic.co/u/meena)\
**Replies:** 2\
**Last updated:** [June 29, 2020, 9:19pm UTC](https://discuss.elastic.co/t/update-2-million-record-with-a-correct-format-of-country-prefix-in-phone-number-field/239152 "2020-06-29T21:19:12Z")

</div>

Hi, Am not an Expert on elastic search but would like to update around 2 million records in my database with a country prefix to be added to the phone number field in correct format. My phone number field lies under ne…

---

## [AuditBeat failed to create audit client: protocol not supported](https://discuss.elastic.co/t/auditbeat-failed-to-create-audit-client-protocol-not-supported/138601)

<div class="topic-metadata">

**Author:** [@Nicholas\_Amon](https://discuss.elastic.co/u/Nicholas_Amon)\
**Replies:** 5\
**Last updated:** [June 29, 2020, 9:21pm UTC](https://discuss.elastic.co/t/auditbeat-failed-to-create-audit-client-protocol-not-supported/138601 "2020-06-29T21:21:13Z")

</div>

Auditbeat is failing to start successfully with the error message: 2018-07-04T18:01:32.410Z ERROR instance/beat.go:691 Exiting: 1 error: 1 error: failed to create audit client: failed to create audit client: protocol no…

---

## [No kibana-oss image available for 6.6.1 version](https://discuss.elastic.co/t/no-kibana-oss-image-available-for-6-6-1-version/239014)

<div class="topic-metadata">

**Author:** [@chinmoy\_padhi](https://discuss.elastic.co/u/chinmoy_padhi)\
**Replies:** 1\
**Last updated:** [June 29, 2020, 9:17pm UTC](https://discuss.elastic.co/t/no-kibana-oss-image-available-for-6-6-1-version/239014 "2020-06-29T21:17:52Z")

</div>

Currently on production we are running kibana-oss:6.2.2 when we run the security scan we found some vulnerabilities related to cross-site-scripting,timelion visualizer,security audit logger and such issues are mentioned …

---

## [How can I do a “match\_phrase” that ranks solely on “does the phrase exists”?](https://discuss.elastic.co/t/how-can-i-do-a-match-phrase-that-ranks-solely-on-does-the-phrase-exists/238976)

<div class="topic-metadata">

**Author:** [@chrislentz](https://discuss.elastic.co/u/chrislentz)\
**Replies:** 1\
**Last updated:** [June 29, 2020, 8:57pm UTC](https://discuss.elastic.co/t/how-can-i-do-a-match-phrase-that-ranks-solely-on-does-the-phrase-exists/238976 "2020-06-29T20:57:35Z")

</div>

Is there a way to make “match\_phrase” only look for a match, but not take other things into account, like the match in relation to other terms in the text field? i.e. If I search "star wars", "Star Wars: Revelations" re…

---

## [Auditbeat reliance on auditd](https://discuss.elastic.co/t/auditbeat-reliance-on-auditd/239193)

<div class="topic-metadata">

**Author:** [@perfecto25](https://discuss.elastic.co/u/perfecto25)\
**Replies:** 0\
**Last updated:** [June 29, 2020, 8:49pm UTC](https://discuss.elastic.co/t/auditbeat-reliance-on-auditd/239193 "2020-06-29T20:49:22Z")

</div>

Hello, question, on my Centos7 servers, if I install auditbeat, do I need to have auditd process running or is auditbeat able to pick up all audit events by itself? Should I run both auditd and auditbeat services, or o…

---

## [Use Bind-Mounted Setting for Local Config File?](https://discuss.elastic.co/t/use-bind-mounted-setting-for-local-config-file/238500)

<div class="topic-metadata">

**Author:** [@redapplesonly](https://discuss.elastic.co/u/redapplesonly)\
**Replies:** 5\
**Last updated:** [June 29, 2020, 8:27pm UTC](https://discuss.elastic.co/t/use-bind-mounted-setting-for-local-config-file/238500 "2020-06-29T20:27:31Z")

</div>

Hello Logstash Wizards, I’m struggling to understand how I can spin up a Logstash Docker container using bind-mounted settings (see here) to run the container with a config file on the local host. To explain: Let’s say…

---

## [Parsing filter for nested json](https://discuss.elastic.co/t/parsing-filter-for-nested-json/239180)

<div class="topic-metadata">

**Author:** [@korrmal](https://discuss.elastic.co/u/korrmal)\
**Replies:** 1\
**Last updated:** [June 29, 2020, 8:26pm UTC](https://discuss.elastic.co/t/parsing-filter-for-nested-json/239180 "2020-06-29T20:26:52Z")

</div>

Hi. I have input string {'message': 'send data to', 'payload': {'params': {'cardNo': '77'}}, 'remote-url': 'https://api.com/status', 'cookie': {}, 'headers': {'User-Agent': 'req', 'Accept-Encoding': 'gzip, deflate', 'A…

---

## [Add Nested Field Value to a new field using Logstash Filter](https://discuss.elastic.co/t/add-nested-field-value-to-a-new-field-using-logstash-filter/239151)

<div class="topic-metadata">

**Author:** [@Kevin\_f](https://discuss.elastic.co/u/Kevin_f)\
**Replies:** 6\
**Last updated:** [June 29, 2020, 8:26pm UTC](https://discuss.elastic.co/t/add-nested-field-value-to-a-new-field-using-logstash-filter/239151 "2020-06-29T20:26:14Z")

</div>

Hello All, I hope someone here could help me as I have been stuck for days on this issue I am facing. I have got the kibana output as shown below: I am trying to add the nested field value of "key" into a new field c…

---

## [Transform kills the whole cluster](https://discuss.elastic.co/t/transform-kills-the-whole-cluster/237294)

<div class="topic-metadata">

**Author:** [@liorg2](https://discuss.elastic.co/u/liorg2)\
**Replies:** 3\
**Last updated:** [June 29, 2020, 8:25pm UTC](https://discuss.elastic.co/t/transform-kills-the-whole-cluster/237294 "2020-06-29T20:25:12Z")

</div>

Hi I'm using elastic cloud (cloud.elastic.co) I'm not sure if that's the correct category, but I want to run a transform for the past 6 month, and it's killing the cpu. the whole cluster becomes unresponsive (queries, k…

---

## [Error client.addTransportAddress(new TransportAddress(InetAddress.getByName("localhost"), 9300));](https://discuss.elastic.co/t/error-client-addtransportaddress-new-transportaddress-inetaddress-getbyname-localhost-9300/239098)

<div class="topic-metadata">

**Author:** [@Najib\_Ghlissi](https://discuss.elastic.co/u/Najib_Ghlissi)\
**Replies:** 1\
**Last updated:** [June 29, 2020, 7:52pm UTC](https://discuss.elastic.co/t/error-client-addtransportaddress-new-transportaddress-inetaddress-getbyname-localhost-9300/239098 "2020-06-29T19:52:24Z")

</div>

hi All developers i have i error in my projetct Exception in thread "main" NoNodeAvailableException\[None of the configured nodes are available: \[{#transport#-1}{zSavWRA4QBGzdYdox-h2Aw}{localhost}{127.0.0.1:9300}\]\] att …

---

## [Can not start Kibana if the default port for elasticsearch is changed](https://discuss.elastic.co/t/can-not-start-kibana-if-the-default-port-for-elasticsearch-is-changed/238697)

<div class="topic-metadata">

**Author:** [@ashrafuzzaman](https://discuss.elastic.co/u/ashrafuzzaman)\
**Replies:** 1\
**Last updated:** [June 29, 2020, 7:49pm UTC](https://discuss.elastic.co/t/can-not-start-kibana-if-the-default-port-for-elasticsearch-is-changed/238697 "2020-06-29T19:49:06Z")

</div>

I am using the composer shared here. The composer works until I change the default port of elasticsearch to something else and updating the port reference. Here is my compose file, version: '2.2' services: apm-serve…

---

## [Transforms cannot group by boolean](https://discuss.elastic.co/t/transforms-cannot-group-by-boolean/238752)

<div class="topic-metadata">

**Author:** [@Xavier\_Marti\_Bofill](https://discuss.elastic.co/u/Xavier_Marti_Bofill)\
**Replies:** 1\
**Last updated:** [June 29, 2020, 7:46pm UTC](https://discuss.elastic.co/t/transforms-cannot-group-by-boolean/238752 "2020-06-29T19:46:28Z")

</div>

When I try to add a boolean field into the group\_by list of a transform, preview returns me an error: "type" : "illegal\_argument\_exception", "reason" : "Value of type \[class java.lang.Boolean\] is not supported" Am I u…

---

## [How to create a default index pattern via kibana api](https://discuss.elastic.co/t/how-to-create-a-default-index-pattern-via-kibana-api/238905)

<div class="topic-metadata">

**Author:** [@damasu](https://discuss.elastic.co/u/damasu)\
**Replies:** 2\
**Last updated:** [June 29, 2020, 7:19pm UTC](https://discuss.elastic.co/t/how-to-create-a-default-index-pattern-via-kibana-api/238905 "2020-06-29T19:19:10Z")

</div>

Using the experimental Kibana 7.8 API, how can i create a DEFAULT index pattern. I am calling the api as such: http://kibana:5601/s/\<some space\>/api/saved\_objects/index-pattern/dummy\_index\_pattern { "attributes": { …

---

## [Weird field names with Transforms](https://discuss.elastic.co/t/weird-field-names-with-transforms/238597)

<div class="topic-metadata">

**Author:** [@mykael](https://discuss.elastic.co/u/mykael)\
**Replies:** 3\
**Last updated:** [June 29, 2020, 7:34pm UTC](https://discuss.elastic.co/t/weird-field-names-with-transforms/238597 "2020-06-29T19:34:07Z")

</div>

I used a text field to group my data - STATE, although the input to the grouping was STATE.keyword. Then I defined a second level transfrom that took my hourly data and rolled it up to daily data, also grouping it by st…

---

## [Ask for advice on elastic search client](https://discuss.elastic.co/t/ask-for-advice-on-elastic-search-client/239178)

<div class="topic-metadata">

**Author:** [@kendraschwartz](https://discuss.elastic.co/u/kendraschwartz)\
**Replies:** 0\
**Last updated:** [June 29, 2020, 7:33pm UTC](https://discuss.elastic.co/t/ask-for-advice-on-elastic-search-client/239178 "2020-06-29T19:33:19Z")

</div>

Hello, I want to be able to pass in "server\_hostname" to the elastic search python client. Because I would like to give an IP address and still have the SSL work. Do you have any suggestions?

---

## [Continuous Transform Timestamp isn't a timestamp](https://discuss.elastic.co/t/continuous-transform-timestamp-isnt-a-timestamp/238594)

<div class="topic-metadata">

**Author:** [@mykael](https://discuss.elastic.co/u/mykael)\
**Replies:** 3\
**Last updated:** [June 29, 2020, 7:10pm UTC](https://discuss.elastic.co/t/continuous-transform-timestamp-isnt-a-timestamp/238594 "2020-06-29T19:10:00Z")

</div>

Set up a continuous transform, grouping by a time historgram driven from the @timestamp field. The transform contains an @timestamp value, but it's classified as a number rather than as a date (according to Kibana when …

---

## [Segments with 60-70% deleted docs (5G) never remove deleted docs](https://discuss.elastic.co/t/segments-with-60-70-deleted-docs-5g-never-remove-deleted-docs/238342)

<div class="topic-metadata">

**Author:** [@zenloop](https://discuss.elastic.co/u/zenloop)\
**Replies:** 2\
**Last updated:** [June 29, 2020, 6:39pm UTC](https://discuss.elastic.co/t/segments-with-60-70-deleted-docs-5g-never-remove-deleted-docs/238342 "2020-06-29T18:39:36Z")

</div>

Will a 5g segment ever be selected for merging? We have 5g segments with up to 60-70% deleted docs. We have been monitoring and the segments never appear to be selected for merge.

---

## [Metrics from structured logfile](https://discuss.elastic.co/t/metrics-from-structured-logfile/239167)

<div class="topic-metadata">

**Author:** [@Marcel27](https://discuss.elastic.co/u/Marcel27)\
**Replies:** 0\
**Last updated:** [June 29, 2020, 6:19pm UTC](https://discuss.elastic.co/t/metrics-from-structured-logfile/239167 "2020-06-29T18:19:46Z")

</div>

I have an application which logs periodicly to a file like: {"field1": 21, "field2": 45, "utctime": "2020-06-26 13:48:36,", "event": "test1"} {"field1": 62, "field2": 15, "utctime": "2020-06-26 13:53:36,", "event": "tes…

---

## [Different fields in different documents](https://discuss.elastic.co/t/different-fields-in-different-documents/238139)

<div class="topic-metadata">

**Author:** [@Anton91](https://discuss.elastic.co/u/Anton91)\
**Replies:** 3\
**Last updated:** [June 23, 2020, 7:05pm UTC](https://discuss.elastic.co/t/different-fields-in-different-documents/238139 "2020-06-23T19:05:37Z")

</div>

Hey, I have the following question and I want to visualize two fields with each other that are not connected to each other. Both are stored in different documents but in the same index. For example I have document A:…

---

## [I have deleted Elastic searcg logs files and now logs are not coming up](https://discuss.elastic.co/t/i-have-deleted-elastic-searcg-logs-files-and-now-logs-are-not-coming-up/239148)

<div class="topic-metadata">

**Author:** [@Ali\_Nouman](https://discuss.elastic.co/u/Ali_Nouman)\
**Replies:** 1\
**Last updated:** [June 29, 2020, 4:46pm UTC](https://discuss.elastic.co/t/i-have-deleted-elastic-searcg-logs-files-and-now-logs-are-not-coming-up/239148 "2020-06-29T16:46:20Z")

</div>

Hi Guys, Using ubutnu 16.04,elastic search 6 and inside the /var/log/elasticsearch, I have run sudo rm \* to clean all the old log files. it's not writing new logs file anymore. It will be great if somebody can give me i…

---

## [Elasticsearch has deleted all my visualizations and indexes](https://discuss.elastic.co/t/elasticsearch-has-deleted-all-my-visualizations-and-indexes/239157)

<div class="topic-metadata">

**Author:** [@Anton91](https://discuss.elastic.co/u/Anton91)\
**Replies:** 1\
**Last updated:** [June 29, 2020, 4:41pm UTC](https://discuss.elastic.co/t/elasticsearch-has-deleted-all-my-visualizations-and-indexes/239157 "2020-06-29T16:41:36Z")

</div>

Hello, today I wanted to continue working on my visualizations and already at the registration I was shown That I cannot select a Space. Then I restarted my machine and thought nothing else. Afterwards I could log in ag…

---

## [Value in Table and JSON are different](https://discuss.elastic.co/t/value-in-table-and-json-are-different/239135)

<div class="topic-metadata">

**Author:** [@ranju](https://discuss.elastic.co/u/ranju)\
**Replies:** 2\
**Last updated:** [June 29, 2020, 4:30pm UTC](https://discuss.elastic.co/t/value-in-table-and-json-are-different/239135 "2020-06-29T16:30:19Z")

</div>

Facing This Issue in JSON the value "test": { "test\_id": "1111111111111180522" }, in Kibana table showing as: 1111111111111180526

---

## [Can not add a new field using if filter and add\_field](https://discuss.elastic.co/t/can-not-add-a-new-field-using-if-filter-and-add-field/239127)

<div class="topic-metadata">

**Author:** [@brapnda23](https://discuss.elastic.co/u/brapnda23)\
**Replies:** 5\
**Last updated:** [June 29, 2020, 4:24pm UTC](https://discuss.elastic.co/t/can-not-add-a-new-field-using-if-filter-and-add-field/239127 "2020-06-29T16:24:04Z")

</div>

Newbie here. Trying to add another field but not working. I have added below set of codes to a .conf file under /etc/conf.d. Logs for logstash not showing any error. Am I doing something wrong here? Using the new 7.8 v…

[Previous page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1962)

[Next page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1964)
