# Latest

**URL:** https://discuss.elastic.co/latest.md?page=1313

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1314

---

## [Metricbeat cpu](https://discuss.elastic.co/t/metricbeat-cpu/294052)

<div class="topic-metadata">

**Author:** [@joaosf](https://discuss.elastic.co/u/joaosf)\
**Replies:** 0\
**Last updated:** [January 11, 2022, 3:11pm UTC](https://discuss.elastic.co/t/metricbeat-cpu/294052 "2022-01-11T15:11:33Z")

</div>

help, Is there any explication for this kind of values? system.cpu.system.norm.pct=111,851,835.7% metricbeat 7.14

---

## [Importing file to an existing index](https://discuss.elastic.co/t/importing-file-to-an-existing-index/293932)

<div class="topic-metadata">

**Author:** [@kibanauser4](https://discuss.elastic.co/u/kibanauser4)\
**Replies:** 4\
**Last updated:** [January 11, 2022, 3:11pm UTC](https://discuss.elastic.co/t/importing-file-to-an-existing-index/293932 "2022-01-11T15:11:09Z")

</div>

I wanted to update my index by importing a file via Logstash. I used the same logstash file (the input file was updated with new records) cause I thought it's gonna overwrite the existing index. I tested this on a differ…

---

## [Json nested field](https://discuss.elastic.co/t/json-nested-field/293925)

<div class="topic-metadata">

**Author:** [@kvmuralidhar](https://discuss.elastic.co/u/kvmuralidhar)\
**Replies:** 2\
**Last updated:** [January 11, 2022, 3:02pm UTC](https://discuss.elastic.co/t/json-nested-field/293925 "2022-01-11T15:02:30Z")

</div>

Hi All, I have a field with value as a json object as follows messageParts="\[{\\"disposition\\":\\"inline\\",\\"sha256\\":\\"f3c958fe6406140b13360a42b3237477dc5bc525f3858f64cca45bf2d02fc771\\",\\"md5\\":\\"c87f14af3c845fc6d8b84b1…

---

## [Can i install two heartbeat on two servers and connet them to only one elasticsearh and kibana](https://discuss.elastic.co/t/can-i-install-two-heartbeat-on-two-servers-and-connet-them-to-only-one-elasticsearh-and-kibana/293819)

<div class="topic-metadata">

**Author:** [@amr\_ibrahim](https://discuss.elastic.co/u/amr_ibrahim)\
**Replies:** 2\
**Last updated:** [January 11, 2022, 2:57pm UTC](https://discuss.elastic.co/t/can-i-install-two-heartbeat-on-two-servers-and-connet-them-to-only-one-elasticsearh-and-kibana/293819 "2022-01-11T14:57:03Z")

</div>

Hello, i have old heartbeat connect with Elasticsearch and kibana and i want to create another heartbeat and connect it to same uptime is this possbile and how can we configure index and differentiate between them Than…

---

## [Canvas data table top hit metric](https://discuss.elastic.co/t/canvas-data-table-top-hit-metric/293995)

<div class="topic-metadata">

**Author:** [@hNiven](https://discuss.elastic.co/u/hNiven)\
**Replies:** 3\
**Last updated:** [January 11, 2022, 2:46pm UTC](https://discuss.elastic.co/t/canvas-data-table-top-hit-metric/293995 "2022-01-11T14:46:25Z")

</div>

Hi, I am creating a data table in canvas and was wondering if it is possible to do something similar to the 'top hit' metric you can do in the visualization, but in the canvas data table? For example I have a field cal…

---

## [Fortigate Firewall Logs to Elasticsearch](https://discuss.elastic.co/t/fortigate-firewall-logs-to-elasticsearch/294041)

<div class="topic-metadata">

**Author:** [@yogicd](https://discuss.elastic.co/u/yogicd)\
**Replies:** 2\
**Last updated:** [January 11, 2022, 2:42pm UTC](https://discuss.elastic.co/t/fortigate-firewall-logs-to-elasticsearch/294041 "2022-01-11T14:42:53Z")

</div>

Hi Team, I am trying to get the Fortigate firewall logs to elasticsearch via logstash but not able to get the data to elasticsearch, But i can see the data coming via tcpdump udp port 514. and my logstash config as…

---

## [Update to latest version compatibility](https://discuss.elastic.co/t/update-to-latest-version-compatibility/294031)

<div class="topic-metadata">

**Author:** [@FleaLes](https://discuss.elastic.co/u/FleaLes)\
**Replies:** 4\
**Last updated:** [January 11, 2022, 2:36pm UTC](https://discuss.elastic.co/t/update-to-latest-version-compatibility/294031 "2022-01-11T14:36:38Z")

</div>

Hi. I've inherited an ELK setup as follows: Elasticsearch / Logstash / Kibana / Filebeat: version 6.3.0 Curator: version 5.5.4 Docker Composer: version 3 HAProxy: version 1.8.12 I'm planning to upgrade the whole stac…

---

## [Problems deploying to azure](https://discuss.elastic.co/t/problems-deploying-to-azure/293954)

<div class="topic-metadata">

**Author:** [@Jorgenv](https://discuss.elastic.co/u/Jorgenv)\
**Replies:** 2\
**Last updated:** [January 11, 2022, 2:33pm UTC](https://discuss.elastic.co/t/problems-deploying-to-azure/293954 "2022-01-11T14:33:00Z")

</div>

I'm trying to deploy a test environment on azure and I'm running into all kinds of problems. I first had issues passing self-signed certificates for the application gateway and kibana, but I found some hacky way around t…

---

## [Logstash Input adds data stamp and host](https://discuss.elastic.co/t/logstash-input-adds-data-stamp-and-host/294021)

<div class="topic-metadata">

**Author:** [@pruttle](https://discuss.elastic.co/u/pruttle)\
**Replies:** 7\
**Last updated:** [January 11, 2022, 2:23pm UTC](https://discuss.elastic.co/t/logstash-input-adds-data-stamp-and-host/294021 "2022-01-11T14:23:17Z")

</div>

I am using Logstash to receive data from a syslog server and push it into different Kafka topics. Logstash appears to add a data/time stamp and hostname at that start of the raw event. Is there a way stop this happening?…

---

## [Metricbeat collecting mongo-metrics is not updated to elasticsearch](https://discuss.elastic.co/t/metricbeat-collecting-mongo-metrics-is-not-updated-to-elasticsearch/293922)

<div class="topic-metadata">

**Author:** [@smileyvignesh](https://discuss.elastic.co/u/smileyvignesh)\
**Replies:** 2\
**Last updated:** [January 11, 2022, 1:58pm UTC](https://discuss.elastic.co/t/metricbeat-collecting-mongo-metrics-is-not-updated-to-elasticsearch/293922 "2022-01-11T13:58:25Z")

</div>

Hello everyone, I'm using the metricbeat to get mongodb metics ("dbstats", "status", "collstats", "metrics") and update it to Elasticsearch via logstash. There is no error seen in the logstash logs or metric beat logs. T…

---

## [IBM HTTP Server](https://discuss.elastic.co/t/ibm-http-server/293862)

<div class="topic-metadata">

**Author:** [@rodri.gz](https://discuss.elastic.co/u/rodri.gz)\
**Replies:** 6\
**Last updated:** [January 11, 2022, 1:57pm UTC](https://discuss.elastic.co/t/ibm-http-server/293862 "2022-01-11T13:57:56Z")

</div>

Hello ! Does ELK have modules to monitor with metricbeat and obtain logs previously parsed with filebeat from IBM HTTP servers? Thanks in advanced!

---

## [Elasticsearch 7.16 failed install on Unbuntu 20.04 - cannot execute binary file](https://discuss.elastic.co/t/elasticsearch-7-16-failed-install-on-unbuntu-20-04-cannot-execute-binary-file/293777)

<div class="topic-metadata">

**Author:** [@Winston\_Ferguson](https://discuss.elastic.co/u/Winston_Ferguson)\
**Replies:** 3\
**Last updated:** [January 11, 2022, 1:54pm UTC](https://discuss.elastic.co/t/elasticsearch-7-16-failed-install-on-unbuntu-20-04-cannot-execute-binary-file/293777 "2022-01-11T13:54:49Z")

</div>

Hi, I'm unable to solve my issue installing Elasticsearch on my new Windows 11 machine running Ubuntu 20.04 (via Windows Subsystem for Linux). The log received is: Reading package lists... Done Building dependency tree…

---

## [Parsing log date into timestamp](https://discuss.elastic.co/t/parsing-log-date-into-timestamp/293966)

<div class="topic-metadata">

**Author:** [@phung025](https://discuss.elastic.co/u/phung025)\
**Replies:** 1\
**Last updated:** [January 11, 2022, 1:31pm UTC](https://discuss.elastic.co/t/parsing-log-date-into-timestamp/293966 "2022-01-11T13:31:07Z")

</div>

In the JSON-format logs sent from filebeat to logstash, I have a field named "time". In the logstash.conf, I mutate it to create a field in the kibana log called rawDate logstash.conf: mutate { add\_field =\> {"rawDa…

---

## [Question about data types and adding new data types](https://discuss.elastic.co/t/question-about-data-types-and-adding-new-data-types/293928)

<div class="topic-metadata">

**Author:** [@Miguel\_Lopez1](https://discuss.elastic.co/u/Miguel_Lopez1)\
**Replies:** 3\
**Last updated:** [January 11, 2022, 12:08pm UTC](https://discuss.elastic.co/t/question-about-data-types-and-adding-new-data-types/293928 "2022-01-11T12:08:31Z")

</div>

Hi, As part of a masters degree assignment I need to address some questions about the Elasticsearch to the developers. The question is: I saw that Elasticsearch is capable of working with a variety of data types (for i…

---

## [How to parse suricata rules with logstash](https://discuss.elastic.co/t/how-to-parse-suricata-rules-with-logstash/292548)

<div class="topic-metadata">

**Author:** [@karpaz](https://discuss.elastic.co/u/karpaz)\
**Replies:** 7\
**Last updated:** [January 11, 2022, 11:58am UTC](https://discuss.elastic.co/t/how-to-parse-suricata-rules-with-logstash/292548 "2022-01-11T11:58:54Z")

</div>

Hi, guys, I've been solving a "parsing" problem for a while now. First I tried it with GROK, then with KV filter. I have not been successful with either method. So I am turning to you for help to see if anyone experien…

---

## [Add link on row table to external application](https://discuss.elastic.co/t/add-link-on-row-table-to-external-application/293996)

<div class="topic-metadata">

**Author:** [@karatsuba](https://discuss.elastic.co/u/karatsuba)\
**Replies:** 2\
**Last updated:** [January 11, 2022, 11:17am UTC](https://discuss.elastic.co/t/add-link-on-row-table-to-external-application/293996 "2022-01-11T11:17:35Z")

</div>

Hello, I am trying to display my string field in a row table as a link to external application, i am using URL format for string in index patterns, but when I click on the link "myLink" it's opening it in new window and…

---

## [Unable to access kibana after upgrade 7.13.2 -\> 7.16.2](https://discuss.elastic.co/t/unable-to-access-kibana-after-upgrade-7-13-2-7-16-2/294011)

<div class="topic-metadata">

**Author:** [@mihalikv](https://discuss.elastic.co/u/mihalikv)\
**Replies:** 1\
**Last updated:** [January 11, 2022, 10:56am UTC](https://discuss.elastic.co/t/unable-to-access-kibana-after-upgrade-7-13-2-7-16-2/294011 "2022-01-11T10:56:51Z")

</div>

Hello, I have upgraded kibana from 7.13.2 to 7.16.2. No plugins installed. Environment: Error: There was an error in logs: {"type":"log","@timestamp":"2022-01-11T09:22:44+00:00","tags":\["error","plugins","ev…

---

## [Using S3 as storage for elasticsearch](https://discuss.elastic.co/t/using-s3-as-storage-for-elasticsearch/294007)

<div class="topic-metadata">

**Author:** [@Yang\_Yang2](https://discuss.elastic.co/u/Yang_Yang2)\
**Replies:** 1\
**Last updated:** [January 11, 2022, 10:35am UTC](https://discuss.elastic.co/t/using-s3-as-storage-for-elasticsearch/294007 "2022-01-11T10:35:26Z")

</div>

Is it possible to use the S3 as a data storage for Elasticsearch?

---

## [Deprecation logs not being logged to file in Elasticsearch 7.15](https://discuss.elastic.co/t/deprecation-logs-not-being-logged-to-file-in-elasticsearch-7-15/294016)

<div class="topic-metadata">

**Author:** [@Suraj\_Kumar4](https://discuss.elastic.co/u/Suraj_Kumar4)\
**Replies:** 0\
**Last updated:** [January 11, 2022, 10:18am UTC](https://discuss.elastic.co/t/deprecation-logs-not-being-logged-to-file-in-elasticsearch-7-15/294016 "2022-01-11T10:18:24Z")

</div>

Snippet of the log4j2.properties file being used with ES 7.15.2 status = error appender.console.type = Console appender.console.name = console appender.console.layout.type = PatternLayout appender.console.layout.patter…

---

## [Specify Mappings while creating index using python client](https://discuss.elastic.co/t/specify-mappings-while-creating-index-using-python-client/292433)

<div class="topic-metadata">

**Author:** [@sunny3794.ad](https://discuss.elastic.co/u/sunny3794.ad)\
**Replies:** 3\
**Last updated:** [January 11, 2022, 10:18am UTC](https://discuss.elastic.co/t/specify-mappings-while-creating-index-using-python-client/292433 "2022-01-11T10:18:09Z")

</div>

As far as I know, Elasticsearch by default takes in data and stores it as string (except for date). So, I have been using the body parameter in the create function of the Elasticsearch python client to specify the field …

---

## [Logstasch pipeline filter](https://discuss.elastic.co/t/logstasch-pipeline-filter/294009)

<div class="topic-metadata">

**Author:** [@max\_cyril](https://discuss.elastic.co/u/max_cyril)\
**Replies:** 1\
**Last updated:** [January 11, 2022, 10:13am UTC](https://discuss.elastic.co/t/logstasch-pipeline-filter/294009 "2022-01-11T10:13:14Z")

</div>

Hi, I am new to ELK and struggling to write my first logstash pipeline. Can anyone help me to write the filter section? Thanks in advance. i want to filter and only output the maximum of completion per users fo…

---

## [Max score multi match query](https://discuss.elastic.co/t/max-score-multi-match-query/294014)

<div class="topic-metadata">

**Author:** [@Divy\_Garg](https://discuss.elastic.co/u/Divy_Garg)\
**Replies:** 0\
**Last updated:** [January 11, 2022, 10:08am UTC](https://discuss.elastic.co/t/max-score-multi-match-query/294014 "2022-01-11T10:08:16Z")

</div>

Hi, I am using multi match query of Elasticsearch. Need to understand what is the maximum \_score that multi match query can have. Please help with this. { "query": { "multi\_match" : { "query": "john wi…

---

## [Elastic service stopped automatically](https://discuss.elastic.co/t/elastic-service-stopped-automatically/293252)

<div class="topic-metadata">

**Author:** [@sandesh0209](https://discuss.elastic.co/u/sandesh0209)\
**Replies:** 4\
**Last updated:** [January 11, 2022, 9:57am UTC](https://discuss.elastic.co/t/elastic-service-stopped-automatically/293252 "2022-01-11T09:57:58Z")

</div>

Faulting application name: Elasticsearch.exe, version: 7.10.1.0, time stamp: 0x5fcb0351 Faulting module name: KERNELBASE.dll, version: 10.0.14393.4770, time stamp: 0x6180883c Exception code: 0xe0434352 Fault offset: 0…

---

## [Filebeat not picking up log files](https://discuss.elastic.co/t/filebeat-not-picking-up-log-files/293910)

<div class="topic-metadata">

**Author:** [@aamir\_mustafa](https://discuss.elastic.co/u/aamir_mustafa)\
**Replies:** 3\
**Last updated:** [January 11, 2022, 9:30am UTC](https://discuss.elastic.co/t/filebeat-not-picking-up-log-files/293910 "2022-01-11T09:30:49Z")

</div>

Hello Team, I'm using Filebeat 7.10.2 to ship logs directly to Elasticsearch. But I'm facing an issue while giving input to filebeat. Filebeat only picks up one log file even when I'm specifying to read all files from i…

---

## [How to loop through array in Logstash?](https://discuss.elastic.co/t/how-to-loop-through-array-in-logstash/291747)

<div class="topic-metadata">

**Author:** [@rijo\_joseph](https://discuss.elastic.co/u/rijo_joseph)\
**Replies:** 4\
**Last updated:** [January 11, 2022, 9:15am UTC](https://discuss.elastic.co/t/how-to-loop-through-array-in-logstash/291747 "2022-01-11T09:15:10Z")

</div>

{ "modifiedTime": "2021-12-13T06:47:11.138Z", "task\_owner\_name": null, "contents": \[ { "eligible": false, "rawResponse": "454536251", "id": 868286622 }, { "eligible": false, …

---

## [Delete index pattern](https://discuss.elastic.co/t/delete-index-pattern/293987)

<div class="topic-metadata">

**Author:** [@sunny3794.ad](https://discuss.elastic.co/u/sunny3794.ad)\
**Replies:** 2\
**Last updated:** [January 11, 2022, 8:57am UTC](https://discuss.elastic.co/t/delete-index-pattern/293987 "2022-01-11T08:57:33Z")

</div>

I am trying to automate the deletion of index patterns whenever the index is deleted. For this I am using the requests module in Python to send the delete request to the Kibana API enpoint. However, the request fails whe…

---

## [Can't start logstash after installtion because java](https://discuss.elastic.co/t/cant-start-logstash-after-installtion-because-java/293993)

<div class="topic-metadata">

**Author:** [@aviad.co1](https://discuss.elastic.co/u/aviad.co1)\
**Replies:** 0\
**Last updated:** [January 11, 2022, 8:49am UTC](https://discuss.elastic.co/t/cant-start-logstash-after-installtion-because-java/293993 "2022-01-11T08:49:51Z")

</div>

I install this java version - java -version : openjdk version "11.0.13" 2021-10-19. OpenJDK Runtime Environment (build 11.0.13+8-Ubuntu-0ubuntu1.20.04). OpenJDK 64-Bit Server VM (build 11.0.13+8-Ubuntu-0ubuntu1.20.04…

---

## [12K fields in the mapping](https://discuss.elastic.co/t/12k-fields-in-the-mapping/293340)

<div class="topic-metadata">

**Author:** [@orips](https://discuss.elastic.co/u/orips)\
**Replies:** 6\
**Last updated:** [January 11, 2022, 8:35am UTC](https://discuss.elastic.co/t/12k-fields-in-the-mapping/293340 "2022-01-11T08:35:28Z")

</div>

Hi, We're approaching 12K fields in our mapping. Our cluster does not have many documents (it's about 1 billion, and it's doc one per user, so it's not growing very rapidly). I'd like to know: how much further can we g…

---

## [Auto Deletion of Old index](https://discuss.elastic.co/t/auto-deletion-of-old-index/293978)

<div class="topic-metadata">

**Author:** [@triptesh1212](https://discuss.elastic.co/u/triptesh1212)\
**Replies:** 1\
**Last updated:** [January 11, 2022, 8:17am UTC](https://discuss.elastic.co/t/auto-deletion-of-old-index/293978 "2022-01-11T08:17:42Z")

</div>

Hi community, I am exploring the index lifecycle policy and auto deletion of an index. I have gone through the following link. I have understood that we can create index template with policy where we can setup paramete…

---

## [How to implement ElastiFlow on CentOS 7](https://discuss.elastic.co/t/how-to-implement-elastiflow-on-centos-7/293982)

<div class="topic-metadata">

**Author:** [@jeffrey0329](https://discuss.elastic.co/u/jeffrey0329)\
**Replies:** 0\
**Last updated:** [January 11, 2022, 7:42am UTC](https://discuss.elastic.co/t/how-to-implement-elastiflow-on-centos-7/293982 "2022-01-11T07:42:16Z")

</div>

I'm new to using ElasticStack, and I'm trying to use ElastiFlow on CentOS7. I've looked into the ElastiFlow official website, but they don't specify support and install guideline on CentOS. Can someone advise or guide me…

[Previous page](https://discuss.elastic.co/latest.md?page=1312)

[Next page](https://discuss.elastic.co/latest.md?page=1314)
