# \#ecs-elastic-common-schema

**URL:** https://discuss.elastic.co/tag/ecs-elastic-common-schema/26.md?page=3

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 4

---

## [Filebeat, ECS and fieds.\* namespace](https://discuss.elastic.co/t/filebeat-ecs-and-fieds-namespace/255062)

<div class="topic-metadata">

**Author:** [@A\_B](https://discuss.elastic.co/u/A_B)\
**Replies:** 2\
**Last updated:** [December 3, 2020, 12:05pm UTC](https://discuss.elastic.co/t/filebeat-ecs-and-fieds-namespace/255062 "2020-12-03T12:05:36Z")

</div>

Hello all, I'm looking for some suggestions for the following situation. Some context I'm trying to convince our developers to adopt ECS as their log format for container logs. We run our containers in Kubernetes and…

---

## [ECS mappings for asset tracking and port scanning output](https://discuss.elastic.co/t/ecs-mappings-for-asset-tracking-and-port-scanning-output/256162)

<div class="topic-metadata">

**Author:** [@imperial.slipper](https://discuss.elastic.co/u/imperial.slipper)\
**Replies:** 1\
**Last updated:** [November 23, 2020, 2:45pm UTC](https://discuss.elastic.co/t/ecs-mappings-for-asset-tracking-and-port-scanning-output/256162 "2020-11-23T14:45:15Z")

</div>

Hey chaps, I'm currently working on an application that will generate asset tracking and scanning data, and one of the outputs I'm building will use the ECS standard where possible. There are broadly two kind of events…

---

## [Logstash/grok patterns with ECS](https://discuss.elastic.co/t/logstash-grok-patterns-with-ecs/197871)

<div class="topic-metadata">

**Author:** [@prophoto](https://discuss.elastic.co/u/prophoto)\
**Replies:** 11\
**Last updated:** [November 10, 2020, 6:33pm UTC](https://discuss.elastic.co/t/logstash-grok-patterns-with-ecs/197871 "2020-11-10T18:33:10Z")

</div>

For a couple weeks I've been attempting to migrate my logs to ECS. I have a running ELK 6.x cluster and it works fine, but my new cluster I want to see if I can get ECS running. I am starting from scratch so old logs don…

---

## [When ECSLayout is default for Elasticsearch and Kibana log configuration?](https://discuss.elastic.co/t/when-ecslayout-is-default-for-elasticsearch-and-kibana-log-configuration/254710)

<div class="topic-metadata">

**Author:** [@Bingu\_Shim](https://discuss.elastic.co/u/Bingu_Shim)\
**Replies:** 0\
**Last updated:** [November 9, 2020, 6:40am UTC](https://discuss.elastic.co/t/when-ecslayout-is-default-for-elasticsearch-and-kibana-log-configuration/254710 "2020-11-09T06:40:05Z")

</div>

Hi, I'm trying to change the log format of Elasticsearch and Kibana to ECS format The Current Document guided using ESJsonLayout, which is different fro ECS format. As far as I know ECS is the standard format for Elas…

---

## [ECS field for application data and payloads](https://discuss.elastic.co/t/ecs-field-for-application-data-and-payloads/254131)

<div class="topic-metadata">

**Author:** [@strokirk](https://discuss.elastic.co/u/strokirk)\
**Replies:** 3\
**Last updated:** [November 4, 2020, 5:04pm UTC](https://discuss.elastic.co/t/ecs-field-for-application-data-and-payloads/254131 "2020-11-04T17:04:47Z")

</div>

Hi, I'd like to hear if there are any suggestions in the ECS framework on how to provide app-specific fields. Do you use your own namespace for that, or just put it in the global namespace? Any recommendations for field…

---

## [Custom access\_log and ECS](https://discuss.elastic.co/t/custom-access-log-and-ecs/253148)

<div class="topic-metadata">

**Author:** [@rmrfchik](https://discuss.elastic.co/u/rmrfchik)\
**Replies:** 2\
**Last updated:** [October 26, 2020, 1:33pm UTC](https://discuss.elastic.co/t/custom-access-log-and-ecs/253148 "2020-10-26T13:33:12Z")

</div>

I have custom access\_log and want to use power of ECS. So, filebeat simply chew log file (type: log) and forward lines to logstash. Logstash groks line and fills "user\_agent.original" field. So far so good. I made sim…

---

## [Parse log using logstash and make ecs format](https://discuss.elastic.co/t/parse-log-using-logstash-and-make-ecs-format/251980)

<div class="topic-metadata">

**Author:** [@111387](https://discuss.elastic.co/u/111387)\
**Replies:** 4\
**Last updated:** [October 15, 2020, 6:36pm UTC](https://discuss.elastic.co/t/parse-log-using-logstash-and-make-ecs-format/251980 "2020-10-15T18:36:37Z")

</div>

i Receiving WAF(Web Application FireWall) log, Network Scan Result log file(xml) And try to send this log to ElasticSearch using logstash i want to parse this log according to ECS Format. but, "https://github.com/elas…

---

## [Winlogbeat Sysmon Registry events missing event.category](https://discuss.elastic.co/t/winlogbeat-sysmon-registry-events-missing-event-category/251282)

<div class="topic-metadata">

**Author:** [@willemdh](https://discuss.elastic.co/u/willemdh)\
**Replies:** 1\
**Last updated:** [October 8, 2020, 1:14pm UTC](https://discuss.elastic.co/t/winlogbeat-sysmon-registry-events-missing-event-category/251282 "2020-10-08T13:14:35Z")

</div>

Hello, My Sysmon registry events (Registry object added or deleted (rule: RegistryEvent)) seem to be missing an event.category field. (7.8) What event.category should be given to these Sysmon events? Grtz Willem

---

## [Error after switching to ECS: 1 of 2 shards failed The data you are seeing might be incomplete or wrong](https://discuss.elastic.co/t/error-after-switching-to-ecs-1-of-2-shards-failed-the-data-you-are-seeing-might-be-incomplete-or-wrong/250540)

<div class="topic-metadata">

**Author:** [@michielvoo](https://discuss.elastic.co/u/michielvoo)\
**Replies:** 1\
**Last updated:** [October 1, 2020, 1:20pm UTC](https://discuss.elastic.co/t/error-after-switching-to-ecs-1-of-2-shards-failed-the-data-you-are-seeing-might-be-incomplete-or-wrong/250540 "2020-10-01T13:20:01Z")

</div>

I recently changed the logging configuration in my .NET application to use the official Serilog ECS formatter from Elastic (based on the recommendation in this official documentation). Now when I go to the discover app …

---

## [Elastic SIEM "Data Fetch Failure Invalid time value"](https://discuss.elastic.co/t/elastic-siem-data-fetch-failure-invalid-time-value/249388)

<div class="topic-metadata">

**Author:** [@soufiane\_adn](https://discuss.elastic.co/u/soufiane_adn)\
**Replies:** 5\
**Last updated:** [September 25, 2020, 2:07pm UTC](https://discuss.elastic.co/t/elastic-siem-data-fetch-failure-invalid-time-value/249388 "2020-09-25T14:07:54Z")

</div>

Hello guys, i hope you are doing well, so i'm facing a problem on the elastic siem app after parsing my logs and migrating them to ecs by logstash. the problem is the following error on the host/ event view : Data F…

---

## [Grok Ingest Pipeline and the Elastic Common Schema](https://discuss.elastic.co/t/grok-ingest-pipeline-and-the-elastic-common-schema/247917)

<div class="topic-metadata">

**Author:** [@roshanp](https://discuss.elastic.co/u/roshanp)\
**Replies:** 3\
**Last updated:** [September 9, 2020, 2:11pm UTC](https://discuss.elastic.co/t/grok-ingest-pipeline-and-the-elastic-common-schema/247917 "2020-09-09T14:11:42Z")

</div>

Hi there, I want to use the Grok patterns already available in the Elastic Ingest pipeline; however, I don't see how I can map the default field names provided to the Elastic common schema? Is there any work towards tha…

---

## [Logstash parsing ECS](https://discuss.elastic.co/t/logstash-parsing-ecs/247108)

<div class="topic-metadata">

**Author:** [@Abdelhalim](https://discuss.elastic.co/u/Abdelhalim)\
**Replies:** 4\
**Last updated:** [September 1, 2020, 3:27pm UTC](https://discuss.elastic.co/t/logstash-parsing-ecs/247108 "2020-09-01T15:27:33Z")

</div>

Hello everybody, I am using logstash to parse my firewall logs, and some logs contain these information : src=x.x.x.x srcport=YYY dst=x.x.x.x modsrc=x.x.x.x origdst=x.x.x.x dst= x.x.x.x srcport=YY modsrcport= YY ori…

---

## [Custom ECS to Index Template](https://discuss.elastic.co/t/custom-ecs-to-index-template/245638)

<div class="topic-metadata">

**Author:** [@jakobdoering](https://discuss.elastic.co/u/jakobdoering)\
**Replies:** 7\
**Last updated:** [August 31, 2020, 4:05pm UTC](https://discuss.elastic.co/t/custom-ecs-to-index-template/245638 "2020-08-31T16:05:54Z")

</div>

Hi, we extended ECS for a specific use case where logstash is used to read some CSV, filter the data to match the custom ECS Extension and then send the data to elasticsearch. I am now wondering how to transfer my ECS e…

---

## [Suggestion for field name](https://discuss.elastic.co/t/suggestion-for-field-name/242105)

<div class="topic-metadata">

**Author:** [@opoplawski](https://discuss.elastic.co/u/opoplawski)\
**Replies:** 5\
**Last updated:** [July 24, 2020, 3:50am UTC](https://discuss.elastic.co/t/suggestion-for-field-name/242105 "2020-07-24T03:50:22Z")

</div>

I'm parsing logs from e2guardian - a web filter. One of the fields is basically "why" a request was block. For e.g.: 2020.04.06 12:21:37 - 10.11.2.22 https://stats.g.doubleclick.net/r/collect?v=1&aip=…

---

## [Getting mutate\_error while trying to use ECS schema](https://discuss.elastic.co/t/getting-mutate-error-while-trying-to-use-ecs-schema/240707)

<div class="topic-metadata">

**Author:** [@curiousmind](https://discuss.elastic.co/u/curiousmind)\
**Replies:** 4\
**Last updated:** [July 11, 2020, 5:24pm UTC](https://discuss.elastic.co/t/getting-mutate-error-while-trying-to-use-ecs-schema/240707 "2020-07-11T17:24:25Z")

</div>

I was trying to ingest Fortigate firewall logs and under ECS schema. Here is my configuration: input { udp { host =\> "0.0.0.0" port =\> 10514 type =\> "log" } } filter { if \[type\] == "log" { kv { …

---

## [Email fields in ECS 1.5](https://discuss.elastic.co/t/email-fields-in-ecs-1-5/239359)

<div class="topic-metadata">

**Author:** [@sidahmed](https://discuss.elastic.co/u/sidahmed)\
**Replies:** 3\
**Last updated:** [July 1, 2020, 10:11am UTC](https://discuss.elastic.co/t/email-fields-in-ecs-1-5/239359 "2020-07-01T10:11:43Z")

</div>

I have some email fields that i'm indexing. My problem is, fields like CC, Subject ...; don't seem to fit in ECS (Elastic Common Schema). Is ELK team willing to add these fiels in next ECS versions ? or should I use cus…

---

## [Customizing message field for Ecs logging method of java applications](https://discuss.elastic.co/t/customizing-message-field-for-ecs-logging-method-of-java-applications/237133)

<div class="topic-metadata">

**Author:** [@Mohan\_vel](https://discuss.elastic.co/u/Mohan_vel)\
**Replies:** 2\
**Last updated:** [June 17, 2020, 10:51am UTC](https://discuss.elastic.co/t/customizing-message-field-for-ecs-logging-method-of-java-applications/237133 "2020-06-17T10:51:41Z")

</div>

Hi Team, I am using the filebeat latest version 7.7.1 to ship the data of my java application from my logfile to elasticsearch ecs logging method. Data is available in elasticsearch and i am able to track down the logs…

---

## [How to configure Filebeat to recognize ECS data](https://discuss.elastic.co/t/how-to-configure-filebeat-to-recognize-ecs-data/236550)

<div class="topic-metadata">

**Author:** [@Noxis](https://discuss.elastic.co/u/Noxis)\
**Replies:** 3\
**Last updated:** [June 12, 2020, 8:57am UTC](https://discuss.elastic.co/t/how-to-configure-filebeat-to-recognize-ecs-data/236550 "2020-06-12T08:57:44Z")

</div>

Hello I have an Kibana Elastic Filebeat docker stack and I want to monitor the logs of some NodeJS microservices (that run in docker too). I discovered yesterday ecs-morgan-format and it seems to work well with morgan. …

---

## [Use ecs with vpn server](https://discuss.elastic.co/t/use-ecs-with-vpn-server/235656)

<div class="topic-metadata">

**Author:** [@orsa](https://discuss.elastic.co/u/orsa)\
**Replies:** 4\
**Last updated:** [June 4, 2020, 3:33pm UTC](https://discuss.elastic.co/t/use-ecs-with-vpn-server/235656 "2020-06-04T15:33:59Z")

</div>

Hi, I parse Mikrotik log vpn server and and encountered difficulties in applying the ecs for some fields. Exsample: vpn session time - the total time of VPN session vpn session rx bits or packets vpn session tx bits…

---

## [Updated filebeat (from 6.2.4 to 7.6 ) drops all log.\*](https://discuss.elastic.co/t/updated-filebeat-from-6-2-4-to-7-6-drops-all-log/232724)

<div class="topic-metadata">

**Author:** [@mishat-realityi](https://discuss.elastic.co/u/mishat-realityi)\
**Replies:** 2\
**Last updated:** [May 20, 2020, 7:03pm UTC](https://discuss.elastic.co/t/updated-filebeat-from-6-2-4-to-7-6-drops-all-log/232724 "2020-05-20T19:03:52Z")

</div>

Hi everyone, I have a stack filebeat \> logstash \> elasticsearch Here is my config of filebeat. filebeat.inputs: - type: log enabled: true paths: - C:\\folder\\\* json.keys\_under\_root: true …

---

## [Suggestion to improve ECS documentation](https://discuss.elastic.co/t/suggestion-to-improve-ecs-documentation/232813)

<div class="topic-metadata">

**Author:** [@SH\_HSOC](https://discuss.elastic.co/u/SH_HSOC)\
**Replies:** 1\
**Last updated:** [May 15, 2020, 2:10pm UTC](https://discuss.elastic.co/t/suggestion-to-improve-ecs-documentation/232813 "2020-05-15T14:10:28Z")

</div>

Hi Elastic folks, I have a proposal to improve your documentation for the Elastic Common Schema. I would suggest to reference the filebeat modules for common log sources in the ECS documentation. E.g. under Additional I…

---

## [PANW schema bugs take 2](https://discuss.elastic.co/t/panw-schema-bugs-take-2/232388)

<div class="topic-metadata">

**Author:** [@willemdh](https://discuss.elastic.co/u/willemdh)\
**Replies:** 1\
**Last updated:** [May 14, 2020, 7:58pm UTC](https://discuss.elastic.co/t/panw-schema-bugs-take-2/232388 "2020-05-14T19:58:38Z")

</div>

Hello, Could someone please take a look at: And confirm this is a bug? This is generating confusion.... As source.bytes and destination.bytes are quite important field in a very important dataset, this should be han…

---

## [ECS: Converting winglogbeats for Sysmon/Security to Logstash](https://discuss.elastic.co/t/ecs-converting-winglogbeats-for-sysmon-security-to-logstash/231902)

<div class="topic-metadata">

**Author:** [@elkn00b](https://discuss.elastic.co/u/elkn00b)\
**Replies:** 1\
**Last updated:** [May 11, 2020, 11:36pm UTC](https://discuss.elastic.co/t/ecs-converting-winglogbeats-for-sysmon-security-to-logstash/231902 "2020-05-11T23:36:03Z")

</div>

I'm in the process of converting the winlogbeats javascript to Logstash, and I want to be sure I'm correctly interpreting some of the javascript. In the snip below, is the winlogbeats.js template for Sysmon separating t…

---

## [Emerging standards for ECS customization](https://discuss.elastic.co/t/emerging-standards-for-ecs-customization/229969)

<div class="topic-metadata">

**Author:** [@jgregmac](https://discuss.elastic.co/u/jgregmac)\
**Replies:** 1\
**Last updated:** [April 30, 2020, 6:28pm UTC](https://discuss.elastic.co/t/emerging-standards-for-ecs-customization/229969 "2020-04-30T18:28:21Z")

</div>

I am curious if there are any emerging patterns / practices / standards relating to the development of ECS custom extensions that can be shared with the community. We are experiencing difficulties in making logically co…

---

## [Ecs.version field as array or clean up?](https://discuss.elastic.co/t/ecs-version-field-as-array-or-clean-up/226407)

<div class="topic-metadata">

**Author:** [@widhalmt](https://discuss.elastic.co/u/widhalmt)\
**Replies:** 4\
**Last updated:** [April 8, 2020, 7:12am UTC](https://discuss.elastic.co/t/ecs-version-field-as-array-or-clean-up/226407 "2020-04-08T07:12:43Z")

</div>

Hi, As suggested in the ECS documents I want to set the ecs.version field in my Logstash pipelines. But since I'm using multiplie cascading pipelines (and receive events via filebeat), sometimes the field is already set…

---

## [Fuzzy Hostname/FQDN Semantics](https://discuss.elastic.co/t/fuzzy-hostname-fqdn-semantics/224368)

<div class="topic-metadata">

**Author:** [@nemhods](https://discuss.elastic.co/u/nemhods)\
**Replies:** 2\
**Last updated:** [March 24, 2020, 8:17am UTC](https://discuss.elastic.co/t/fuzzy-hostname-fqdn-semantics/224368 "2020-03-24T08:17:13Z")

</div>

Hello, I'm normalizing hostnames and host name fields across multiple data sources and indices for security use cases. I'm struggling to find a consistent use of the Hostname/domain fields in ECS. Consider the use cas…

---

## [ECS Fields Not Mapping Correctly Automatically](https://discuss.elastic.co/t/ecs-fields-not-mapping-correctly-automatically/224190)

<div class="topic-metadata">

**Author:** [@scottdfedorov](https://discuss.elastic.co/u/scottdfedorov)\
**Replies:** 5\
**Last updated:** [March 19, 2020, 7:50pm UTC](https://discuss.elastic.co/t/ecs-fields-not-mapping-correctly-automatically/224190 "2020-03-19T19:50:33Z")

</div>

When I index documents into Elasticsearch, the fields which conform to ECS are not being mapped correctly and all are being made into "text" fields, with "keyword" sub-fields. What steps are needed to utilize ECS? I was…

---

## [Change ECS event.duration unit to milliseconds in Packetbeat](https://discuss.elastic.co/t/change-ecs-event-duration-unit-to-milliseconds-in-packetbeat/223589)

<div class="topic-metadata">

**Author:** [@pryesh001](https://discuss.elastic.co/u/pryesh001)\
**Replies:** 2\
**Last updated:** [March 16, 2020, 7:09pm UTC](https://discuss.elastic.co/t/change-ecs-event-duration-unit-to-milliseconds-in-packetbeat/223589 "2020-03-16T19:09:39Z")

</div>

Hi, I have a requirement to capture http average event duration in milliseconds and show it in a visualisation. As of now ECS event.duration captures duration in nanoseconds. Which is not very readable in a visualisati…

---

## [Field Aliases vs Copy](https://discuss.elastic.co/t/field-aliases-vs-copy/223102)

<div class="topic-metadata">

**Author:** [@NerdSec](https://discuss.elastic.co/u/NerdSec)\
**Replies:** 4\
**Last updated:** [March 13, 2020, 4:53am UTC](https://discuss.elastic.co/t/field-aliases-vs-copy/223102 "2020-03-13T04:53:47Z")

</div>

Hi Team, We are planning to use Wazuh for some of our monitoring needs. Wazuh does not support ECS. Now, I plan to make the Wazuh data ECS compliant for better monitoring! My question is, which of the following would b…

---

## [MDC logs, ELK and filebeat](https://discuss.elastic.co/t/mdc-logs-elk-and-filebeat/222413)

<div class="topic-metadata">

**Author:** [@ash2](https://discuss.elastic.co/u/ash2)\
**Replies:** 9\
**Last updated:** [March 6, 2020, 4:30pm UTC](https://discuss.elastic.co/t/mdc-logs-elk-and-filebeat/222413 "2020-03-06T16:30:08Z")

</div>

Hi, I am new to Elastic stack. I am trying to creating a log management system. And while searching I came across MDC. So, I want to know about MDC logs and how it is useful in respect of filebeat or logstash log parsin…

[Previous page](https://discuss.elastic.co/tag/ecs-elastic-common-schema/26.md?match_all_tags=true&page=2&tags%5B%5D=ecs-elastic-common-schema)

[Next page](https://discuss.elastic.co/tag/ecs-elastic-common-schema/26.md?match_all_tags=true&page=4&tags%5B%5D=ecs-elastic-common-schema)
