# \#ecs-elastic-common-schema

**URL:** https://discuss.elastic.co/tag/ecs-elastic-common-schema/26.md?match_all_tags=true&page=2&tags%5B%5D=ecs-elastic-common-schema

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 3

---

## [Timestamp not being overwriten (ECS)](https://discuss.elastic.co/t/timestamp-not-being-overwriten-ecs/288544)

<div class="topic-metadata">

**Author:** [@vcaleffi](https://discuss.elastic.co/u/vcaleffi)\
**Replies:** 2\
**Last updated:** [November 6, 2021, 6:41pm UTC](https://discuss.elastic.co/t/timestamp-not-being-overwriten-ecs/288544 "2021-11-06T18:41:03Z")

</div>

Hello, I'm very new to filebeat and I'm trying to import logs created by my application (PHP - symfony). The application uses monolog and ECS formatter to write to a log file. Monolog configuration: monolog: handl…

---

## [Confusion, dot-notation vs. sub-objects](https://discuss.elastic.co/t/confusion-dot-notation-vs-sub-objects/286199)

<div class="topic-metadata">

**Author:** [@anton-johansson](https://discuss.elastic.co/u/anton-johansson)\
**Replies:** 2\
**Last updated:** [October 11, 2021, 3:15pm UTC](https://discuss.elastic.co/t/confusion-dot-notation-vs-sub-objects/286199 "2021-10-11T15:15:40Z")

</div>

We're a bit confused about the specification regarding dot-notation vs. sub-objects. If you look in the documentation, it is specified as dot-notation, see here: This is implemented as dot-notation in the Java/Log4j2-i…

---

## [How does elasticsearch index json](https://discuss.elastic.co/t/how-does-elasticsearch-index-json/285335)

<div class="topic-metadata">

**Author:** [@Zeeshan\_Alam](https://discuss.elastic.co/u/Zeeshan_Alam)\
**Replies:** 2\
**Last updated:** [September 29, 2021, 3:24pm UTC](https://discuss.elastic.co/t/how-does-elasticsearch-index-json/285335 "2021-09-29T15:24:25Z")

</div>

We are trying to push log into elastic which adhere to Elastic Common Schema (ECS) . Does elastic index data differently for the logs shown below. Both are having same data just the JSON format is different. Format 1 {…

---

## [Applying Elastic Common Scheman(ECS) in multi language environments](https://discuss.elastic.co/t/applying-elastic-common-scheman-ecs-in-multi-language-environments/282431)

<div class="topic-metadata">

**Author:** [@Bingu\_Shim](https://discuss.elastic.co/u/Bingu_Shim)\
**Replies:** 2\
**Last updated:** [August 26, 2021, 1:31am UTC](https://discuss.elastic.co/t/applying-elastic-common-scheman-ecs-in-multi-language-environments/282431 "2021-08-26T01:31:08Z")

</div>

Hello, We are operating Filebeat on about 2,000 Machines and 2~30 K8S Clusters. Also we accept ECS as the structured logging format standard for our company. Currently, we applied ECS layout to services that are writt…

---

## [Create a custom ECS settings via github repo](https://discuss.elastic.co/t/create-a-custom-ecs-settings-via-github-repo/280769)

<div class="topic-metadata">

**Author:** [@Thomas74](https://discuss.elastic.co/u/Thomas74)\
**Replies:** 2\
**Last updated:** [August 18, 2021, 7:41am UTC](https://discuss.elastic.co/t/create-a-custom-ecs-settings-via-github-repo/280769 "2021-08-18T07:41:41Z")

</div>

Hi, I'm trying to generate ecs template with custom settings. For that, I used this repo GitHub - elastic/ecs: Elastic Common Schema. Command used : python scripts/generator.py --template-settings template.json --ref …

---

## [Where is the object mapping for \[host\] defined?](https://discuss.elastic.co/t/where-is-the-object-mapping-for-host-defined/281541)

<div class="topic-metadata">

**Author:** [@antoineco](https://discuss.elastic.co/u/antoineco)\
**Replies:** 14\
**Last updated:** [August 16, 2021, 2:26pm UTC](https://discuss.elastic.co/t/where-is-the-object-mapping-for-host-defined/281541 "2021-08-16T14:26:42Z")

</div>

Context Since the release of Elastic v8.0.0 (alpha), the elasticsearch output of Logstash started throwing the following error, even on a fresh installation: object mapping for \[host\] tried to parse field \[host\] as obj…

---

## [Mapping Tenable (Nessus) scan reportitems to ECS vulnerability field set](https://discuss.elastic.co/t/mapping-tenable-nessus-scan-reportitems-to-ecs-vulnerability-field-set/280543)

<div class="topic-metadata">

**Author:** [@Gerry7](https://discuss.elastic.co/u/Gerry7)\
**Replies:** 3\
**Last updated:** [August 12, 2021, 9:54pm UTC](https://discuss.elastic.co/t/mapping-tenable-nessus-scan-reportitems-to-ecs-vulnerability-field-set/280543 "2021-08-12T21:54:41Z")

</div>

We are attempting to map Tenable (Nessus) scan report items to the ECS vulnerability field set. The Tenable scan report may include multiple vulnerability identifiers related to the detected vulnerability where each vuln…

---

## [Difference between (event.module: system - event.action: user\_login) AND (event.module: auditd - event.action: logged-in)](https://discuss.elastic.co/t/difference-between-event-module-system-event-action-user-login-and-event-module-auditd-event-action-logged-in/279712)

<div class="topic-metadata">

**Author:** [@panagiss](https://discuss.elastic.co/u/panagiss)\
**Replies:** 2\
**Last updated:** [July 27, 2021, 4:03pm UTC](https://discuss.elastic.co/t/difference-between-event-module-system-event-action-user-login-and-event-module-auditd-event-action-logged-in/279712 "2021-07-27T16:03:48Z")

</div>

I have set on a host both packetbeat and auditbeat. I wanted to set a rule about login events but it confuses me a bit the separation between event.module: system and event.module: auditd. At the SIEM overview there is …

---

## [ECS fields for Postfix?](https://discuss.elastic.co/t/ecs-fields-for-postfix/276284)

<div class="topic-metadata">

**Author:** [@jerrac](https://discuss.elastic.co/u/jerrac)\
**Replies:** 1\
**Last updated:** [June 21, 2021, 8:06pm UTC](https://discuss.elastic.co/t/ecs-fields-for-postfix/276284 "2021-06-21T20:06:58Z")

</div>

Initially in response to My Elastic Stack Observability Wishlist - #5 by weltenwort, but I think this really is it's own topic. Are there ECS fields for Postfix logs? Or, rather, how would you break out postfix log mess…

---

## [ECS Logger Mapping Logs to ECS Fields](https://discuss.elastic.co/t/ecs-logger-mapping-logs-to-ecs-fields/274932)

<div class="topic-metadata">

**Author:** [@mertayd](https://discuss.elastic.co/u/mertayd)\
**Replies:** 7\
**Last updated:** [June 16, 2021, 5:48pm UTC](https://discuss.elastic.co/t/ecs-logger-mapping-logs-to-ecs-fields/274932 "2021-06-16T17:48:03Z")

</div>

I am quite new using Elastic and I have log data from AWS CloudWatch that I have shipped into Elastic Cluster using filebeats however I couldn't understand how I can map my logs into ECS fields. I read a lot of documenta…

---

## [Best Practices / Recommendations for Custom Objects](https://discuss.elastic.co/t/best-practices-recommendations-for-custom-objects/274081)

<div class="topic-metadata">

**Author:** [@Jeff\_Stevens](https://discuss.elastic.co/u/Jeff_Stevens)\
**Replies:** 2\
**Last updated:** [June 1, 2021, 6:16am UTC](https://discuss.elastic.co/t/best-practices-recommendations-for-custom-objects/274081 "2021-06-01T06:16:24Z")

</div>

We are evaluating ECS as a common transport schema for our events, logging, and messaging needs. Tags are not enough as we want to have sharable serialized compound objects. We initially started with the .NET NLog mapp…

---

## [Elasticsearch common data model](https://discuss.elastic.co/t/elasticsearch-common-data-model/273283)

<div class="topic-metadata">

**Author:** [@daya.ems](https://discuss.elastic.co/u/daya.ems)\
**Replies:** 3\
**Last updated:** [May 19, 2021, 10:11pm UTC](https://discuss.elastic.co/t/elasticsearch-common-data-model/273283 "2021-05-19T22:11:57Z")

</div>

Hi All, Hope you are doing great and safe..!!! I am new into Elasticsearch stack and want implement elasticsearch common data model for our project . I am not sure where to start this topic.and how to Implement this i…

---

## [How to fit data from unchangeable source into ECS?](https://discuss.elastic.co/t/how-to-fit-data-from-unchangeable-source-into-ecs/273126)

<div class="topic-metadata">

**Author:** [@TheGerd](https://discuss.elastic.co/u/TheGerd)\
**Replies:** 3\
**Last updated:** [May 18, 2021, 8:07pm UTC](https://discuss.elastic.co/t/how-to-fit-data-from-unchangeable-source-into-ecs/273126 "2021-05-18T20:07:27Z")

</div>

Hello. I am used to the very basic concepts of Elasticsearch but now facing an issue where I don't know how to proceed. I am indexing data in a fixed format and I am not able to change the format at the source. Now I wa…

---

## [Mapping Winlogbeat old version to newest ECS](https://discuss.elastic.co/t/mapping-winlogbeat-old-version-to-newest-ecs/272625)

<div class="topic-metadata">

**Author:** [@Kambing](https://discuss.elastic.co/u/Kambing)\
**Replies:** 2\
**Last updated:** [May 17, 2021, 7:32pm UTC](https://discuss.elastic.co/t/mapping-winlogbeat-old-version-to-newest-ecs/272625 "2021-05-17T19:32:34Z")

</div>

Hi, I have hundreds windows server in production with variety of windows version from windows server 2003 to the windows server 2019 I had tried to install winlogbeat 7.12.1 for windows server 2003 but there's always an…

---

## [Field for http response times](https://discuss.elastic.co/t/field-for-http-response-times/272742)

<div class="topic-metadata">

**Author:** [@Sergii\_Ovcharenko](https://discuss.elastic.co/u/Sergii_Ovcharenko)\
**Replies:** 2\
**Last updated:** [May 12, 2021, 5:04pm UTC](https://discuss.elastic.co/t/field-for-http-response-times/272742 "2021-05-12T17:04:44Z")

</div>

Hey, Our app logs HTTP response times for the APIs we provide. What would be the best standard field to put this data in to follow ECS standard and best practices? There is no http.response.latency or similar field and e…

---

## [ECS in avro format](https://discuss.elastic.co/t/ecs-in-avro-format/272170)

<div class="topic-metadata">

**Author:** [@birko](https://discuss.elastic.co/u/birko)\
**Replies:** 2\
**Last updated:** [May 6, 2021, 2:22pm UTC](https://discuss.elastic.co/t/ecs-in-avro-format/272170 "2021-05-06T14:22:47Z")

</div>

I'm looking for avro schema representation of ecs. It is necessary in Apache NiFi, when you're trying to transform data with record-oriented processors. Workaround is to use InferAvroSchema processor, but there is necess…

---

## [Managed index templates, composition, and ECS](https://discuss.elastic.co/t/managed-index-templates-composition-and-ecs/266734)

<div class="topic-metadata">

**Author:** [@Supermathie](https://discuss.elastic.co/u/Supermathie)\
**Replies:** 3\
**Last updated:** [March 19, 2021, 8:04pm UTC](https://discuss.elastic.co/t/managed-index-templates-composition-and-ecs/266734 "2021-03-19T20:04:40Z")

</div>

We are upgrading to Elastic 7 and at the same time attempting to move our entire pipeline to ECS. I'm wondering how template composition fits in with everything. We primarily store transient logs and I'm wondering what …

---

## [SIEM Network Map Errors](https://discuss.elastic.co/t/siem-network-map-errors/266386)

<div class="topic-metadata">

**Author:** [@Lin2020](https://discuss.elastic.co/u/Lin2020)\
**Replies:** 1\
**Last updated:** [March 16, 2021, 5:49pm UTC](https://discuss.elastic.co/t/siem-network-map-errors/266386 "2021-03-16T17:49:42Z")

</div>

The error on the map is "The Source Point and Destination Point no results found" and SIEM-Network-Flows: Autonomous system, Bytes in, Bytes out....no items displayed Discover error-firewall logs

---

## [Elastic Common Schema Fields for Reverse Proxies](https://discuss.elastic.co/t/elastic-common-schema-fields-for-reverse-proxies/267074)

<div class="topic-metadata">

**Author:** [@learnerbyheart](https://discuss.elastic.co/u/learnerbyheart)\
**Replies:** 2\
**Last updated:** [March 15, 2021, 9:10pm UTC](https://discuss.elastic.co/t/elastic-common-schema-fields-for-reverse-proxies/267074 "2021-03-15T21:10:46Z")

</div>

Hello, we are currently migrating our NGINX logging format to the Elastic Common Schema. For some NGINX logging values I cannot find any fitting fields. In our case we use NGINX as a reverse proxy in Kubernetes. Most of…

---

## [I have hypen separated in one column and i want to use that column in elastic search. Mapping created with type. Need to escape the hypen and get the whole value](https://discuss.elastic.co/t/i-have-hypen-separated-in-one-column-and-i-want-to-use-that-column-in-elastic-search-mapping-created-with-type-need-to-escape-the-hypen-and-get-the-whole-value/266998)

<div class="topic-metadata">

**Author:** [@Sreenath\_G](https://discuss.elastic.co/u/Sreenath_G)\
**Replies:** 3\
**Last updated:** [March 15, 2021, 2:15pm UTC](https://discuss.elastic.co/t/i-have-hypen-separated-in-one-column-and-i-want-to-use-that-column-in-elastic-search-mapping-created-with-type-need-to-escape-the-hypen-and-get-the-whole-value/266998 "2021-03-15T14:15:03Z")

</div>

Below is mapping: "TestID" : { "type" : "text", "fielddata" : true Example value of ID is "12333-1arerd-2333d-rrrrrwwqq" In the scripted field of the Index pattern i have given the below Script: if (doc\['TestID'\] …

---

## [Monitoring Linux System Temperature with Elasticsearch (Tested on Raspberry Pi)](https://discuss.elastic.co/t/monitoring-linux-system-temperature-with-elasticsearch-tested-on-raspberry-pi/266609)

<div class="topic-metadata">

**Author:** [@jamesgarside](https://discuss.elastic.co/u/jamesgarside)\
**Replies:** 0\
**Last updated:** [March 8, 2021, 9:45pm UTC](https://discuss.elastic.co/t/monitoring-linux-system-temperature-with-elasticsearch-tested-on-raspberry-pi/266609 "2021-03-08T21:45:12Z")

</div>

Hello all, I have just finished a quick temperature monitoring project for Linux systems using Filebeat and Elasticsearch. The repo can be found here: https://github.com/jamesgarside/linux-temperature-logger I develop…

---

## [ECS Logging for PHP / Question](https://discuss.elastic.co/t/ecs-logging-for-php-question/265006)

<div class="topic-metadata">

**Author:** [@leostereo](https://discuss.elastic.co/u/leostereo)\
**Replies:** 2\
**Last updated:** [February 22, 2021, 3:48am UTC](https://discuss.elastic.co/t/ecs-logging-for-php-question/265006 "2021-02-22T03:48:20Z")

</div>

Hi guys, Im trying to ship my application events to my elasticsearch platform. My app and elk are running on different servers (ping reachable). I already have the php library working on a little example script taken f…

---

## [Error when using template generated by ECS Tooling (1.7 and master) for datastream](https://discuss.elastic.co/t/error-when-using-template-generated-by-ecs-tooling-1-7-and-master-for-datastream/263016)

<div class="topic-metadata">

**Author:** [@mxu](https://discuss.elastic.co/u/mxu)\
**Replies:** 7\
**Last updated:** [February 11, 2021, 7:38pm UTC](https://discuss.elastic.co/t/error-when-using-template-generated-by-ecs-tooling-1-7-and-master-for-datastream/263016 "2021-02-11T19:38:21Z")

</div>

ECS Tooling (1.7.0 and master) generates template as following with my template-settings input: { "index\_patterns":\[ "my-data-stream\*" \], "data\_stream":{ }, "mappings":{ "properties":{ …

---

## [Linux auditd to ECS mapping](https://discuss.elastic.co/t/linux-auditd-to-ecs-mapping/263150)

<div class="topic-metadata">

**Author:** [@kelk](https://discuss.elastic.co/u/kelk)\
**Replies:** 0\
**Last updated:** [February 3, 2021, 4:48pm UTC](https://discuss.elastic.co/t/linux-auditd-to-ecs-mapping/263150 "2021-02-03T16:48:22Z")

</div>

hi We got data coming via syslog-\> logstash from certain Linux devices and don't have auditbeats. Is there a logstash pattern, where I can map the auditd fields to ECS (common schema) format?

---

## [Parsing Mapping and finding the right ECS fields for logs in general](https://discuss.elastic.co/t/parsing-mapping-and-finding-the-right-ecs-fields-for-logs-in-general/262451)

<div class="topic-metadata">

**Author:** [@cgekoski](https://discuss.elastic.co/u/cgekoski)\
**Replies:** 1\
**Last updated:** [February 2, 2021, 11:43pm UTC](https://discuss.elastic.co/t/parsing-mapping-and-finding-the-right-ecs-fields-for-logs-in-general/262451 "2021-02-02T23:43:52Z")

</div>

Hello everyone. I'm going to start with saying sorry TLDR but hope someone can shine the light in the right direction. Pretty new to logstash/elastic and trying to come to grasp with the ECS field guide and want to teach…

---

## [Scaling\_factor is missing in generated template using ECS Tooling 1.7.0](https://discuss.elastic.co/t/scaling-factor-is-missing-in-generated-template-using-ecs-tooling-1-7-0/262511)

<div class="topic-metadata">

**Author:** [@mxu](https://discuss.elastic.co/u/mxu)\
**Replies:** 3\
**Last updated:** [February 1, 2021, 3:37pm UTC](https://discuss.elastic.co/t/scaling-factor-is-missing-in-generated-template-using-ecs-tooling-1-7-0/262511 "2021-02-01T15:37:58Z")

</div>

Hi, I am adding a custom schema for CPU Usage, configured as following. The ECS Tooling 1.7.0 generated template without "scaling\_factor" field. - name: 1MinAvg.Pct level: custom type: scaled\_float s…

---

## [Moving my first logs to ECS](https://discuss.elastic.co/t/moving-my-first-logs-to-ecs/261567)

<div class="topic-metadata">

**Author:** [@leostereo](https://discuss.elastic.co/u/leostereo)\
**Replies:** 5\
**Last updated:** [January 25, 2021, 4:29pm UTC](https://discuss.elastic.co/t/moving-my-first-logs-to-ecs/261567 "2021-01-25T16:29:41Z")

</div>

Hi friends. After succesing submiting my custom events into elk and visalize ok kibana, I would like to improve my event login format. After googlin about creating custom ecs index and indexing its documents , I did no…

---

## [Question about logstash output plugin 7.9 and ecs](https://discuss.elastic.co/t/question-about-logstash-output-plugin-7-9-and-ecs/259154)

<div class="topic-metadata">

**Author:** [@gerbdla](https://discuss.elastic.co/u/gerbdla)\
**Replies:** 1\
**Last updated:** [January 7, 2021, 4:53pm UTC](https://discuss.elastic.co/t/question-about-logstash-output-plugin-7-9-and-ecs/259154 "2021-01-07T16:53:14Z")

</div>

I am not understanding the ecs changes in the logstash elasticsearch output plugin version 7.9 ecs compatibility. I have an issue when I try to index an event that has an object mapping for host. object mapping for \[ho…

---

## [Host.os is missing in generated template when host is expected in a custom schema using ECS Tooling 1.6 and 1.7](https://discuss.elastic.co/t/host-os-is-missing-in-generated-template-when-host-is-expected-in-a-custom-schema-using-ecs-tooling-1-6-and-1-7/258786)

<div class="topic-metadata">

**Author:** [@mxu](https://discuss.elastic.co/u/mxu)\
**Replies:** 4\
**Last updated:** [December 18, 2020, 11:46pm UTC](https://discuss.elastic.co/t/host-os-is-missing-in-generated-template-when-host-is-expected-in-a-custom-schema-using-ecs-tooling-1-6-and-1-7/258786 "2020-12-18T23:46:18Z")

</div>

Hi, I am using ECS Tooling (1.6 and 1.7) to generate template, adding "host" to a custom schema "Link". Added host.yml as following. In the resulted template.json, while host.geo exists, host.os is missing. After I c…

---

## [Dec 4th, 2020: \[EN\] Validate Elastic Common Schema (ECS) fields using Security Detection Rules](https://discuss.elastic.co/t/dec-4th-2020-en-validate-elastic-common-schema-ecs-fields-using-security-detection-rules/254805)

<div class="topic-metadata">

**Author:** [@ebeahan](https://discuss.elastic.co/u/ebeahan)\
**Replies:** 0\
**Last updated:** [December 4, 2020, 8:00am UTC](https://discuss.elastic.co/t/dec-4th-2020-en-validate-elastic-common-schema-ecs-fields-using-security-detection-rules/254805 "2020-12-04T08:00:00Z")

</div>

Introduction The Elastic Common Schema (ECS) provides an open, consistent model for structuring your data in the Elastic Stack. By normalizing data to a single common model, you can uniformly examine your data using int…

[Previous page](https://discuss.elastic.co/tag/ecs-elastic-common-schema/26.md?match_all_tags=true&page=1&tags%5B%5D=ecs-elastic-common-schema)

[Next page](https://discuss.elastic.co/tag/ecs-elastic-common-schema/26.md?match_all_tags=true&page=3&tags%5B%5D=ecs-elastic-common-schema)
