How to ingest complex JSON objects with tables in ES?

Elastic Stack Elasticsearch
1

I'm trying to define a format for my logs and these must include lists of objects. When I upload my log file to ElasticSearch, it doesn't know how to parse the lists and I don't see how to configure this.

Example NDJSON log:

{"id_of_execution":123,"branch":"master","timestamp":1628682978,"hostname":"HOST_1","full_version":"4.3.4-43bca4","known_issues_table":[{"key":1,"name":"DG-1"},{"key":2,"name":"DG-2"}]}
{"id_of_execution":125,"branch":"feature_new","timestamp":1628682979,"hostname":"HOST_1","full_version":"4.5.0-32ab03","known_issues_table":[{"key":1,"name":"DG-1"},{"key":2,"name":"DG-2"},{"key":255,"name":"DG-4"},{"key":256,"name":"DG-67"}]}
{"id_of_execution":126,"branch":"feature_new2","timestamp":1628682956,"hostname":"HOST_2","full_version":"4.6.0-32ff34","known_issues_table":[{"key":1,"name":"DG-1"},{"key":2,"name":"DG-2"},{"key":255,"name":"DG-45"},{"key":256,"name":"DG-68"}]}
{"id_of_execution":127,"branch":"feature_new3","timestamp":1628682934,"hostname":"HOST_55","full_version":"4.7.0-32cc75","known_issues_table":[{"key":1,"name":"DG-1"},{"key":2,"name":"DG-2"},{"key":255,"name":"DG-3"},{"key":256,"name":"DG-69"}]}

image
image2376×1416 170 KB

The list known_issues_table is recognized as of type unknown type and I would like this to be recognized as an object within the main object with an array. Is this possible?

2

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.