Hello team. More and more often you have to work with logos that come to logstash in the form of a table: Network Management Card AOS v3.7.3 Symmetra APP v1.1.2 Date Time Name Contact Location System IP 23.03.2021 10:33:07 test-UPS02 QWER Elektric 10.10.10.1 Symmetra LX 16000 RM …

at least some ideas how you can transfer / add data from the first table to the second?

You would need to use a ruby filter. There is an example here and another here .

Badger ,thanks for the parsing suggestion. I'll try to figure out how it works. I haven't used Ruby in my configurations before. I've come across similar Ruby posts before, but I couldn't figure out how to use them in my code. Another question, I have several types of files with a different number …

I use the ruby code, it partially worked - metadata was added to some lines, but not to others - in kibana _rubyexception. I can't understand why it works selectively, the messages are of the same type

[image] San9: Another question, I have several types of files with a different number of columns, can I somehow differentiate them among themselves by the number of columns in order to use the correct headers for each of them in the future? See here for an example.

Badger , thank you so much. The column counting code works fine. But we had to refuse to add metadata that was found at the beginning of the file, because subsequently, only new lines are transmitted and the initial table only once at the time of reading the file, or you need to constantly re-read th…

Discuss the Elastic Stack

Parsing data presented in the form of a table

Elastic Stack Logstash

Badger June 23, 2021, 4:46pm 8

See here for an example.

Topic		Replies	Views
Logstash as a parser for data in column Logstash docker	22	1296	January 24, 2022
Parsing multiple lines as multiple events using fields from first and last line Logstash	5	2249	July 1, 2020
Multiple tables in csv file Logstash	7	4076	December 8, 2018
Parsing csv file through Logstash Logstash	18	2386	July 9, 2021
Process - Reshape a CSV file using logstash Logstash	30	1478	September 17, 2019

Elasticsearch is a trademark of Elasticsearch BV, registered in the U.S. and in other countries
Trademarks
Terms
Privacy
Brand
Code of Conduct

Apache, Apache Lucene, Apache Hadoop, Hadoop, HDFS and the yellow elephant logo are trademarks of the Apache Software Foundation in the United States and/or other countries.

Parsing data presented in the form of a table

Related topics