Parse multiple lines of Log file into the same Elasticsearch document based on ID


(Bacem Hagui) #1

I would like to store the times for different tasks of a job. The log file of my job has several lines each of which is a different task. Here is an example:

2018-04-25 18:33:40.940 INFO be8f587e-aae3-4e56-88a2-75dde556a99c --- Task 1
2018-04-25 18:33:43.941 INFO be8f587e-aae3-4e56-88a2-75dde556a99c --- Task 2
2018-04-25 18:33:46.775 INFO be8f587e-aae3-4e56-88a2-75dde556a99c --- Task 3

As you can see, the three tasks have the same job ID which can be used as the unique ID for an Elasticsearch document. I would liked to have 3 fields in this elasticsearch document named task 1, task 2 and task 3 containing the respective times.

Any help intoducing tools or plugins that will help me will be greatly appreciated, especially with an example of code or a demonstration. Thanks in advance!


(system) #2

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.