Import data from MySQL to elasticsearch with logstash after preprocessing


(M. Alsioufi) #1

I am trying to import data from MySQL to elasticsearch using logstash, everything works fine and I have all the data imported well. However, one of the fields in MySQL called "metadata" is following a specific pattern like this "firstname_lastname_yyyy-MM-dd HH:mm:ss" so for example this is one of the values it may take "Mark_Karlos_2018-02-23 15:19:55", at the moment this field is imported to Elasticsearch as it is, what I want to do is to have this field as three fields in Elasticsearch "first_name", "last_name", "time". Is this possible to be done with Logstash config file? If not is there any other way to do this?


(Magnus B├Ąck) #2

You can e.g. use a grok or a dissect filter.


(system) #3

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.