Logstash pipeline to fill sparse data


I have a series of machines whose status, selected from a set of possible values, is inserted into a database upon change with the associated timestamp. There is no new record until the next state change for the machine. Only the machine whose state changes has a record created in the database.

I'd like to be able to get the data into Elasticsearch, via Logstash, in order to visualize the distribution of the machines between the different states as a time series. What I'd need to do is to fill all the time steps after a state change for each machine and check if there has been a state change since the last time the data has been ingested at each time step.

Can this be done using a Logstash pipeline ? I've searched but haven't come up with anything which seems to fit the bill. I presume it exists, I just can't seem to find it.


This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.