Unique identified per line during logstash

Elastic Stack Logstash
1

Hi All,

is there a way to add a uniquer identified per line when we index log files to elastic search. initially i thought of considering time stamp as the unique identifier per line if we are running a single thread, but end up in seeing multiple index instances per time stamp (till milli secs) and there is no support for nano seconds. Please suggest if any one have some idea.

thanks

2

Perhaps this filter will help? https://www.elastic.co/guide/en/logstash/current/plugins-filters-uuid.html

3

thanks for your response.

i tried out this option. but i think it is not creating in sequence with line order, it is creating some random uid. is there a way we can get sequential increment (pref numbers) per line?

4

Hi All,

i found a solution for this in the below link.