How are you ingesting your logs? I suggest parsing your message and extracting the id from the message at ingest time. With Logstash you can use the dissect filter to do this. With Beats you can use the dissect ingest processor.
Getting the elapsed time between logs is also easier to do at ingest time. Logstash has an elapsed filter which helps with this.
Apache, Apache Lucene, Apache Hadoop, Hadoop, HDFS and the yellow elephant
logo are trademarks of the
Apache Software Foundation
in the United States and/or other countries.