Hi,
I have around 5 logs per transaction, every log has a timestamp and all 5 logs in a transactionId has a unique Id
I am trying to find the latest (largest) timestamp for every transaction Id.
Many thanks
Hi,
I have around 5 logs per transaction, every log has a timestamp and all 5 logs in a transactionId has a unique Id
I am trying to find the latest (largest) timestamp for every transaction Id.
Many thanks
The challenge is the high cardinality field that needs grouping on.
You can use aggregations to do this but will likely need to break it down into chunks using this partitioning approach
Alternatively you can use more of a streaming API to periodically sort the latest log raw records and compact down into an entity-centric index (the entity in your case being a transaction).
This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
© 2020. All Rights Reserved - Elasticsearch
Apache, Apache Lucene, Apache Hadoop, Hadoop, HDFS and the yellow elephant logo are trademarks of the Apache Software Foundation in the United States and/or other countries.