# Correlation or calculating time difference between log entries using BI tool with ES 6.5

**URL:** https://discuss.elastic.co/t/correlation-or-calculating-time-difference-between-log-entries-using-bi-tool-with-es-6-5/158526
**Category:** Elasticsearch
**Created:** [November 28, 2018, 9:42am UTC](https://discuss.elastic.co/t/correlation-or-calculating-time-difference-between-log-entries-using-bi-tool-with-es-6-5/158526 "2018-11-28T09:42:44Z")
**Posts on this page:** 4
**Page:** 1

<div class="post-metadata">

### Author: ![ramvalleru](https://avatars.discourse-cdn.com/v4/letter/r/b3f665/32.png) [@ramvalleru](https://discuss.elastic.co/u/ramvalleru)
#### Post date: [November 28, 2018, 9:42am UTC](https://discuss.elastic.co/t/correlation-or-calculating-time-difference-between-log-entries-using-bi-tool-with-es-6-5/158526/1 "2018-11-28T09:42:45Z")

</div>

Some jobs create log entries as following:  
event time( start), uid and status;  
event time( stop), uid and status;

The message if parsed and the fields are separated using Logstash and put into index.

I believe I could not show on Kibana, the average running time of job and top jobs that take more time even though they are put into same index.

Can I use ES as data store and use external BI tool to project such kind of visualization.

---

<div class="post-metadata">

### Author: ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)
#### Post date: [November 28, 2018, 9:55am UTC](https://discuss.elastic.co/t/correlation-or-calculating-time-difference-between-log-entries-using-bi-tool-with-es-6-5/158526/2 "2018-11-28T09:55:20Z")

</div>

Or you can use this may be? [https://www.elastic.co/guide/en/logstash/current/plugins-filters-aggregate.html](https://www.elastic.co/guide/en/logstash/current/plugins-filters-aggregate.html)

---

<div class="post-metadata">

### Author: ![ramvalleru](https://avatars.discourse-cdn.com/v4/letter/r/b3f665/32.png) [@ramvalleru](https://discuss.elastic.co/u/ramvalleru)
#### Post date: [November 28, 2018, 10:42am UTC](https://discuss.elastic.co/t/correlation-or-calculating-time-difference-between-log-entries-using-bi-tool-with-es-6-5/158526/3 "2018-11-28T10:42:43Z")

</div>

One could also use [https://www.elastic.co/guide/en/logstash/current/plugins-filters-elapsed.html](https://www.elastic.co/guide/en/logstash/current/plugins-filters-elapsed.html). Can calculate difference between timestamps in the log entries right.

---

<div class="post-metadata">

### Author: ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)
#### Post date: [December 26, 2018, 10:42am UTC](https://discuss.elastic.co/t/correlation-or-calculating-time-difference-between-log-entries-using-bi-tool-with-es-6-5/158526/4 "2018-12-26T10:42:46Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
