# Show records based on last modified date in Kibana

**URL:** <https://discuss.elastic.co/t/show-records-based-on-last-modified-date-in-kibana/286959>\
**Category:** Kibana\
**Created:** [October 18, 2021, 7:05am UTC](https://discuss.elastic.co/t/show-records-based-on-last-modified-date-in-kibana/286959 "2021-10-18T07:05:10Z")\
**Posts on this page:** 12\
**Page:** 1

<div class="post-metadata">

**Author:** ![Farah\_Zaidi](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/farah_zaidi/32/83575_2.png) [@Farah\_Zaidi](https://discuss.elastic.co/u/Farah_Zaidi)\
**Post date:** [October 18, 2021, 7:05am UTC](https://discuss.elastic.co/t/show-records-based-on-last-modified-date-in-kibana/286959/1 "2021-10-18T07:05:10Z")

</div>

Hi All ,  
I have a requirement where we have same ids with different status but we need to show only the last status of the id based on last modified date .  
For Example  
{id : 123,  
status:validated,  
modifiedAt:Oct 18, 2021 @ 10:48:08.096},  
{id : 123,  
status:processing,  
modifiedAt: Oct 18, 2021 @ 10:52:08.096}',  
{id : 123,  
status:finished,  
modifiedAt:Oct 18, 2021 @ 10:55:08.096}

Can guide on how we can create Visualize in Kibana to achieve the same .

TIA

---

<div class="post-metadata">

**Author:** ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)\
**Post date:** [October 18, 2021, 7:12am UTC](https://discuss.elastic.co/t/show-records-based-on-last-modified-date-in-kibana/286959/2 "2021-10-18T07:12:52Z")

</div>

Use a terms aggregation on the `id` field and then a top hits aggregation on the `modifiedAt` field. That should do it.

---

<div class="post-metadata">

**Author:** ![Farah\_Zaidi](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/farah_zaidi/32/83575_2.png) [@Farah\_Zaidi](https://discuss.elastic.co/u/Farah_Zaidi)\
**Post date:** [October 18, 2021, 7:20am UTC](https://discuss.elastic.co/t/show-records-based-on-last-modified-date-in-kibana/286959/3 "2021-10-18T07:20:58Z")

</div>

I tried with same but i want to count the total number of ids failed or completed based on ids last status but when i group them with status , it includes same ids as twice .  
I am trying to do this in Kibana Visualize

---

<div class="post-metadata">

**Author:** ![padamrai](https://avatars.discourse-cdn.com/v4/letter/p/3da27b/32.png) [@padamrai](https://discuss.elastic.co/u/padamrai)\
**Post date:** [October 18, 2021, 7:56am UTC](https://discuss.elastic.co/t/show-records-based-on-last-modified-date-in-kibana/286959/4 "2021-10-18T07:56:29Z")

</div>

Dear, What is your last status in the modification process?

---

<div class="post-metadata">

**Author:** ![Farah\_Zaidi](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/farah_zaidi/32/83575_2.png) [@Farah\_Zaidi](https://discuss.elastic.co/u/Farah_Zaidi)\
**Post date:** [October 18, 2021, 7:57am UTC](https://discuss.elastic.co/t/show-records-based-on-last-modified-date-in-kibana/286959/5 "2021-10-18T07:57:33Z")

</div>

Finished

---

<div class="post-metadata">

**Author:** ![padamrai](https://avatars.discourse-cdn.com/v4/letter/p/3da27b/32.png) [@padamrai](https://discuss.elastic.co/u/padamrai)\
**Post date:** [October 18, 2021, 7:59am UTC](https://discuss.elastic.co/t/show-records-based-on-last-modified-date-in-kibana/286959/6 "2021-10-18T07:59:18Z")

</div>

Then use `status.keyword:"Finished"` in the filter bar of the visualization. Then count a number of records in the visualization.

---

<div class="post-metadata">

**Author:** ![Farah\_Zaidi](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/farah_zaidi/32/83575_2.png) [@Farah\_Zaidi](https://discuss.elastic.co/u/Farah_Zaidi)\
**Post date:** [October 18, 2021, 8:00am UTC](https://discuss.elastic.co/t/show-records-based-on-last-modified-date-in-kibana/286959/7 "2021-10-18T08:00:57Z")

</div>

The issue is same id can have both Validate & Finish status.  
But I want to cater only the status as per last modified date. Currently same id is counted in both Total number of validated records & Total number of Finished records.

---

<div class="post-metadata">

**Author:** ![padamrai](https://avatars.discourse-cdn.com/v4/letter/p/3da27b/32.png) [@padamrai](https://discuss.elastic.co/u/padamrai)\
**Post date:** [October 18, 2021, 8:06am UTC](https://discuss.elastic.co/t/show-records-based-on-last-modified-date-in-kibana/286959/8 "2021-10-18T08:06:22Z")

</div>

Is it possible to override your previous record with the new incoming record?

---

<div class="post-metadata">

**Author:** ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)\
**Post date:** [October 18, 2021, 8:25am UTC](https://discuss.elastic.co/t/show-records-based-on-last-modified-date-in-kibana/286959/9 "2021-10-18T08:25:49Z")

</div>

Does this look like what you want;

 ![Screen Shot 2021-10-18 at 19.24.10](https://us1.discourse-cdn.com/elastic/original/3X/1/0/105f349d31dde4950122bcdbc81b2cc0056a3228.png)

Here's the sample data I created;

```auto
PUT test/
{
  "mappings": {
    "properties": {
      "id": {
        "type": "short"
      },
      "status": {
        "type": "keyword"
      },
      "modifiedAt": {
        "type": "date",
        "format": "yyyy-MM-dd HH:mm:ss"
      }
    }
  }
}

PUT test/_doc/0
{
  "id": 0,
  "status": "validated",
  "modifiedAt": "2021-10-18 10:48:08"
}

PUT test/_doc/1
{
  "id": 123,
  "status": "validated",
  "modifiedAt": "2021-10-18 10:48:08"
}

PUT test/_doc/2
{
  "id": 123,
  "status": "processing",
  "modifiedAt": "2021-10-18 10:52:08"
}

PUT test/_doc/3
{
  "id": 123,
  "status": "finished",
  "modifiedAt": "2021-10-18 10:55:08"
}

PUT test/_doc/4
{
  "id": 234,
  "status": "validated",
  "modifiedAt": "2021-10-18 10:48:08"
}

PUT test/_doc/5
{
  "id": 234,
  "status": "processing",
  "modifiedAt": "2021-10-18 10:52:08"
}

PUT test/_doc/6
{
  "id": 234,
  "status": "finished",
  "modifiedAt": "2021-10-18 10:55:08"
}

```

Then set the table up with this;

 ![Screen Shot 2021-10-18 at 19.25.26](https://us1.discourse-cdn.com/elastic/original/3X/9/5/95561c662f74be541f2540ca3acca998a3128a1b.png)  
 ![Screen Shot 2021-10-18 at 19.25.38](https://us1.discourse-cdn.com/elastic/original/3X/f/6/f6e4cd9040b303545bfa8b55c746c0f2f552bb3f.png)

---

<div class="post-metadata">

**Author:** ![Farah\_Zaidi](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/farah_zaidi/32/83575_2.png) [@Farah\_Zaidi](https://discuss.elastic.co/u/Farah_Zaidi)\
**Post date:** [October 18, 2021, 10:09am UTC](https://discuss.elastic.co/t/show-records-based-on-last-modified-date-in-kibana/286959/10 "2021-10-18T10:09:05Z")

</div>

```auto
Hi Mark,

Yeah this is the same use case but I need to count the total number of unique ids with status as failed.
I tried above approach, but I am still getting the duplicate values in table (PFA below).
Also if I further add filter with status as validated , it will still show the id whose last status is Finished already

Also currently i have mappings as below-
{
   "my-index":{
      "mappings":{
         "properties":{
            "payload":{
               "properties":{
                  "ID":{
                     "type":"text",
                     "fields":{
                        "keyword":{
                           "type":"keyword",
                           "ignore_above":256
                        }
                     },
                     "modifiedAt":{
                        "type":"date"
                     }
                  }
               }
            }
         }
      }
   }
}
Do we need to update something in mappings as well.

TIA

```

---

<div class="post-metadata">

**Author:** ![Farah\_Zaidi](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/farah_zaidi/32/83575_2.png) [@Farah\_Zaidi](https://discuss.elastic.co/u/Farah_Zaidi)\
**Post date:** [October 18, 2021, 10:34am UTC](https://discuss.elastic.co/t/show-records-based-on-last-modified-date-in-kibana/286959/11 "2021-10-18T10:34:46Z")

</div>

![image](https://us1.discourse-cdn.com/elastic/original/3X/5/1/51c00c6c108d8b6f8fa35c892950d809fd19f4ec.png)

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [November 15, 2021, 10:35am UTC](https://discuss.elastic.co/t/show-records-based-on-last-modified-date-in-kibana/286959/12 "2021-11-15T10:35:38Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
