# Kibana Data Table filtered data missed

**URL:** https://discuss.elastic.co/t/kibana-data-table-filtered-data-missed/49255
**Category:** Kibana
**Created:** [May 5, 2016, 4:57am UTC](https://discuss.elastic.co/t/kibana-data-table-filtered-data-missed/49255 "2016-05-05T04:57:03Z")
**Posts on this page:** 8
**Page:** 1

<div class="post-metadata">

### Author: ![Deep\_Ch](https://avatars.discourse-cdn.com/v4/letter/d/9de0a6/32.png) [@Deep\_Ch](https://discuss.elastic.co/u/Deep_Ch)
#### Post date: [May 5, 2016, 4:57am UTC](https://discuss.elastic.co/t/kibana-data-table-filtered-data-missed/49255/1 "2016-05-05T04:57:04Z")

</div>

Hi All, I have some raw message have been parsed with below fields:

EventID:  
EventTime:  
Hostname:  
Message:

Kibana index name begins with logstash-xxx.

The question is now I am using Kibana 4.5.0 and visualize my data with Metric and Data Table. I can easily filtered my data with EventID say 676 and shows total counts in Metric is correct. But the question is that it has a wrong count show in Data Table. An example is just like below:

Enable Filter: EventID:676

Metric View  
1141 \<-- This is correct number of entries.

Data Table  
EveintID.raw Message.raw Count  
676 Some message 323 \<-- (only 323 showed but total count is 1141)

I have tried not to use Message.raw field and it shows correct count 1141. I tried to review the log in Discovery view, it show that was parsed successfully in message field. Seems parsing has no problem but the data view exist missing counts in Data Table.

Thank you in advance for your help with this!

Best,  
Deep

---

<div class="post-metadata">

### Author: ![spalger](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/spalger/32/14092_2.png) [@spalger](https://discuss.elastic.co/u/spalger)
#### Post date: [May 5, 2016, 11:30pm UTC](https://discuss.elastic.co/t/kibana-data-table-filtered-data-missed/49255/2 "2016-05-05T23:30:06Z")

</div>

Based on your example it looks like the data table is grouping events by their raw Message, meaning that the count `323` is simply the number of events with EventID 676 and the same message. What if you add a filter for the message.raw too, does the metric view match then?

Also, can you include a screenshot by chance?

---

<div class="post-metadata">

### Author: ![Deep\_Ch](https://avatars.discourse-cdn.com/v4/letter/d/9de0a6/32.png) [@Deep\_Ch](https://discuss.elastic.co/u/Deep_Ch)
#### Post date: [May 6, 2016, 4:31am UTC](https://discuss.elastic.co/t/kibana-data-table-filtered-data-missed/49255/3 "2016-05-06T04:31:57Z")

</div>

Thanks for some thoughts!

I found it is the Size value which made those entries didn't show completely. I have set it to 1000 and sum it up then the total count is now correct.

Value set to 1000

 ![](https://us1.discourse-cdn.com/elastic/original/2X/e/eeedd450be928c4396bbf3eb950728959bbb0b3c.PNG)

But now there is another question. As below screen shows, I have many event ID. If I enable the filter for EventID 675, total logs is 593. The log and message showed correctly in the Data Table. While I enable the filter Event ID 673, total count is 1171 but no message can show out. I go the Discover tab and search the log with EventId 673, the message field contains the message in message filed, seems has been parsed with no problem. Appreciate you help.

No filter applied:

 ![](https://us1.discourse-cdn.com/elastic/original/2X/3/3f28d9f885890276cbc219e98e7fb62d22fc925a.PNG)

Filter: EventID: 675

 ![](https://us1.discourse-cdn.com/elastic/original/2X/4/49e3a932d4e06bc76241d882c5371d999e16a089.PNG)

Filter: EventID: 673

 ![](https://us1.discourse-cdn.com/elastic/original/2X/c/cd854c7220a74013e2dade21b3126ca535101989.PNG)

Log in Discover tab:

 ![](https://us1.discourse-cdn.com/elastic/original/2X/0/063bbff8c651e0f3eb2c6bb7862a302e997409ec.PNG)  
Thanks,  
Deep

---

<div class="post-metadata">

### Author: ![shaunak](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/shaunak/32/6643_2.png) [@shaunak](https://discuss.elastic.co/u/shaunak)
#### Post date: [May 6, 2016, 12:39pm UTC](https://discuss.elastic.co/t/kibana-data-table-filtered-data-missed/49255/4 "2016-05-06T12:39:35Z")

</div>

Hi, when you are filtering on EventID = 673, could you click the little `^` at the bottom of the MSG visualization panel? This will bring up a spy panel which has useful debugging information. In this spy panel, please click the Request button. This will show the request being sent to Elasticsearch. Please paste this request over here so we can debug further. Thanks!

---

<div class="post-metadata">

### Author: ![Deep\_Ch](https://avatars.discourse-cdn.com/v4/letter/d/9de0a6/32.png) [@Deep\_Ch](https://discuss.elastic.co/u/Deep_Ch)
#### Post date: [May 9, 2016, 7:05am UTC](https://discuss.elastic.co/t/kibana-data-table-filtered-data-missed/49255/5 "2016-05-09T07:05:10Z")

</div>

Hi , the request being sent to ES like below. Thanks!

{  
"query": {  
"filtered": {  
"query": {  
"query\_string": {  
"query": "_",  
"analyze\_wildcard": true  
}  
},  
"filter": {  
"bool": {  
"must": [  
{  
"$state": {  
"store": "appState"  
},  
"query": {  
"match": {  
"EventID.raw": {  
"query": "673",  
"type": "phrase"  
}  
}  
}  
},  
{  
"query": {  
"query\_string": {  
"analyze\_wildcard": true,  
"query": "_"  
}  
}  
},  
{  
"range": {  
"@timestamp": {  
"gte": 1461212310614,  
"lte": 1461233028309,  
"format": "epoch\_millis"  
}  
}  
}  
],  
"must\_not": []  
}  
}  
}  
},  
"size": 0,  
"aggs": {  
"2": {  
"terms": {  
"field": "EventID.raw",  
"size": 1000,  
"order": {  
"\_count": "desc"  
}  
},  
"aggs": {  
"3": {  
"terms": {  
"field": "Message.raw",  
"size": 1000,  
"order": {  
"\_count": "desc"  
}  
}  
}  
}  
}  
}  
}

---

<div class="post-metadata">

### Author: ![spalger](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/spalger/32/14092_2.png) [@spalger](https://discuss.elastic.co/u/spalger)
#### Post date: [May 9, 2016, 9:35pm UTC](https://discuss.elastic.co/t/kibana-data-table-filtered-data-missed/49255/6 "2016-05-09T21:35:45Z")

</div>

Is it possible that the events with eventID 673 have a `Message` but no `Message.raw`?

---

<div class="post-metadata">

### Author: ![Deep\_Ch](https://avatars.discourse-cdn.com/v4/letter/d/9de0a6/32.png) [@Deep\_Ch](https://discuss.elastic.co/u/Deep_Ch)
#### Post date: [May 10, 2016, 10:45am UTC](https://discuss.elastic.co/t/kibana-data-table-filtered-data-missed/49255/7 "2016-05-10T10:45:48Z")

</div>

As it is using dynamic mapping , and the default behaviors of ES that query from Message field is not allowed. And It return successful eventID 675 with the same request from Message.raw. Is there any misconfiguration or praising issue I made or it is the fault of ES?

---

<div class="post-metadata">

### Author: ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)
#### Post date: [July 6, 2017, 1:53pm UTC](https://discuss.elastic.co/t/kibana-data-table-filtered-data-missed/49255/8 "2017-07-06T13:53:51Z")

</div>


