# Kibana missing chunks of data by time **URL:** \ **Category:** Kibana\ **Created:** [November 8, 2017, 11:52pm UTC](https://discuss.elastic.co/t/kibana-missing-chunks-of-data-by-time/106947 "2017-11-08T23:52:21Z")\ **Posts on this page:** 6\ **Page:** 1
**Author:** ![jeopardy](https://avatars.discourse-cdn.com/v4/letter/j/e0b2c6/32.png) [@jeopardy](https://discuss.elastic.co/u/jeopardy)\ **Post date:** [November 8, 2017, 11:52pm UTC](https://discuss.elastic.co/t/kibana-missing-chunks-of-data-by-time/106947/1 "2017-11-08T23:52:21Z")
Hey all. New user here. Trying out Kibana, particularly with a focus on X-pack features. Right now, I'm running into an issue when I visualize my data. It seems that I'm missing chunks of hours from my data, which spans the course of two weeks. In particular, my Logstash config specifies date as "yyyy-MM-dd'T'H:m". Dates can look like 2017-10-10T15:0 to indicate 3PM on October 10, or 2017-10-10T2:0 to indicate 2AM on October 10. The data I'm looking at exists for every 10 minute segment in the original .csv file, meaning you'll see 2017-10-10T15:0, 2017-10-10T15:10, 2017-10-10T15:20.... and so forth, from October 10 to October 23. However, when I query and/or visualize my data in Kibana, I seem to be missing data around the 4PM-3AM mark every night, give or take 30 minutes. Here's what a sample of the data looks like in the Kibana Visualize tab (y-axis is count of records at each time slot): ![image](https://us1.discourse-cdn.com/elastic/original/3X/c/c/cc426c1188a75aec341ba9ca602dc9fbe363e2f3.png) As you can see, we're missing data from 10/10 4:30PM to 10/11 3AM, and then again from 10/11 4:30PM to 10/12 3AM. However, screenshotting my .csv, the data clearly exists at those times. ![image](https://us1.discourse-cdn.com/elastic/original/3X/2/d/2d21da4595b6d58186ddac711cdb9710d2445cf8.png) Does anybody know why the data is missing for these evenings? It definitely exists in the .csv, but for some reason, Kibana isn't detecting it. It's causing my time series to have these unexplained gaps. I'm not sure if it has to do with how timestamps are being parsed or so. I waited until the data finished indexing before proceeding with visualization and any machine learning in X-pack. ---
**Author:** ![Christian\_Dahlqvist](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/christian_dahlqvist/32/4617_2.png) [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)\ **Post date:** [November 9, 2017, 8:06am UTC](https://discuss.elastic.co/t/kibana-missing-chunks-of-data-by-time/106947/2 "2017-11-09T08:06:18Z")
What do the events look like in Kibana? Is the data parsed correctly? Does the `@timestamp` match the timestamp from the csv file? ---
**Author:** ![jeopardy](https://avatars.discourse-cdn.com/v4/letter/j/e0b2c6/32.png) [@jeopardy](https://discuss.elastic.co/u/jeopardy)\ **Post date:** [November 9, 2017, 8:45pm UTC](https://discuss.elastic.co/t/kibana-missing-chunks-of-data-by-time/106947/3 "2017-11-09T20:45:52Z")
@timestamp matches the csv timestamp perfectly. May you clarify your other two questions? The data that clearly exists in the .csv just doesn't seem to appear in Kibana. ---
**Author:** ![Christian\_Dahlqvist](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/christian_dahlqvist/32/4617_2.png) [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)\ **Post date:** [November 9, 2017, 8:48pm UTC](https://discuss.elastic.co/t/kibana-missing-chunks-of-data-by-time/106947/4 "2017-11-09T20:48:24Z")
Can you show an example of an event where the @timestamp field matches the csv timestamp? What is the mapping for the @timestamp field? Elasticsearch and Kibana requires all timestamps to be in UTC time zone. Is this the case for your events? ---
**Author:** ![jeopardy](https://avatars.discourse-cdn.com/v4/letter/j/e0b2c6/32.png) [@jeopardy](https://discuss.elastic.co/u/jeopardy)\ **Post date:** [November 9, 2017, 8:50pm UTC](https://discuss.elastic.co/t/kibana-missing-chunks-of-data-by-time/106947/5 "2017-11-09T20:50:46Z")
![image](https://us1.discourse-cdn.com/elastic/original/3X/c/2/c2182f2429d39ac42feb3d3a031aab144b4e985f.png) Here's a screenshot from the Discover tab of both @timestamp and timestamp columns. ---
**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\ **Post date:** [December 7, 2017, 8:50pm UTC](https://discuss.elastic.co/t/kibana-missing-chunks-of-data-by-time/106947/6 "2017-12-07T20:50:56Z")
This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.