# Kibana Time Troubles

**URL:** <https://discuss.elastic.co/t/kibana-time-troubles/17378>\
**Category:** Elasticsearch\
**Created:** [May 6, 2014, 8:32pm UTC](https://discuss.elastic.co/t/kibana-time-troubles/17378 "2014-05-06T20:32:45Z")\
**Posts on this page:** 3\
**Page:** 1

<div class="post-metadata">

**Author:** ![Tate\_Eskew](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/tate_eskew/32/1570_2.png) [@Tate\_Eskew](https://discuss.elastic.co/u/Tate_Eskew)\
**Post date:** [May 6, 2014, 8:32pm UTC](https://discuss.elastic.co/t/kibana-time-troubles/17378/1 "2014-05-06T20:32:45Z")

</div>

Hello,  
Maybe someone can help me. My setup:  
AWS Servers using rsyslog (UTC time) \> Physical server in datacenter  
central syslog-ng server (CST).  
Logstash shipper is running on the central syslog-ng box (CST). It grabs  
the events coming in, mangles them, throws them into redis. Logstash  
indexer on another box grabs them out of redis, shoves them in  
elasticsearch.

Everything works as expected for months now, the only problem I have is  
that the display in Kibana doesn't show the log events for 5 hours because  
of the Logstash shipper being CST (5 hours behind). Any idea on how to get  
it to display immediately? Logs display immediately if I send to the  
central log server from a server that is CST as well. Here is a sample from  
an AWS box (UTC) that is picked up by the central log server (CST)

Is there any way to get Kibana to show the events as they come in  
correctly? We have lots of physical machines in our datacenters and they  
are all set to CST, but all of our AWS instances are set to UTC. As of  
right now, we don't want to change the central syslog server's timezone to  
UTC since it still resides in one of our data centers.

Any ideas? Is this something we should try to fix at the Logstash config or  
is this a display fix for Kibana?

Here is a sample from an AWS box (UTC) that is picked up by the central log server (CST) - Displays 5 hours later/incorrectly

{  
"\_index": "logstash-2014.05.06",  
"\_type": "syslog",  
"\_id": "mZvpk-\_9T4WgA2zxlsxogA",  
"\_score": null,  
"\_source": {  
"@version": "1",  
"@timestamp": "2014-05-05T20:01:26.000-05:00",  
"type": "syslog",  
"syslog\_pri": "163",  
"syslog\_program": "ubuntu",  
"received\_at": "2014-05-05 20:01:27 UTC",  
"syslog\_severity\_code": 3,  
"syslog\_facility\_code": 20,  
"syslog\_facility": "local4",  
"syslog\_severity": "error",  
"@source\_host": "p-aws-emmaplatformsingle01",  
"@message": "trustinme",  
"@host": "p-aws-emmaplatformsingle01"  
},  
"sort": [  
1399338086000  
]  
}

Here is a sample from a physical machine in one of our data centers (CST) that is picked up by the central logs server (CST) - Diplays instantly/correctly

{  
"\_index": "logstash-2014.05.06",  
"\_type": "syslog",  
"\_id": "SjWn9aJWRGKeshylyp1j2Q",  
"\_score": null,  
"\_source": {  
"@version": "1",  
"@timestamp": "2014-05-06T14:01:52.000-05:00",  
"type": "syslog",  
"syslog\_pri": "13",  
"syslog\_program": "teskew",  
"received\_at": "2014-05-06 19:01:53 UTC",  
"syslog\_severity\_code": 5,  
"syslog\_facility\_code": 1,  
"syslog\_facility": "user-level",  
"syslog\_severity": "notice",  
"@source\_host": "p-bna-apix01",  
"@message": "trustinme",  
"@host": "p-bna-apix01"  
},  
"sort": [  
1399402912000  
]  
}

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/fb88791b-1231-4db9-8888-5afd5c18d7a2%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/fb88791b-1231-4db9-8888-5afd5c18d7a2%40googlegroups.com).  
For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).

---

<div class="post-metadata">

**Author:** ![Tate\_Eskew](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/tate_eskew/32/1570_2.png) [@Tate\_Eskew](https://discuss.elastic.co/u/Tate_Eskew)\
**Post date:** [May 12, 2014, 2:58pm UTC](https://discuss.elastic.co/t/kibana-time-troubles/17378/2 "2014-05-12T14:58:28Z")

</div>

Any ideas here?

On Tuesday, May 6, 2014 3:32:45 PM UTC-5, Tate Eskew wrote:

> Hello,  
> Maybe someone can help me. My setup:  
> AWS Servers using rsyslog (UTC time) \> Physical server in datacenter  
> central syslog-ng server (CST).  
> Logstash shipper is running on the central syslog-ng box (CST). It grabs  
> the events coming in, mangles them, throws them into redis. Logstash  
> indexer on another box grabs them out of redis, shoves them in  
> elasticsearch.
> 
> Everything works as expected for months now, the only problem I have is  
> that the display in Kibana doesn't show the log events for 5 hours because  
> of the Logstash shipper being CST (5 hours behind). Any idea on how to get  
> it to display immediately? Logs display immediately if I send to the  
> central log server from a server that is CST as well. Here is a sample from  
> an AWS box (UTC) that is picked up by the central log server (CST)
> 
> Is there any way to get Kibana to show the events as they come in  
> correctly? We have lots of physical machines in our datacenters and they  
> are all set to CST, but all of our AWS instances are set to UTC. As of  
> right now, we don't want to change the central syslog server's timezone to  
> UTC since it still resides in one of our data centers.
> 
> Any ideas? Is this something we should try to fix at the Logstash config  
> or is this a display fix for Kibana?
> 
> Here is a sample from an AWS box (UTC) that is picked up by the central log server (CST) - Displays 5 hours later/incorrectly
> 
> {  
> "\_index": "logstash-2014.05.06",  
> "\_type": "syslog",  
> "\_id": "mZvpk-\_9T4WgA2zxlsxogA",  
> "\_score": null,  
> "\_source": {  
> "@version": "1",  
> "@timestamp": "2014-05-05T20:01:26.000-05:00",  
> "type": "syslog",  
> "syslog\_pri": "163",  
> "syslog\_program": "ubuntu",  
> "received\_at": "2014-05-05 20:01:27 UTC",  
> "syslog\_severity\_code": 3,  
> "syslog\_facility\_code": 20,  
> "syslog\_facility": "local4",  
> "syslog\_severity": "error",  
> "@source\_host": "p-aws-emmaplatformsingle01",  
> "@message": "trustinme",  
> "@host": "p-aws-emmaplatformsingle01"  
> },  
> "sort": [  
> 1399338086000  
> ]  
> }
> 
> Here is a sample from a physical machine in one of our data centers (CST) that is picked up by the central logs server (CST) - Diplays instantly/correctly
> 
> {  
> "\_index": "logstash-2014.05.06",  
> "\_type": "syslog",  
> "\_id": "SjWn9aJWRGKeshylyp1j2Q",  
> "\_score": null,  
> "\_source": {  
> "@version": "1",  
> "@timestamp": "2014-05-06T14:01:52.000-05:00",  
> "type": "syslog",  
> "syslog\_pri": "13",  
> "syslog\_program": "teskew",  
> "received\_at": "2014-05-06 19:01:53 UTC",  
> "syslog\_severity\_code": 5,  
> "syslog\_facility\_code": 1,  
> "syslog\_facility": "user-level",  
> "syslog\_severity": "notice",  
> "@source\_host": "p-bna-apix01",  
> "@message": "trustinme",  
> "@host": "p-bna-apix01"  
> },  
> "sort": [  
> 1399402912000  
> ]  
> }

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/2e5f4158-8954-4ed6-85bf-cc7dc8099454%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/2e5f4158-8954-4ed6-85bf-cc7dc8099454%40googlegroups.com).  
For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [July 6, 2017, 1:30am UTC](https://discuss.elastic.co/t/kibana-time-troubles/17378/3 "2017-07-06T01:30:07Z")

</div>


