# Two load balanced servers send same logs to logstash. But data not update real time in kibana dashboard

**URL:** <https://discuss.elastic.co/t/two-load-balanced-servers-send-same-logs-to-logstash-but-data-not-update-real-time-in-kibana-dashboard/106268>\
**Category:** Beats\
**Tags:** filebeat\
**Created:** [November 3, 2017, 4:13am UTC](https://discuss.elastic.co/t/two-load-balanced-servers-send-same-logs-to-logstash-but-data-not-update-real-time-in-kibana-dashboard/106268 "2017-11-03T04:13:38Z")\
**Posts on this page:** 5\
**Page:** 1

<div class="post-metadata">

**Author:** ![ruranga](https://avatars.discourse-cdn.com/v4/letter/r/97f17d/32.png) [@ruranga](https://discuss.elastic.co/u/ruranga)\
**Post date:** [November 3, 2017, 4:13am UTC](https://discuss.elastic.co/t/two-load-balanced-servers-send-same-logs-to-logstash-but-data-not-update-real-time-in-kibana-dashboard/106268/1 "2017-11-03T04:13:38Z")

</div>

Hi all,

**DESCRIPTION**

I have two logs 2 send to logstash. But these two logs available in two servers due load balancing. So I send them all to centralized logstash server as follows

![image](https://us1.discourse-cdn.com/elastic/original/3X/4/d/4d55e3c34b0aaf7de21923ee8d4774e32a95a772.png)

## following is my filebeat config of two servers

filebeat.prospectors:

- input\_type: log

output.logstash:

hosts: ["172.26.29.126:5044"]

* * *

I start filebeat in both servers as follows

sudo /etc/init.d/filebeat start

Out put is

2017/11/03 03:49:20.024553 beat.go:192: INFO Setup Beat: filebeat; Version: 5.6.3  
2017/11/03 03:49:20.024660 metrics.go:23: INFO Metrics logging every 30s  
2017/11/03 03:49:20.024730 logstash.go:90: INFO Max Retries set to: 3  
2017/11/03 03:49:20.024908 outputs.go:108: INFO Activated logstash as output plugin.  
2017/11/03 03:49:20.025080 publish.go:300: INFO Publisher name: #######  
2017/11/03 03:49:20.025387 async.go:63: INFO Flush Interval set to: 1s  
2017/11/03 03:49:20.025413 async.go:64: INFO Max Bulk Size set to: 2048

**ISSUE**

But my kibana dashboard doesn't update real time. It updates with a lag for both log types. Specially one log get delayed significantly (log\_type1\*.log)

following are real observations

for log\_type1\*.log

current time: 9.40 A.M.  
Updated time in dash board: 8.03 A.M.

 ![image](https://us1.discourse-cdn.com/elastic/original/3X/3/5/351cff063656095b1bccb34ea8300d8c30a1f55a.png)

for log\_type2\*.log

current time: 9.40 A.M.  
Updated time in dash board: 9.35 A.M.

 ![image](https://us1.discourse-cdn.com/elastic/original/3X/2/3/2312d745181144b360c3ae5f13e14c64c7fc709b.png)

Can some one please help me!!!!!

Thanks a lot!

---

<div class="post-metadata">

**Author:** ![ruranga](https://avatars.discourse-cdn.com/v4/letter/r/97f17d/32.png) [@ruranga](https://discuss.elastic.co/u/ruranga)\
**Post date:** [November 3, 2017, 4:39am UTC](https://discuss.elastic.co/t/two-load-balanced-servers-send-same-logs-to-logstash-but-data-not-update-real-time-in-kibana-dashboard/106268/2 "2017-11-03T04:39:01Z")

</div>

Please help me. This is bit urgent. 🙁

---

<div class="post-metadata">

**Author:** ![Christian\_Dahlqvist](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/christian_dahlqvist/32/4617_2.png) [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)\
**Post date:** [November 3, 2017, 6:57am UTC](https://discuss.elastic.co/t/two-load-balanced-servers-send-same-logs-to-logstash-but-data-not-update-real-time-in-kibana-dashboard/106268/3 "2017-11-03T06:57:50Z")

</div>

What does it look like if you change the time-picker to show the `last 4 hours` with a 30 second refresh interval instead of `today`? What is the load on the host where Elasticsearch, Kibana and Elasticsearch is installed (CPU and disk I/O)? What does your Logstash config look like?

---

<div class="post-metadata">

**Author:** ![ruranga](https://avatars.discourse-cdn.com/v4/letter/r/97f17d/32.png) [@ruranga](https://discuss.elastic.co/u/ruranga)\
**Post date:** [November 3, 2017, 9:03am UTC](https://discuss.elastic.co/t/two-load-balanced-servers-send-same-logs-to-logstash-but-data-not-update-real-time-in-kibana-dashboard/106268/4 "2017-11-03T09:03:25Z")

</div>

Actually i thought issue sorted! But still one specific log is getting lag! Can any one please tell me a possible reason for this? Please refer the above attached diagram and other information to get an idea,

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [December 1, 2017, 9:03am UTC](https://discuss.elastic.co/t/two-load-balanced-servers-send-same-logs-to-logstash-but-data-not-update-real-time-in-kibana-dashboard/106268/5 "2017-12-01T09:03:44Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
