# Logs shipping to redis queue

**URL:** <https://discuss.elastic.co/t/logs-shipping-to-redis-queue/44875>\
**Category:** Logstash\
**Created:** [March 19, 2016, 12:16am UTC](https://discuss.elastic.co/t/logs-shipping-to-redis-queue/44875 "2016-03-19T00:16:18Z")\
**Posts on this page:** 8\
**Page:** 1

<div class="post-metadata">

**Author:** ![bishaka](https://avatars.discourse-cdn.com/v4/letter/b/e480ec/32.png) [@bishaka](https://discuss.elastic.co/u/bishaka)\
**Post date:** [March 19, 2016, 12:16am UTC](https://discuss.elastic.co/t/logs-shipping-to-redis-queue/44875/1 "2016-03-19T00:16:18Z")

</div>

I'm shipping some logs from server 1 to server 2 using logstash-shipper and receiving the message on redisqueue on server 2

the config file i'm using is this:

input {  
file {  
path =\> "/path/to/my/logfile.log"  
type =\> "apache"  
}  
}

output {  
redis { host =\> "myserverIP" data\_type =\> "list" key =\> "logstash" }  
}

The log file contains 29 logs...however logstash shipper stops after sending 3 logs..why is that?  
I do not see any error messages either. Is it some sort of a delay issue somewhere?

---

<div class="post-metadata">

**Author:** ![ebuildy](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/ebuildy/32/6070_2.png) [@ebuildy](https://discuss.elastic.co/u/ebuildy)\
**Post date:** [March 19, 2016, 1:25pm UTC](https://discuss.elastic.co/t/logs-shipping-to-redis-queue/44875/2 "2016-03-19T13:25:23Z")

</div>

Did you test with a stdout output?

Maybe you must "reset" the input file syncdb (by changing its path).

---

<div class="post-metadata">

**Author:** ![bishaka](https://avatars.discourse-cdn.com/v4/letter/b/e480ec/32.png) [@bishaka](https://discuss.elastic.co/u/bishaka)\
**Post date:** [March 19, 2016, 11:12pm UTC](https://discuss.elastic.co/t/logs-shipping-to-redis-queue/44875/3 "2016-03-19T23:12:04Z")

</div>

Ok, after fiddling around a little...it was shipping logss.  
however, it was extremely slow..what could be there reason behind it?

Another thing, After i recieved the logs on server 2 through redisqueue..i created a logstash config file...indexed at elasticsearch and displayed on kibana..

However, after some time..the logs were gone from kibana magically...(there were 5 logs..and which each refresh..some would disappear)

I don't understand what's happening here.

---

<div class="post-metadata">

**Author:** ![ebuildy](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/ebuildy/32/6070_2.png) [@ebuildy](https://discuss.elastic.co/u/ebuildy)\
**Post date:** [March 20, 2016, 3:42pm UTC](https://discuss.elastic.co/t/logs-shipping-to-redis-queue/44875/4 "2016-03-20T15:42:07Z")

</div>

How do you measure "slowness"?

About Kibana, check time window (UI, on top right).

---

<div class="post-metadata">

**Author:** ![ebuildy](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/ebuildy/32/6070_2.png) [@ebuildy](https://discuss.elastic.co/u/ebuildy)\
**Post date:** [March 20, 2016, 3:50pm UTC](https://discuss.elastic.co/t/logs-shipping-to-redis-queue/44875/5 "2016-03-20T15:50:01Z")

</div>

Also check ignore\_older parameter of input file.

---

<div class="post-metadata">

**Author:** ![bishaka](https://avatars.discourse-cdn.com/v4/letter/b/e480ec/32.png) [@bishaka](https://discuss.elastic.co/u/bishaka)\
**Post date:** [March 21, 2016, 2:02am UTC](https://discuss.elastic.co/t/logs-shipping-to-redis-queue/44875/6 "2016-03-21T02:02:45Z")

</div>

omg it works! Thanks so much!!!!!!!!!!!!!

---

<div class="post-metadata">

**Author:** ![bishaka](https://avatars.discourse-cdn.com/v4/letter/b/e480ec/32.png) [@bishaka](https://discuss.elastic.co/u/bishaka)\
**Post date:** [March 21, 2016, 2:24am UTC](https://discuss.elastic.co/t/logs-shipping-to-redis-queue/44875/7 "2016-03-21T02:24:10Z")

</div>

I have 28 logs in total...for some reason it is only shipping 15 of 28 logs...

This is how my config file looks... logstash-shipper.conf

input {  
file {  
path =\> ["/path/to/logs/sample.log"]  
type =\> "syslog"  
start\_position =\> "beginning"  
sincedb\_path =\> "/dev/null"  
ignore\_older =\> 0  
}  
}

output {  
stdout { codec =\> rubydebug }  
redis { host =\> "10._._.\*" data\_type =\> "list" key =\> "rediskey" }  
}

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [July 6, 2017, 5:06am UTC](https://discuss.elastic.co/t/logs-shipping-to-redis-queue/44875/8 "2017-07-06T05:06:10Z")

</div>