Experiences with Logstash Redis spiped


(Simon) #1

Hi everyone,

does anybody have some knowledge regarding the abovementioned subject?
My setup is the following:

Filebeat/Syslog --> Logstash(A) --> RabbitMQ --> |Firewall| --> Logstash(B) --> Elasticsearch <-- Kibana

I'd like to replace RabbitMQ by Redis. Unfortunately Redis has no encryption. Thus I want to use spiped. There is just one speciality. The connection must be initiated by Logstash(B).

Is it possible to fulfill these requirements with Logstash?

Filebeat/Syslog --> Logstash(A) --> Redis (spiped)--> |Firewall| --> Logstash(B) --> Elasticsearch <-- Kibana

Thank you in advance.

Best regards,
Simon


(Magnus Bäck) #2

Based on the information you've given I suppose this should work, but do you have any specific concerns?


(Simon) #3

Where does Logstash (B) know that it is suppose to use spiped? There is no input module.


(Magnus Bäck) #4

Configure Logstash to connect to the local spiped daemon which is wired to connect to the spiped daemon on the Redis server, which in turn is wired to the Redis daemon on the same machine.

Logstash (B) -> spiped (B) -> spiped (A) -> Redis (A)


(Simon) #5

In theory it's simple, tough you need two redis instances on both sides.

Unfortunately my config doesn't functions and I wont continue on this redis setup.
I found another solution with Apache Kafka.

Thank's anyway!


(system) #6

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.