Using logstash v6.2.1
I have setup 2 pipelines each getting input using a web socket input plugin. My problem is at a time only one pipeline seems to be making connection to web socket server, meaning data is collected only for pipeline1 or pipeline2, but never for both.
I have also noticed that after starting the logstash it's several minutes before an attempt is made to connect to web socket server, is that normal?
Greatly appreciate any help i can get to resolve this. Thanks
Below is the configuration for pipelines,yml file
indent preformatted text by 4 spaces
- pipeline.id: pipeline1
pipeline.workers: 2
pipeline.batch.size: 100
path.config: "/etc/logstash/conf.d/my_conf1.conf" - pipeline.id: pipleline2
pipeline.workers: 2
pipeline.batch.size: 100
path.config: "/etc/logstash/conf.d/my_conf2.conf"
and conf 1.conf reads
indent preformatted text by 4 spaces
input {
websocket {
url => "ws://localhost:8081/?type=v1¶m1=ALL¶m2=ALL¶m3=value3"
codec => "json"
id => "ws1"
}
}
output {
elasticsearch { hosts => "localhost:9200"
index => "ws1"}
stdout { codec => rubydebug }
}
and conf 2.conf reads
indent preformatted text by 4 spaces
input {
websocket {
url => "ws://localhost:8081/?type=v2¶m1=ALL¶m2=ALL¶m3=value4"
codec => "json"
id => "ws2"
}
}
output {
elasticsearch { hosts => "localhost:9200"
index => "ws2"}
stdout { codec => rubydebug }
}