Pipeline-to-Pipeline in 6.2.4


(Tarmendeos) #1

Hello! I'm relatively new to the ELK stack, and I've got a problem where I am in need of the output-isolator pattern described in https://www.elastic.co/guide/en/logstash/current/pipeline-to-pipeline.html, but the feature has just been released on 6.5 and I am still on 6.2.4.

Is there a viable workaround without upgrading to 6.5 at the moment? Is it possible to say, use the file-output plugin and multiple pipelines to duplicate the pipeline-to-pipeline?

For example,

config/pipelines.yml

  • pipeline.id: intake
    queue.type: persisted
    config.string: |
    input { beats { port => 5044 } }
    output { file { path => file1 } file { path => file2 } }
  • pipeline.id: buffered-es
    queue.type: persisted
    config.string: |
    input { file { path => file1} }
    output { elasticsearch { } }
  • pipeline.id: buffered-http
    queue.type: persisted
    config.string: |
    input { file { path => file2} }
    output { http { } }

Thanks in advance!