Setting multiple pipelines for elasticserach.output

Elastic Stack Beats
,
1

Hello,

Is It possible to use for example metricbeat.yml config file for setting multiple ingest node pipelines for the same document/index? I triend something like this but only the first one work.

#-------------------------- Elasticsearch output ------------------------------
output.elasticsearch:
  # Array of hosts to connect to.
  hosts: ["https://ip:9200"]
  username: "${ES_LOG}"
  password: "${ES_PWD}"
  ssl.certificate_authorities: [.crt]
  ssl.certificate: ".crt"
  ssl.key: ".key"	
 # Protocol - either `http` (default) or `https`.
  protocol: "https"
  pipelines:
  - pipeline : default-additional-pipeline
    and:
  - pipeline : service-level-field-name-pipeline

or something like this

  pipelines:
  - pipeline : default-additional-pipeline
  - pipeline : service-level-field-name-pipeline

but in both cases, only the first one is applied.

2

Hi @Adriann

No that is not supported However there is great way to do this.

You just create a top level pipeline that then can call sub pipelines even with conditionals it like building modular code. See here for and example.