Access pipeline id inside pipeline config

Elastic Stack Logstash
1

Hi there elastic community !

As I stumbled upon an idea that hasn't been addressed here (or at least I haven't found such topic) - here goes my first post !

I am looking for a way to access pipeline.id option (from pipelines.yml) inside logstash config file that has been configured under path.config field. For example, for entry:

  • pipeline.id: oracle_table_1
    path.config: "/usr/share/logstash/pipeline/test.config"
    pipeline.workers: 1
  • pipeline.id: oracle_table_2
    path.config: "/usr/share/logstash/pipeline/test.config"
    pipeline.workers: 1

I'd like to reuse test.config for collecting data from multiple different oracle tables. For this config I'd like download data from oracle_table_1 table to index test_oracle_table_1 amd data from oracle_table_2 to index test_oracle_table_2. I'd like to perform it generically instead of creating as many configs as tables.

Is there a way to achieve this ?

Many thanks for help,
Mariusz

2

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.