Ingest Pipeline, set field derived from another

Elastic Stack Elasticsearch
1

Hello,

i am currently building a new pipeline for filebeat where we ingest a lot of different logfiles, e.g.

  • /log/appname1.log
  • /log/appname2.log
  • etc

now i want a field in every document that says:

  • app: appname1

So, is it possible to parse an existing field (log.file.path: /log/appname1.log) with an regex and use the result in a new field?

2

Hi,

You can use the grok processor for that: Grok processor | Elasticsearch Reference [7.11] | Elastic

You can use the Kibana grok debugger(available under Dev Tools) to test your pattern.

Best regards
Wolfram

3

great, it works quite well for me

Thanks!