There are a couple of files in /opt/logs/*.0 and the file beat reads them properly but does not print all the lines and sends them to the output file . Is there a problem with my matching ? How can I make sure everything from 2 files stdout.0 and stderr.0 from /opt/logs/ is read and sent to the /apps/logs/abcd/web_xxx.log ?
filebeat.inputs:
- type: log
enabled: true
paths:
- /opt/logs/*.0
json.keys_under_root: true
json.add_error_key: false
json.ignore_decoding_error: true
json.overwrite_keys: true
json.message_key: message
json.message_key: msg
multiline:
pattern: '^[[:digit:]]{4}-[[:digit:]]{2}-[[:digit:]]{2}'
negate: true
match: after
fields:
loggingApplicationId: abcd
processors:
- drop_fields:
fields: ["beat", "offset", "type"]
output.file:
path: "/apps/logs/abcd"
filename: web_xxx.log
rotate_every_kb: 1000000
permissions: 0644
codec.json:
escape_html: false
logging.level: error
logging.metrics.enabled: false
logging.to_stderr: true
logging.json: true