i have problem in sending logs with filebeat to elasticsearch . it sends data and pauses and after miliseconds it sends again data .
i set this config :
scan_frequency: 10s
close_inactive: 20s
ignore_older: 30s
harvester_buffer_size: 32768
json.keys_under_root: true
json.add_error_key: true
json.message_key: true
backoff: 1s
max_backoff: 2s
bulk_max_size: 5000
workers: 4
queue.mem:
events: 10000
flush.min_events: 2048
flush.timeout: 1s