after 2 days running, EOF came out also with the configuration without load_balance.
this is the stats from kibana -> I connected the filebeat log itself (it has been cut but the search is in kibana is "EOF")
it seems that they appear especially during night (off-load period)
I just checkd: logs are always the same as above, nothing on logstash side, EOF and ignore_older on FileBeat side (see topic https://discuss.elastic.co/t/filebeat-file-is-falling-under-ignore-older/61210/3 )
in filebeat i have lot of prospectors with this configuration
- input_type: log
paths:
- d:Logger\2
exclude_lines: ["^\\s*$"]
include_lines: ["^([a-z]|[A-Z])"]
fields:
catena: 11
fields_under_root: true
ignore_older: 10m
close_inactive: 2m
clean_inactive: 15m
document_type: log2
general fb conf are the following
output.logstash:
hosts: ["10.10.10.10"]
template.name: "filebeat"
template.path: "filebeat.template.json"
template.overwrite: false
in LS i have the following
LS_HEAP_SIZE="8g"
LS_OPTS="-b 1000 -r --verbose"
LS_JAVA_OPTS="{LS_JAVA_OPTS} -Djava.io.tmpdir={LS_HOME} -Xms8g"
I've checked di JVM stats and they seems to be very good
LS1
LS2
LS3
