Elastic-agent ingest interval

Elastic Stack Elastic Agent
,
1

Hi people!
I need your help with a requirement.

I installed an elastic-agent 8.11.4 on a windows server to read and send data from .csv files by integrating fleet 'custom logs'.

The agent was installed by default.

Currently the agent reads and ingests the data every 1 hour, but I need this action to be done every 15 minutes.

I have searched for information and I can't find the key.

Is there any parameter that I can modify so that the agent sends the data of the csv reports every 15 minutes?

Thank you very much!

2

Hi @nml1988
Sorry we didn't see this.. have you solved this?

Can you share your configuration?

How much data is in the csv files?

How are the written and updae

3

Hi @nml1988

do you still need help on this?

If you are using Custom Logs Filestream

The file is scanned every 10s by default.

The default is 10s

prospector.scanner.check_interval How often Filebeat checks for new files in the paths that are specified for harvesting. For example, if you specify a glob like /var/log/*, the directory is scanned for files using the frequency specified by check_interval. Specify 1s to scan the directory as frequently as possible without causing Filebeat to scan too frequently. We do not recommend to set this value <1s.
If you require log lines to be sent in near real time do not use a very low check_interval but adjust close.on_state_change.inactive so the file handler stays open and constantly polls your files.
The default setting is 10s.

So in short if you post a new file ... it should be read within 10s

If you append new lines to an existing file it should be read almost immediately like tail

If you are using the Deprecated Log Intput it is also 10s