Live updating file

Elastic Stack Beats
1

Hi everyone,

I need to update an inputed file which size doesn't change. It consists in a csv file that will be changing every 3 hours. I am doing a test changing manually the csv file by the new one (same size, but different content) and there is no change in kibana.

My question is:

Do i have to specify something in the .yml to tell filebeat to be waiting for new changes?

Thank you so much in advance.

There is my filebeat.yml:

    filebeat.inputs:

    - type: log
      enabled: true
      close_eof: true
      paths:
        - C:\Users\MQUEROLG\Desktop\136.129.3.91\CsvExport\StatisticError.csv
      encoding: utf-16le-bom

    - type: filestream

      enabled: false

      paths:
        - c:\temp\*.logx
        
    setup.ilm.enabled: false
    setup.template.enabled: false

    output.elasticsearch:

        ssl.verification_mode: none
        hosts: ["##################"]
        
        username: "#####"
        password: "###########"
        index: "test2_dev_sca"

    processors:
      - decode_csv_fields:
          fields:
            message: decoded_csv_arr
          separator: "\t"
          ignore_missing: true
          overwrite_keys: true
          trim_leading_space: true
          fail_on_error: false

      - script:
          lang: javascript
          id: convert_csv_into_json
          file: E:\filebeat-7.11.1-windows-x86\convert_csv_to_json.js

      - drop_fields:
          fields: ["decoded_csv_arr"] 
          
    logging.level: debug
2

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.