Sending json data into elasticsearch using filebeat and logstash

mgolubov55 · January 8, 2019, 6:14pm

I have a utility written in C#/Ado.Net that produces a text file in the following (json) format:

[{"Description":"Import AgoraOrder - APAC","NextStartTime":"2019-01-08T15:05:00","LastRunTime":"2019-01-07T15:05:26.78","JobRanToday0":-1,"fStatusTypeId":3,"LastUpdateTime":"2019-01-07T15:05:26.777"},{"Description":"Toolbox to NBF Stop","NextStartTime":"2019-01-08T23:45:00","LastRunTime":"2019-01-07T23:45:16.153","JobRanToday0":-1,"fStatusTypeId":null,"LastUpdateTime":null}]

The text file is overwritten many times during the day, so I need to automate the process of sending the data to elasticsearch via filebeat and logstash.

What is the proper configuration for filebeat and logstash that will enable this:
- filebeat.yml and the logstash pipeline

system · February 5, 2019, 6:14pm

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.

Topic		Replies	Views
Json data file to elasticsearch via filebeat and logstash Elasticsearch	1	307	February 5, 2019
Filebeat + logstash infinite loop Beats filebeat	1	385	March 17, 2021
Filebeat is not sending Json data to Elasticsearch Beats filebeat	5	1749	November 9, 2017
Filebeat send a json log but is stored as a string Beats filebeat	17	12746	July 5, 2017
Problem with JSON logs Beats filebeat	3	563	March 9, 2019

Sending json data into elasticsearch using filebeat and logstash

Related topics