# ELK to monitor job
**URL:** https://discuss.elastic.co/t/elk-to-monitor-job/342422
**Category:** Elastic Observability
**Created:** [September 6, 2023, 9:59am UTC](https://discuss.elastic.co/t/elk-to-monitor-job/342422 "2023-09-06T09:59:50Z")
**Posts on this page:** 8
**Page:** 1
### Author:  [@murran\_rais](https://discuss.elastic.co/u/murran_rais)
#### Post date: [September 6, 2023, 9:59am UTC](https://discuss.elastic.co/t/elk-to-monitor-job/342422/1 "2023-09-06T09:59:50Z")
hi, im new with ELK, wanna ask, can ELK monitor job from Apache airflow, SQL or other applications? and can elk monitor comprehensivly like give information about history of the job, last run time of the job, condition of the job (error,idle etc) and alert when there is an error
---
### Author:  [@elasticforme](https://discuss.elastic.co/u/elasticforme)
#### Post date: [September 6, 2023, 2:56pm UTC](https://discuss.elastic.co/t/elk-to-monitor-job/342422/2 "2023-09-06T14:56:45Z")
yes it can
you have to write some kind of code to retrieve that data from them and store in ELK
---
### Author:  [@murran\_rais](https://discuss.elastic.co/u/murran_rais)
#### Post date: [September 13, 2023, 7:19am UTC](https://discuss.elastic.co/t/elk-to-monitor-job/342422/3 "2023-09-13T07:19:25Z")
okayy thanks!, is there any best practice about that?
---
### Author:  [@elasticforme](https://discuss.elastic.co/u/elasticforme)
#### Post date: [September 13, 2023, 2:19pm UTC](https://discuss.elastic.co/t/elk-to-monitor-job/342422/4 "2023-09-13T14:19:24Z")
you question is very vague.
if you can give us more detail description then someone in forum can give you more detail.
but from broad prespective lets say you write python code to pull data from log file of that application?
or transfer metric from that app directly to elastic?
---
### Author:  [@murran\_rais](https://discuss.elastic.co/u/murran_rais)
#### Post date: [September 15, 2023, 7:30am UTC](https://discuss.elastic.co/t/elk-to-monitor-job/342422/5 "2023-09-15T07:30:04Z")
okay bro, for example give me best practice for monitoring MsSQL job on ELK, and Monitoring Airflow Apache job on ELK, i think i'm gonna look from the application syslog (MsSQL/Apache Airflow)
---
### Author:  [@elasticforme](https://discuss.elastic.co/u/elasticforme)
#### Post date: [September 15, 2023, 1:46pm UTC](https://discuss.elastic.co/t/elk-to-monitor-job/342422/6 "2023-09-15T13:46:13Z")
for mysql I will write python code to pull data from mysql, normalize it before saving in to ELK
for log I will install filebeat on log server and send data to elastic. if I need to parse the log like and it is little complicated parsing then I will send filebeat data to lostash and parse there and save it in elastic
---
### Author:  [@murran\_rais](https://discuss.elastic.co/u/murran_rais)
#### Post date: [September 18, 2023, 5:00am UTC](https://discuss.elastic.co/t/elk-to-monitor-job/342422/7 "2023-09-18T05:00:33Z")
ok thanks sachin!, i ll let u know if i have another question
---
### Author:  [@system](https://discuss.elastic.co/u/system)
#### Post date: [October 16, 2023, 5:01am UTC](https://discuss.elastic.co/t/elk-to-monitor-job/342422/8 "2023-10-16T05:01:00Z")
This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.