# ML Job not working with Live data

**URL:** <https://discuss.elastic.co/t/ml-job-not-working-with-live-data/276790>\
**Category:** Kibana\
**Tags:** elastic-stack-machine-learning\
**Created:** [June 23, 2021, 12:42pm UTC](https://discuss.elastic.co/t/ml-job-not-working-with-live-data/276790 "2021-06-23T12:42:10Z")\
**Posts on this page:** 5\
**Page:** 1

<div class="post-metadata">

**Author:** ![swarali\_vartak](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/swarali_vartak/32/69055_2.png) [@swarali\_vartak](https://discuss.elastic.co/u/swarali_vartak)\
**Post date:** [June 23, 2021, 12:42pm UTC](https://discuss.elastic.co/t/ml-job-not-working-with-live-data/276790/1 "2021-06-23T12:42:10Z")

</div>

Hi,  
I have standalone setup of elk stack (7.12.1) and I have huge amount of data pushing into elasticsearch. I created a job in ML with live data but job is not running in real time even though while creating job I have specified real time search.  
When I'm cloning the existing job my records are getting updated but when running in real time search my job is not getting updated.  
Kindly help.  
Thank you.

---

<div class="post-metadata">

**Author:** ![richcollier](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/richcollier/32/115035_2.png) [@richcollier](https://discuss.elastic.co/u/richcollier)\
**Post date:** [June 23, 2021, 1:14pm UTC](https://discuss.elastic.co/t/ml-job-not-working-with-live-data/276790/2 "2021-06-23T13:14:04Z")

</div>

"Huge" means how much exactly?

What is your setup? How many nodes? Size of nodes? Dedicated ML node?

How did you configure the job? What does the job summary page look like?

You'll need to provide specifics in order to get help here.

---

<div class="post-metadata">

**Author:** ![swarali\_vartak](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/swarali_vartak/32/69055_2.png) [@swarali\_vartak](https://discuss.elastic.co/u/swarali_vartak)\
**Post date:** [June 24, 2021, 4:29am UTC](https://discuss.elastic.co/t/ml-job-not-working-with-live-data/276790/3 "2021-06-24T04:29:58Z")

</div>

Thank you for your response.

I have a standalone setup of elk, like on a single node I have elasticsearch, logstash, filebeat and kibana.  
This setup is only for poc purpose.

I have a log files with around 9 Million data.  
I am using filebeat to read the data and send it to logstash, In logstash I have a parser written.

The problem is when I have created the ML job and have specified real time searching.  
That is not updating in ML if I am ingesting more data, the data count is reflecting in discover but not in ML job

I have Advance ML job created with rare function.

---

<div class="post-metadata">

**Author:** ![richcollier](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/richcollier/32/115035_2.png) [@richcollier](https://discuss.elastic.co/u/richcollier)\
**Post date:** [June 24, 2021, 1:03pm UTC](https://discuss.elastic.co/t/ml-job-not-working-with-live-data/276790/4 "2021-06-24T13:03:26Z")

</div>

Please provide the outputs of the following (replacing "jobname" with your ML job name):

```auto
GET _ml/anomaly_detectors/jobname/
GET _ml/anomaly_detectors/jobname/_stats
GET _ml/datafeeds/datafeed-jobname/_stats

```

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [July 22, 2021, 1:04pm UTC](https://discuss.elastic.co/t/ml-job-not-working-with-live-data/276790/5 "2021-07-22T13:04:00Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.