# Machine Learning on Web server logs

**URL:** <https://discuss.elastic.co/t/machine-learning-on-web-server-logs/184569>\
**Category:** Elasticsearch\
**Tags:** elastic-stack-machine-learning\
**Created:** [June 6, 2019, 11:10am UTC](https://discuss.elastic.co/t/machine-learning-on-web-server-logs/184569 "2019-06-06T11:10:10Z")\
**Posts on this page:** 10\
**Page:** 1

<div class="post-metadata">

**Author:** ![Vikash\_Singh1](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/vikash_singh1/32/42119_2.png) [@Vikash\_Singh1](https://discuss.elastic.co/u/Vikash_Singh1)\
**Post date:** [June 6, 2019, 11:10am UTC](https://discuss.elastic.co/t/machine-learning-on-web-server-logs/184569/1 "2019-06-06T11:10:10Z")

</div>

I am new to this machine learning features. I am having my web access logs. Could you help me with what kind of anomalies or single metric data or how can I use forecasting mechanism

---

<div class="post-metadata">

**Author:** ![richcollier](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/richcollier/32/115035_2.png) [@richcollier](https://discuss.elastic.co/u/richcollier)\
**Post date:** [June 6, 2019, 4:55pm UTC](https://discuss.elastic.co/t/machine-learning-on-web-server-logs/184569/2 "2019-06-06T16:55:55Z")

</div>

A simple one would be to look for the rate of requests, for every (split on) HTTP status code

 ![image](https://us1.discourse-cdn.com/elastic/original/3X/1/8/1834f1a417fa3eed881c168fd171d7091820b5ae.png)

---

<div class="post-metadata">

**Author:** ![Vikash\_Singh1](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/vikash_singh1/32/42119_2.png) [@Vikash\_Singh1](https://discuss.elastic.co/u/Vikash_Singh1)\
**Post date:** [June 7, 2019, 3:48am UTC](https://discuss.elastic.co/t/machine-learning-on-web-server-logs/184569/3 "2019-06-07T03:48:28Z")

</div>

How am I gonna detect the anomalies in such pattern??

---

<div class="post-metadata">

**Author:** ![richcollier](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/richcollier/32/115035_2.png) [@richcollier](https://discuss.elastic.co/u/richcollier)\
**Post date:** [June 7, 2019, 10:11am UTC](https://discuss.elastic.co/t/machine-learning-on-web-server-logs/184569/4 "2019-06-07T10:11:20Z")

</div>

Well, that's what the product does for you automatically! Here are sample results:

 ![image](https://us1.discourse-cdn.com/elastic/original/3X/4/c/4c7f15d8aaced5bde0864f167851a3bff074f741.png)

---

<div class="post-metadata">

**Author:** ![Vikash\_Singh1](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/vikash_singh1/32/42119_2.png) [@Vikash\_Singh1](https://discuss.elastic.co/u/Vikash_Singh1)\
**Post date:** [June 7, 2019, 10:18am UTC](https://discuss.elastic.co/t/machine-learning-on-web-server-logs/184569/5 "2019-06-07T10:18:11Z")

</div>

Can you please help me how would I obtain such results using my logs????I am seriously stucked/stalled on machine learning topic..

---

<div class="post-metadata">

**Author:** ![Vikash\_Singh1](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/vikash_singh1/32/42119_2.png) [@Vikash\_Singh1](https://discuss.elastic.co/u/Vikash_Singh1)\
**Post date:** [June 7, 2019, 10:18am UTC](https://discuss.elastic.co/t/machine-learning-on-web-server-logs/184569/6 "2019-06-07T10:18:46Z")

</div>

Even If could help me with any documentation that would also be very helpful

---

<div class="post-metadata">

**Author:** ![richcollier](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/richcollier/32/115035_2.png) [@richcollier](https://discuss.elastic.co/u/richcollier)\
**Post date:** [June 7, 2019, 2:15pm UTC](https://discuss.elastic.co/t/machine-learning-on-web-server-logs/184569/7 "2019-06-07T14:15:25Z")

</div>

Docs:

Getting started tutorial: [https://www.elastic.co/guide/en/x-pack/current/ml-getting-started.html](https://www.elastic.co/guide/en/x-pack/current/ml-getting-started.html)

API docs: [https://www.elastic.co/guide/en/x-pack/current/ml-api-quickref.html](https://www.elastic.co/guide/en/x-pack/current/ml-api-quickref.html)

Other “how to” docs: [https://www.elastic.co/guide/en/x-pack/current/ml-configuring.html](https://www.elastic.co/guide/en/x-pack/current/ml-configuring.html)

Function reference: [https://www.elastic.co/guide/en/x-pack/current/ml-functions.html](https://www.elastic.co/guide/en/x-pack/current/ml-functions.html)

ML Videos:

8 Min Tutorial #1 - How to create a single metric job:

8 Min Tutorial #2 - How to create a multi-metric job:

8 Min Tutorial #3 - Detect outliers in a population:

30 Min Meetup w/ Steve Dodson:

Useful ML Blogs:

Alerting on Machine Learning Jobs in Elasticsearch v5.5 ([https://www.elastic.co/blog/alerting-on-machine-learning-jobs-in-elasticsearch-v55](https://www.elastic.co/blog/alerting-on-machine-learning-jobs-in-elasticsearch-v55))

Machine Learning Anomaly Scoring and Elasticsearch - How it Works ([https://www.elastic.co/blog/machine-learning-anomaly-scoring-elasticsearch-how-it-works](https://www.elastic.co/blog/machine-learning-anomaly-scoring-elasticsearch-how-it-works))

Custom Elasticsearch Aggregations for Machine Learning Jobs ([https://www.elastic.co/blog/custom-elasticsearch-aggregations-for-machine-learning-jobs](https://www.elastic.co/blog/custom-elasticsearch-aggregations-for-machine-learning-jobs))

Scheduled Events ([https://www.elastic.co/blog/scheduled-events-and-the-amorous-anomaly-elasticsearch-machine-learning](https://www.elastic.co/blog/scheduled-events-and-the-amorous-anomaly-elasticsearch-machine-learning))

Filtering Input Data to Refine Machine Learning Jobs ([https://www.elastic.co/blog/filtering-input-data-to-refine-machine-learning-jobs](https://www.elastic.co/blog/filtering-input-data-to-refine-machine-learning-jobs))

How to Capture Domain Knowledge in Elastic Machine Learning Jobs with Custom Rules ([https://www.elastic.co/blog/how-to-capture-domain-knowledge-in-elastic-machine-learning-jobs-with-custom-rules](https://www.elastic.co/blog/how-to-capture-domain-knowledge-in-elastic-machine-learning-jobs-with-custom-rules))

Temporal vs. Population Analysis in Elastic Machine Learning

([https://www.elastic.co/blog/temporal-vs-population-analysis-in-elastic-machine-learning](https://www.elastic.co/blog/temporal-vs-population-analysis-in-elastic-machine-learning))

Changes to Elastic Machine Learning Anomaly Scoring in 6.5 ([https://www.elastic.co/blog/changes-to-elastic-machine-learning-anomaly-scoring-in-6-5](https://www.elastic.co/blog/changes-to-elastic-machine-learning-anomaly-scoring-in-6-5))

Importing CSV and Log Data into Elasticsearch with File Data Visualizer

([https://www.elastic.co/blog/importing-csv-and-log-data-into-elasticsearch-with-file-data-visualizer](https://www.elastic.co/blog/importing-csv-and-log-data-into-elasticsearch-with-file-data-visualizer))

---

<div class="post-metadata">

**Author:** ![Vikash\_Singh1](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/vikash_singh1/32/42119_2.png) [@Vikash\_Singh1](https://discuss.elastic.co/u/Vikash_Singh1)\
**Post date:** [June 13, 2019, 5:51am UTC](https://discuss.elastic.co/t/machine-learning-on-web-server-logs/184569/8 "2019-06-13T05:51:06Z")

</div>

@richcollier Thanks for these links and they are really helpful. Can you share some links how does elasticsearch machine learning features actually works. I mean what's going on behind the scene how it normalizes or lets say how it creates benchmark and they decide what is anomaly and what kind of warning shall we produce

---

<div class="post-metadata">

**Author:** ![Vikash\_Singh1](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/vikash_singh1/32/42119_2.png) [@Vikash\_Singh1](https://discuss.elastic.co/u/Vikash_Singh1)\
**Post date:** [June 13, 2019, 5:56am UTC](https://discuss.elastic.co/t/machine-learning-on-web-server-logs/184569/9 "2019-06-13T05:56:59Z")

</div>

@richcollier h!!! I didn't wen through all the links I guess the answers are in those links....Will post if I had any other query..

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [July 11, 2019, 5:57am UTC](https://discuss.elastic.co/t/machine-learning-on-web-server-logs/184569/10 "2019-07-11T05:57:10Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
