# Prediction.io, Universal Recommender and Elasticsearch

**URL:** <https://discuss.elastic.co/t/prediction-io-universal-recommender-and-elasticsearch/55636>\
**Category:** Elasticsearch\
**Tags:** es-hadoop\
**Created:** [July 15, 2016, 3:32pm UTC](https://discuss.elastic.co/t/prediction-io-universal-recommender-and-elasticsearch/55636 "2016-07-15T15:32:37Z")\
**Posts on this page:** 2\
**Page:** 1

<div class="post-metadata">

**Author:** ![michal.trmac](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/michal.trmac/32/10916_2.png) [@michal.trmac](https://discuss.elastic.co/u/michal.trmac)\
**Post date:** [July 15, 2016, 3:32pm UTC](https://discuss.elastic.co/t/prediction-io-universal-recommender-and-elasticsearch/55636/1 "2016-07-15T15:32:37Z")

</div>

Hi,

we are trying to build recommendation system with [Prediction.io](http://Prediction.io) based on Universal Recommender template which using Elasticsearch as storage.

We have problem with recommendation training performance. It took about 22 hours to run training job on spark for only 20M of rows.

We try to solve the problem on [Prediction.io](http://Prediction.io) forum ( [https://groups.google.com/forum/#!topic/actionml-user/ITni3j\_6HiY](https://groups.google.com/forum/#!topic/actionml-user/ITni3j_6HiY) ) but they told us that the problem is probably in Elasticsearch library ( "The code running is in an Elasticsearch library that writes an RDD to ES." ).

We started with 1 ES node (24 CPU cores, 64 GB RAM). After we find out that it's probably ES problem, we add 2 more ES nodes. But no matter how many ES nodes we have it still took same time.

Is there someone who can help me to debug and fix the problem?

Thanks  
m.

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [July 6, 2017, 1:23pm UTC](https://discuss.elastic.co/t/prediction-io-universal-recommender-and-elasticsearch/55636/2 "2017-07-06T13:23:56Z")

</div>


