# 1) How to integrate Elasticsearch-Hadoop with MySQL DB at the backend and User interface developed in dhtmlx, Spring. 2) Also how to integrate Elasticsearch-Hadoop with Services written in Spring MVC

**URL:** https://discuss.elastic.co/t/1-how-to-integrate-elasticsearch-hadoop-with-mysql-db-at-the-backend-and-user-interface-developed-in-dhtmlx-spring-2-also-how-to-integrate-elasticsearch-hadoop-with-services-written-in-spring-mvc/43223
**Category:** Elasticsearch
**Tags:** es-hadoop
**Created:** [March 2, 2016, 10:08am UTC](https://discuss.elastic.co/t/1-how-to-integrate-elasticsearch-hadoop-with-mysql-db-at-the-backend-and-user-interface-developed-in-dhtmlx-spring-2-also-how-to-integrate-elasticsearch-hadoop-with-services-written-in-spring-mvc/43223 "2016-03-02T10:08:49Z")
**Posts on this page:** 9
**Page:** 1

<div class="post-metadata">

### Author: ![prashanthrd](https://avatars.discourse-cdn.com/v4/letter/p/50afbb/32.png) [@prashanthrd](https://discuss.elastic.co/u/prashanthrd)
#### Post date: [March 2, 2016, 10:08am UTC](https://discuss.elastic.co/t/1-how-to-integrate-elasticsearch-hadoop-with-mysql-db-at-the-backend-and-user-interface-developed-in-dhtmlx-spring-2-also-how-to-integrate-elasticsearch-hadoop-with-services-written-in-spring-mvc/43223/1 "2016-03-02T10:08:49Z")

</div>

1. How to integrate Elasticsearch with MySQL DB at the backend and User interface developed in dhtmlx, Spring. 2) Also how to integrate Elasticsearch with Services written in Spring MVC.

Please consider latest versions for all softwares.

---

<div class="post-metadata">

### Author: ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)
#### Post date: [March 2, 2016, 10:10pm UTC](https://discuss.elastic.co/t/1-how-to-integrate-elasticsearch-hadoop-with-mysql-db-at-the-backend-and-user-interface-developed-in-dhtmlx-spring-2-also-how-to-integrate-elasticsearch-hadoop-with-services-written-in-spring-mvc/43223/2 "2016-03-02T22:10:18Z")

</div>

You can use Logstash to integrate ES with MySQL.

Not sure about the rest.

---

<div class="post-metadata">

### Author: ![prashanthrd](https://avatars.discourse-cdn.com/v4/letter/p/50afbb/32.png) [@prashanthrd](https://discuss.elastic.co/u/prashanthrd)
#### Post date: [March 3, 2016, 7:07am UTC](https://discuss.elastic.co/t/1-how-to-integrate-elasticsearch-hadoop-with-mysql-db-at-the-backend-and-user-interface-developed-in-dhtmlx-spring-2-also-how-to-integrate-elasticsearch-hadoop-with-services-written-in-spring-mvc/43223/3 "2016-03-03T07:07:30Z")

</div>

Thanks, for your reply.  
I have few questions. 1) What is the maximum data that can be fetched from MySQL DB into ElasticSearch via Logstash. I read that as per the jdbc plugin doc, this is configured in this plugin using the jdbc\_fetch\_size configuration option. Please suggest more documents to read on this. Also, we install the Logstash & Elasticsearch on the server, do we need to take into consideration of the server space requirements to store elasearch data. I am unable to see any documents or information regarding this. Please suggest any links or documents with respect to that.  
2) Also, I have a question regarding ES-Hadoop. We don't have Hadoop as of now but is it a good idea to use ES-Hadoop instead of Logstash?.Will there be any additional advantage using ES-Hadoop instead of Logstash.?. Please clarify my doubt.  
3) How do you integrate the Elasticsearch with the frontend (our custom UI Portal) which is currently accessing MySQL data using Java and Spring interfaces. I want to use the data in elasticsearch instead of MySQL, is this possible from my custom UI Portal.? If Yes, how. If possible, please provide links or documentation regarding this.

Thank you in advance....

---

<div class="post-metadata">

### Author: ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)
#### Post date: [March 3, 2016, 7:14am UTC](https://discuss.elastic.co/t/1-how-to-integrate-elasticsearch-hadoop-with-mysql-db-at-the-backend-and-user-interface-developed-in-dhtmlx-spring-2-also-how-to-integrate-elasticsearch-hadoop-with-services-written-in-spring-mvc/43223/4 "2016-03-03T07:14:01Z")

</div>

1. That's something you need to test, your data and systems will be different to others and so will the fetch size.
2. If you don't have hadoop, then why do you want to install it?
3. You need to do that yourself.

---

<div class="post-metadata">

### Author: ![prashanthrd](https://avatars.discourse-cdn.com/v4/letter/p/50afbb/32.png) [@prashanthrd](https://discuss.elastic.co/u/prashanthrd)
#### Post date: [March 3, 2016, 10:04am UTC](https://discuss.elastic.co/t/1-how-to-integrate-elasticsearch-hadoop-with-mysql-db-at-the-backend-and-user-interface-developed-in-dhtmlx-spring-2-also-how-to-integrate-elasticsearch-hadoop-with-services-written-in-spring-mvc/43223/5 "2016-03-03T10:04:22Z")

</div>

Thank you for your kind support...

---

<div class="post-metadata">

### Author: ![prashanthrd](https://avatars.discourse-cdn.com/v4/letter/p/50afbb/32.png) [@prashanthrd](https://discuss.elastic.co/u/prashanthrd)
#### Post date: [March 3, 2016, 11:41am UTC](https://discuss.elastic.co/t/1-how-to-integrate-elasticsearch-hadoop-with-mysql-db-at-the-backend-and-user-interface-developed-in-dhtmlx-spring-2-also-how-to-integrate-elasticsearch-hadoop-with-services-written-in-spring-mvc/43223/6 "2016-03-03T11:41:06Z")

</div>

I am trying to use logstash-input-jdbc plugin. Could you please tell how to proceed with using the plugin . I see the plugin details doc, but it is not much helpful.

---

<div class="post-metadata">

### Author: ![prashanthrd](https://avatars.discourse-cdn.com/v4/letter/p/50afbb/32.png) [@prashanthrd](https://discuss.elastic.co/u/prashanthrd)
#### Post date: [March 4, 2016, 6:35pm UTC](https://discuss.elastic.co/t/1-how-to-integrate-elasticsearch-hadoop-with-mysql-db-at-the-backend-and-user-interface-developed-in-dhtmlx-spring-2-also-how-to-integrate-elasticsearch-hadoop-with-services-written-in-spring-mvc/43223/7 "2016-03-04T18:35:00Z")

</div>

Hi Friends,

I have a problem extracting data from MySQL to Elasticsearch via Logstash.  
Suppose I have two different schemas and one table in each of them. Now, we search data from those  
tables using a LEFT OUTER JOIN query. How do we configure in the config file.

Schema xyz --\> Table1 ; Schema pqr --\> Table2 ; joined by a left outer join.  
Please suggest ways to extract data from MySQL to elasticsearch using logstash.

Thank you in advance....

---

<div class="post-metadata">

### Author: ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)
#### Post date: [March 4, 2016, 9:05pm UTC](https://discuss.elastic.co/t/1-how-to-integrate-elasticsearch-hadoop-with-mysql-db-at-the-backend-and-user-interface-developed-in-dhtmlx-spring-2-also-how-to-integrate-elasticsearch-hadoop-with-services-written-in-spring-mvc/43223/8 "2016-03-04T21:05:42Z")

</div>

You should really start a new thread, this doesn't have anything to do with hadoop now.

---

<div class="post-metadata">

### Author: ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)
#### Post date: [July 6, 2017, 1:25pm UTC](https://discuss.elastic.co/t/1-how-to-integrate-elasticsearch-hadoop-with-mysql-db-at-the-backend-and-user-interface-developed-in-dhtmlx-spring-2-also-how-to-integrate-elasticsearch-hadoop-with-services-written-in-spring-mvc/43223/9 "2017-07-06T13:25:55Z")

</div>


