Index existing data and integrate elasticsearch with PHP


(santosh) #1

Dear All,

I have gone through the link -
http://www.elasticsearch.org/guide/en/elasticsearch/client/php-api/current/_quickstart.html
to understand the setup. Can someone point to the documentation where I can

  1. Index existing data from mysql - I can index the data using curl but
    trying to figure out how to do it in one go. Dont want to do through PHP
    since size of data is very large.

  2. Sync the data whenever there are any update into the database through
    application. Is there a way to achieve this.

  3. How can We use elastic search in PHP

If someone can point to documentation which give some getting started like
stuff that would be great help.

-Santosh

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/f9ad5f6b-7e4a-4505-920a-20ec2207ab0d%40googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.


(Zachary Tong) #2
  1. There is no way to index straight from MySQL itself. You will need
    some kind of adapter/connector to move the data from MySQL to
    Elasticsearch. This is necessary for several reasons, but mainly because
    you need to transform the rows into usable JSON documents. That's
    something only your application will know how to do. The adapter could be
    written in PHP, Python, Perl, etc...any of your favorite dynamic languages
    will work.

  2. Synchronizing databases is another job best left to the application
    and user. The easiest solution is to have a dual-pipeline: when an update
    (or delete or index) arrives at your system, it is sent to MySQL and
    Elasticsearch simultaneously. It is usually easier to perform the
    operation in parallel rather than sending to the database and then trying
    to keep the two synchronized.

  3. That's an awfully broad question! :stuck_out_tongue: The PHP client quickstart and
    docs show the syntax to use the client, which gives you access to all the
    Elasticsearch APIs. How you want to integrate Elasticsearch into your
    application is entirely up to you, and it is very dependent on your
    particular use-case.

-Zach

On Wednesday, February 26, 2014 6:29:14 AM UTC-5, Santosh wrote:

Dear All,

I have gone through the link -
http://www.elasticsearch.org/guide/en/elasticsearch/client/php-api/current/_quickstart.htmlto understand the setup. Can someone point to the documentation where I can

  1. Index existing data from mysql - I can index the data using curl but
    trying to figure out how to do it in one go. Dont want to do through PHP
    since size of data is very large.

  2. Sync the data whenever there are any update into the database through
    application. Is there a way to achieve this.

  3. How can We use elastic search in PHP

If someone can point to documentation which give some getting started like
stuff that would be great help.

-Santosh

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/8c94a64f-f1fe-463e-9750-71aa7b9836ff%40googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.


(santosh) #3

Thank you Zach. Your input will definitely helpful.

Santosh
On 26-Feb-2014 5:52 pm, "Zachary Tong" zacharyjtong@gmail.com wrote:

  1. There is no way to index straight from MySQL itself. You will need
    some kind of adapter/connector to move the data from MySQL to
    Elasticsearch. This is necessary for several reasons, but mainly because
    you need to transform the rows into usable JSON documents. That's
    something only your application will know how to do. The adapter could be
    written in PHP, Python, Perl, etc...any of your favorite dynamic languages
    will work.

  2. Synchronizing databases is another job best left to the application
    and user. The easiest solution is to have a dual-pipeline: when an update
    (or delete or index) arrives at your system, it is sent to MySQL and
    Elasticsearch simultaneously. It is usually easier to perform the
    operation in parallel rather than sending to the database and then trying
    to keep the two synchronized.

  3. That's an awfully broad question! :stuck_out_tongue: The PHP client quickstart
    and docs show the syntax to use the client, which gives you access to all
    the Elasticsearch APIs. How you want to integrate Elasticsearch into your
    application is entirely up to you, and it is very dependent on your
    particular use-case.

-Zach

On Wednesday, February 26, 2014 6:29:14 AM UTC-5, Santosh wrote:

Dear All,

I have gone through the link - http://www.elasticsearch.org/
guide/en/elasticsearch/client/php-api/current/_quickstart.html to
understand the setup. Can someone point to the documentation where I can

  1. Index existing data from mysql - I can index the data using curl but
    trying to figure out how to do it in one go. Dont want to do through PHP
    since size of data is very large.

  2. Sync the data whenever there are any update into the database through
    application. Is there a way to achieve this.

  3. How can We use elastic search in PHP

If someone can point to documentation which give some getting started
like stuff that would be great help.

-Santosh

--
You received this message because you are subscribed to a topic in the
Google Groups "elasticsearch" group.
To unsubscribe from this topic, visit
https://groups.google.com/d/topic/elasticsearch/TKrj5q6w9gs/unsubscribe.
To unsubscribe from this group and all its topics, send an email to
elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/8c94a64f-f1fe-463e-9750-71aa7b9836ff%40googlegroups.com
.
For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CADO%2BbTENERPrEGsPHbjxUZZQUJDth9S79iZM4X8Vx_YRErfLWQ%40mail.gmail.com.
For more options, visit https://groups.google.com/groups/opt_out.


(system) #4