What will be the best way to create ES index for mulit-join tables from Mysql database

Elastic Stack Logstash
1

We need 11 tables to join together to generate the search result in MySQL database.
We use Elasticsearch as our full-text search engine. There is no join operation in ES.
solution

  1. write join query in logstash to create the super table index.
  2. create individual index for each table then do the join at application side.(i do not want this way)
  3. to use other software?

when i try to use solution 1, the issues are 1) what should be the tracking-column, what should be the where cause in the query so that the index can be incrementally increased.

Is there any good suggestion?

2

so that the index can be incrementally increased.

What do you mean by this?

3

I just want the index can be incrementally updated when the Mysql table has been updated.
I am not sure how to write the super join query in the logstash. what should be the primary key for that super-join-table, what should be the tracking-column, should i added timestamp for those individual table?
how to achieve incremental update.

4

I know that it's straight forward to achieve incremental update the index for a single Mysql table.
There's some difficult for multi-table-join-query. 1. what should be the tracking-column for that super-join-table, 2. There are 11 sub tables, when and how to update the super-join-table

5

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.