Map large, complex sql result set to document with nested objects


(Abid Hussain) #1

Hi there,

a similar question was asked here Logstash jdbc plugin input for mutliple table joins of one to many relationships

... but it seems not to be resolved until now.

The elasticsearch-jdbc plugin is able to map the results of a sql query containing joins (e.g. a query on a 1:n relationship) to a json structure containing nested objects.

Unfortunately, elasticsearch-jdbc does not support Elasticsearch 5 and higher.

I would like to index a relational structure containing about 10.000.000 entries to a document structure with nested objects. How can I achieve this?

It seems that logstash aggregate plugin may be an option, but is it able to handle a result set of such large size?

Regards,

Abid


(system) #2

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.