Hi,
We have one use case where we need to get ETL logs to elasticsearch
ETL stores logs to SQL DB.
How to get these sql data to ES and how to index that?
br,
Sunil
You'll likely want to use some scripting language that can query your SQL DB, and make http requests to your elasticSearch instance.
Take a look at the Bulk API for inserting many records at a time for better performance: https://www.elastic.co/guide/en/elasticsearch/reference/current/docs-bulk.html
You'll need to determine a JSON document structure for the data you're pulling from your SQL DB and map the data to the JSON structure to be pushed into elasticsearch and indexed.
See https://www.elastic.co/guide/en/elasticsearch/reference/current/docs-index_.html for how a document could look like & for better understanding of what it take to index a document.
This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.