My use case is something like below
First Input(Mysql JDBC)
I'm selecting some data from MySQL like
select pk_id, score, other_id from <some_table>
Second Chained Input (Elasticsearch)
Then I want to pass the data pk_id
list got from the first input to elasticsearch to get other information from it
Not exactly like this but just to fetch other data from es
some_index/_search
{
"query": {
"terms": {
"values": []
}
}
}
Then combine the response from elasticsearch to the records obtained from the first input with the corresponding pk_id
<pk_id>, score, other_id, <other_info_from_elasticsearch>
Output Elasticsearch
Output the above records to the elasticsearch document
Can I do this using some plugin in logstash? or I have to do that using custom ruby script in logstash