Working on a project that will be querying a number of data sources and inserting the resulting data into ES. The data sources include: Bing API, Twitter, Instagram, Facebook, and more social media platforms.
Thoughts on the following options, pros/cons/etc:
Option 1: Develop custom beats for each of these data sources and output directly to ES via https
Option 2: Write a number of scripts in $language to query these data sources and output directly to ES via https