Working on a project that will be querying a number of data sources and inserting the resulting data into ES. The data sources include: Bing API, Twitter, Instagram, Facebook, and more social media platforms. Thoughts on the following options, pros/cons/etc: Option 1: Develop custom beats for each…

Custom Beats vs. Scripts

warkolm (Mark Walkom) September 17, 2016, 9:02pm 2

apibeat sounds like a good idea, with modules for each site maybe?

Otherwise Logstash has a http_poller input.

Topic		Replies	Views
Can someone please explain the Beat architecture - Can a Beat be used to pull data from a list of sources? Beats	7	1478	January 6, 2017
Advice Needed on Beats Beats	5	1019	July 5, 2017
Can beats pick data from database and send to elasticsearch Beats	2	6060	July 28, 2017
Is there a Beat that reads from DynamoDB? Beats	7	1250	December 8, 2016
RelayBeat Beats	4	447	April 26, 2017

Elasticsearch is a trademark of Elasticsearch BV, registered in the U.S. and in other countries
Trademarks
Terms
Privacy
Brand
Code of Conduct

Apache, Apache Lucene, Apache Hadoop, Hadoop, HDFS and the yellow elephant logo are trademarks of the Apache Software Foundation in the United States and/or other countries.

Custom Beats vs. Scripts

Related topics