Is Elasticsearch a suitable tool for event streaming and processing?


(Eugene Goldberg) #1

Greetings,
I have a requirement at work to transition from periodically pooling remote data sources (such as Oracle RDBMS), to event-driven approach, in which individual events (i.e. new database records) are captured as they occur, and put onto a message bus for further processing and analysis.
My first thoughts were to use Apache Kafka and Apache Spark Streaming for this purpose.
However, I've been told, that our corporate strategist may already have a bias towards Elastic.
Since I do not know Elastic myself, my question is: is the above stated use case suitable to be implemented with Elastic?

-Eugene


(Magnus B├Ąck) #2

ES is a search-oriented JSON document database. Hence, it can store events and make them easily searchable but it won't read a message bus or perform the kind of processing one would typically do with Apache Spark.


(system) #3