Hi...
What are the alternatives to extract data from cassandra to elasticsearch. CQL has many limitations with queries so we are not able to do it. Also apart from logstash is there any other way.
I'd recommend writing to elasticsearch directly from the application which is writing data in Cassandra. That's IMHO the best way, whatever the storage database is, to be as most as possible real time.
We are getting the data from nagios agents which translates the data before sending it to cassandra
I'm not familiar with nagios but can't you do the same with elasticsearch?
Which leads me to another question: what do you need Cassandra for?
The actual data lake is cassandra all the data is stored to cassandra. We are consuming this data to elastic building a ML on it and visualizing it to Kibana. I've always got the feel this is over engineering. If you could share your thoughts on this.
Well. I think (but I don't know all the details so take it with caution), that data such as logs, monitoring... should not be stored in many systems unless there's a real need for that.
Probably I'd go for elasticsearch only and it's built in anomaly detection feature. But I'm biased as I'm working at elastic.
1 Like
This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.