Is it possible to write from elasticsearch to hdfs?
the current pipeline is:
fluentd -> elasticsearch
fluentd -> flume -> hdfs
elastic is used for realtime analysis and hive (on top of hdfs) is used for longer.
i would like to replace this setup with:
fluentd -> elasticsearch -> hdfs
but i have not been able to confirm whether this is possible/feasible.
do anyone have experience with this, or can point me to the docs?