Let's say that I would like to use alternative reporting tool to display
aggregated data and documents from Elasticsearch instead of Kibana. There
is nothing wrong with Kibana as such but alternative tool may have
additional features that I may found useful; KPI and treshold management,
notifications when particular KPI values are reached, ability to provide
rich visualizations (Tableau) etc. To be concreate, I would like to consume
Elasticsearch results from Kibana and Pentaho also. I have found that there
may be some Pentaho Kettle job to extract data from Elasticseach but due to
very limited information use case for this is really not clear.
I have found that Elasticsearch supports snapshots and repositories which
may be what I am looking for but I am not sure if these data structures are
consumable by other tools even using ETL engine.
One particular use case I have in mind is to take Elasticsearch snapshot
and tranform it using ETL to star schema into traditional OLAP database
from which I can make regular OLAP drilldown/ data slicing queries.
Scenario I have in mind is to use Elasticsearch platform for live,
most-up-to-date analytical queries while I can use durable storage as
back-up or archive of Elasticsearch documents. Such archive can be used for
offline reporting.
Technically it boils down to the question what data formats are passed
between Elasticsearch and Kibana and hwether there are APIs exposed to
consume this format from other reporting tools (or ETL engines that can
consume it and store it on traditional relational DB).
I would appreciate any help, direction or comments to this idea.
Let's say that I would like to use alternative reporting tool to display
aggregated data and documents from Elasticsearch instead of Kibana. There
is nothing wrong with Kibana as such but alternative tool may have
additional features that I may found useful; KPI and treshold management,
notifications when particular KPI values are reached, ability to provide
rich visualizations (Tableau) etc. To be concreate, I would like to consume
Elasticsearch results from Kibana and Pentaho also. I have found that there
may be some Pentaho Kettle job to extract data from Elasticseach but due to
very limited information use case for this is really not clear.
I have found that Elasticsearch supports snapshots and repositories which
may be what I am looking for but I am not sure if these data structures are
consumable by other tools even using ETL engine.
One particular use case I have in mind is to take Elasticsearch snapshot
and tranform it using ETL to star schema into traditional OLAP database
from which I can make regular OLAP drilldown/ data slicing queries.
Scenario I have in mind is to use Elasticsearch platform for live,
most-up-to-date analytical queries while I can use durable storage as
back-up or archive of Elasticsearch documents. Such archive can be used for
offline reporting.
Technically it boils down to the question what data formats are passed
between Elasticsearch and Kibana and hwether there are APIs exposed to
consume this format from other reporting tools (or ETL engines that can
consume it and store it on traditional relational DB).
I would appreciate any help, direction or comments to this idea.
On 2 October 2014 08:43, Petr Lazecky <petr.l...@gmail.com <javascript:>>
wrote:
Hi guys,
I have following question for you.
Let's say that I would like to use alternative reporting tool to display
aggregated data and documents from Elasticsearch instead of Kibana. There
is nothing wrong with Kibana as such but alternative tool may have
additional features that I may found useful; KPI and treshold management,
notifications when particular KPI values are reached, ability to provide
rich visualizations (Tableau) etc. To be concreate, I would like to consume
Elasticsearch results from Kibana and Pentaho also. I have found that there
may be some Pentaho Kettle job to extract data from Elasticseach but due to
very limited information use case for this is really not clear.
I have found that Elasticsearch supports snapshots and repositories which
may be what I am looking for but I am not sure if these data structures are
consumable by other tools even using ETL engine.
One particular use case I have in mind is to take Elasticsearch snapshot
and tranform it using ETL to star schema into traditional OLAP database
from which I can make regular OLAP drilldown/ data slicing queries.
Scenario I have in mind is to use Elasticsearch platform for live,
most-up-to-date analytical queries while I can use durable storage as
back-up or archive of Elasticsearch documents. Such archive can be used for
offline reporting.
Technically it boils down to the question what data formats are passed
between Elasticsearch and Kibana and hwether there are APIs exposed to
consume this format from other reporting tools (or ETL engines that can
consume it and store it on traditional relational DB).
I would appreciate any help, direction or comments to this idea.
Apache, Apache Lucene, Apache Hadoop, Hadoop, HDFS and the yellow elephant
logo are trademarks of the
Apache Software Foundation
in the United States and/or other countries.