It would be awesome if we could integrate Jupyter Notebooks with Kibana (more seamlessly, like a dashboard)

TlDr: We think, since Kibana is, after all, a web app, that it might be feasible to have Kibana support Jupyter Notebooks and use via Voila to host them as a kind of Dashboard like Canvas.

Eland is proof that Elastic understands the value in integration between Python and Elasticsearch. Well, the most widely used tool in the Python data-science space is Jupyter Notebooks.

Right now we're developing a tool we're calling ELK Whisperer, which streamlines the integration of Jupyter Notebooks (data science strengths) and Kibana (and a threat emulation tool, Caldera). This results in some great analytic possibilities, and in the end, our final product (on the Kibana side) is some dashboards / visualizations imported to Kibana via the API, all generated through Jupyter. But on the Jupyter end, our final product is an interactive interface with Jupyter's widgets allowing a more interactive control of the capabilities each analytic has to offer.

Better yet, Jupyter comes with a great tool called Voila which takes the output blocks of the Jupyter code (in this case a GUI made of widgets) and hosts them as a web app without the code being rendered. This allows our analysts (who may not all be comfortable working with code) to have simple, comfortable control over the data science tools written in Jupyter, which pipe their results into Kibana, again, through the API.

The only down-side is that the analyst needs to follow some navigation to reach those Voila web app pages. We think that since Kibana is, after all, a web app, that it might be feasible to have Kibana support Jupyter Notebooks and host them as a kind of dashboard like Canvas.

This would allow any team to take community-made Jupyter Notebooks and incorporate them into ELK without any extra steps.

1 Like