# Create Kibana visulaization on the fly using python script

**URL:** <https://discuss.elastic.co/t/create-kibana-visulaization-on-the-fly-using-python-script/124779>\
**Category:** Kibana\
**Created:** [March 20, 2018, 1:51pm UTC](https://discuss.elastic.co/t/create-kibana-visulaization-on-the-fly-using-python-script/124779 "2018-03-20T13:51:46Z")\
**Posts on this page:** 9\
**Page:** 1

<div class="post-metadata">

**Author:** ![Bhairavi](https://avatars.discourse-cdn.com/v4/letter/b/9fc29f/32.png) [@Bhairavi](https://discuss.elastic.co/u/Bhairavi)\
**Post date:** [March 20, 2018, 1:51pm UTC](https://discuss.elastic.co/t/create-kibana-visulaization-on-the-fly-using-python-script/124779/1 "2018-03-20T13:51:46Z")

</div>

I have a requirement of creating kibana visualization when a user writes a query like "apache logs for March". I want it to happen dynamically using Python script.  
I've tried submitting Kibana JSON request through Elasticsearch's .kibana index and it worked if "query" value is static.

```
 import config
from elasticsearch import Elasticsearch,RequestsHttpConnection
es=Elasticsearch(hosts=[{'host':config.hostName,'port':config.port}],http_auth=
(config.userName,config.password),connection_class=RequestsHttpConnection)

feeds = es.index(index=".kibana",doc_type="visualization", body={
      "title": "test kibana1",
      "visState": """{"aggs":[{"enabled":true,"id":"1","params":
{},"schema":"metric","type":"count"},{"enabled":true,"id":"2","params"
{"customInterval":"2h","extended_bounds"
{},"field":"@timestamp","interval":"d","min_doc_count":1},"schema":"segment","type":"d
ate_histogram"}],"listeners":{},"params"
{"addLegend":true,"addTooltip":true,"isDonut":false,"legendPosition":"right"},
"title":"test
kibana1","type":"pie"}""",
"uiStateJSON": "{}",
"description": "",
"version": 1,
"kibanaSavedObjectMeta": {
"searchSourceJSON": """{"index":"logstash-yyyy.mm.dd","query":{"match_all":
{}},"filter":[{"$state":{"store":"appState"},"meta":
{"alias":null,"disabled":false,"index":"logstash-
yyyy.mm.dd","key":"message","negate":false,"type":"phrase","value":”apache logs for
march”},"query":{"match":{"message":{"query":”apache logs for march”}}}}]}"""
}
})
	
print(feeds)		

```

After executing this I am able to see the visualization in Kibana.

But I am aiming to pass string user input to this "query" parameter for which I am getting visualization created message but it's just creating a name for the visualization on Kibana side because it is not accepting the variable which I am trying to pass.

```
 import config
from elasticsearch import Elasticsearch,RequestsHttpConnection

es=Elasticsearch(hosts=[{'host':config.hostName,'port':config.port}],http_auth=
(config.userName,config.password),connection_class=RequestsHttpConnection)

post = input("Enter post:")

feeds = es.index(index=".kibana",doc_type="visualization", body= {

      "title": "test kibana1",
      "visState": """{"aggs":[{"enabled":true,"id":"1","params":
{},"schema":"metric","type":"count"},{"enabled":true,"id":"2","params":
{"customInterval":"2h","extended_bounds":
{},"field":"@timestamp","interval":"d","min_doc_count":1},"schema":"segment",
"type":"date_histogram"}],"listeners":{},"params":
{"addLegend":true,"addTooltip":true,"isDonut":false,"legendPosition":"right"},
"title":"test kibana1","type":"pie"}""",
      "uiStateJSON": "{}",
      "description": "",
      "version": 1,
      "kibanaSavedObjectMeta": {
        "searchSourceJSON": """{"index":"logstash-yyyy.mm.dd","query":{"match_all":
{}},"filter":[{"$state":{"store":"appState"},"meta":
{"alias":null,"disabled":false,"index":"logstash-
yyyy.mm.dd","key":"message","negate":false,"type":"phrase","value":post},"query":
{"match":{"message":{"query":post}}}}]}"""
      }
    })

```

Is there any way to achieve this? Please help.

---

<div class="post-metadata">

**Author:** ![timroes](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/timroes/32/19712_2.png) [@timroes](https://discuss.elastic.co/u/timroes)\
**Post date:** [March 20, 2018, 2:47pm UTC](https://discuss.elastic.co/t/create-kibana-visulaization-on-the-fly-using-python-script/124779/2 "2018-03-20T14:47:42Z")

</div>

"because it is not accepting the variable which I am trying to pass." could you please elaborate what you mean by not accepting the variable? Will the object be stored in the `.kibana` index? If you go in Kibana to management -\> Saved Objects, do you find it there? Could you post how the saved object looks there? At what part does it fail exactly?

---

<div class="post-metadata">

**Author:** ![Bhairavi](https://avatars.discourse-cdn.com/v4/letter/b/9fc29f/32.png) [@Bhairavi](https://discuss.elastic.co/u/Bhairavi)\
**Post date:** [March 20, 2018, 3:16pm UTC](https://discuss.elastic.co/t/create-kibana-visulaization-on-the-fly-using-python-script/124779/3 "2018-03-20T15:16:09Z")

</div>

"because it is not accepting the variable which I am trying to pass." - by this I mean if the variable "post" reads the user input say "apache logs for March" and I am passing it in SearchSourceJSON's query it should execute the query based on the input, a user has given to the "post" variable but it is not working in that way.  
Yes, the object will be stored in the .kibana index and I can find it inside the saved objects even if it is failing. The error occurs at SearchSourceJSON part.

 ![test1](https://us1.discourse-cdn.com/elastic/original/3X/6/a/6a3116a46c0198e77f01f264bc62d4914908705c.png)

---

<div class="post-metadata">

**Author:** ![timroes](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/timroes/32/19712_2.png) [@timroes](https://discuss.elastic.co/u/timroes)\
**Post date:** [March 20, 2018, 4:05pm UTC](https://discuss.elastic.co/t/create-kibana-visulaization-on-the-fly-using-python-script/124779/4 "2018-03-20T16:05:12Z")

</div>

This is rather a Python question then a Kibana question 🙂 in your case you just write the string `post` in your JSON instead of the content of the variable.

You should have a look into Python String format: [https://pyformat.info/](https://pyformat.info/)

Your python should in the end look something like:

```python
"visState": """ ... "query": "{}" ... """.format(post)

```

---

<div class="post-metadata">

**Author:** ![Bhairavi](https://avatars.discourse-cdn.com/v4/letter/b/9fc29f/32.png) [@Bhairavi](https://discuss.elastic.co/u/Bhairavi)\
**Post date:** [March 20, 2018, 9:38pm UTC](https://discuss.elastic.co/t/create-kibana-visulaization-on-the-fly-using-python-script/124779/5 "2018-03-20T21:38:04Z")

</div>

I've tried formatting the string as you said but it rather gives me KeyError: '"index"' error.

But is there any other approach with Kibana which can help this use case, where based on user's string query, dynamically Kibana visualizations are being created using script?

---

<div class="post-metadata">

**Author:** ![timroes](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/timroes/32/19712_2.png) [@timroes](https://discuss.elastic.co/u/timroes)\
**Post date:** [March 21, 2018, 9:05am UTC](https://discuss.elastic.co/t/create-kibana-visulaization-on-the-fly-using-python-script/124779/6 "2018-03-21T09:05:17Z")

</div>

The failing Python is still only python, so nothing Kibana/ES specific in there.

In Kibana itself you can't "dynamically create and save" visualizations based on a query. But of course you can just create that visualization without the query, and then place it on any dashboard you want and as soon as the user puts a search in the query bar of the dashboard, the visualization will only visualize these documents.

I don't think i've understood your use-case well enough so far, to provide a better answer to that.

---

<div class="post-metadata">

**Author:** ![Bhairavi](https://avatars.discourse-cdn.com/v4/letter/b/9fc29f/32.png) [@Bhairavi](https://discuss.elastic.co/u/Bhairavi)\
**Post date:** [March 21, 2018, 8:42pm UTC](https://discuss.elastic.co/t/create-kibana-visulaization-on-the-fly-using-python-script/124779/7 "2018-03-21T20:42:56Z")

</div>

Use case: We are working on a SAAS based application where we are trying to create a complete enterprise search solution on top of Elasticsearch. And we are intending to show the data in form of dashboards on our front-end with the help of Kibana.  
When a user will perform the search query, our goal is to take that query and show respective visualizations created by Kibana along with the results showed in this picture.

 ![test1](https://us1.discourse-cdn.com/elastic/original/3X/e/0/e08bcd2f4ba718214374ac4306d94b992b6be54b.png)

Is there any API or method which Kibana supports to do so. Please let me know. Any help would be appreciated. Thank You 🙂

---

<div class="post-metadata">

**Author:** ![timroes](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/timroes/32/19712_2.png) [@timroes](https://discuss.elastic.co/u/timroes)\
**Post date:** [March 22, 2018, 11:35am UTC](https://discuss.elastic.co/t/create-kibana-visulaization-on-the-fly-using-python-script/124779/8 "2018-03-22T11:35:02Z")

</div>

To be honest, if you are building that custom search solution and want to integrate charts in that, I would rather recommend not using Kibana for that. Since you are anyway developing some web frontends, I would recommend just loading the data from Elasticsearch via its API (the same as Kibana just using aggregations to load the data) and using any of the huge amount of charting libaries out there ([chart.js](http://www.chartjs.org/), [react-vis](http://www.chartjs.org/), ...) to visualize the data.

Embedding Kibana like you are trying into a different web solution will usually only will cause trouble in the long run and for sure isn't the most performent solution, since we need to load all of Kibana just to show a chart in your solution.

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [April 19, 2018, 11:35am UTC](https://discuss.elastic.co/t/create-kibana-visulaization-on-the-fly-using-python-script/124779/9 "2018-04-19T11:35:32Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.