# Impossible to use both Monitoring and DevTools Console with monitoring cluster on basic license(!)?

**URL:** <https://discuss.elastic.co/t/impossible-to-use-both-monitoring-and-devtools-console-with-monitoring-cluster-on-basic-license/104756>\
**Category:** Kibana\
**Created:** [October 21, 2017, 1:15am UTC](https://discuss.elastic.co/t/impossible-to-use-both-monitoring-and-devtools-console-with-monitoring-cluster-on-basic-license/104756 "2017-10-21T01:15:44Z")\
**Posts on this page:** 4\
**Page:** 1

<div class="post-metadata">

**Author:** ![aaron\_ximm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/aaron_ximm/32/61229_2.png) [@aaron\_ximm](https://discuss.elastic.co/u/aaron_ximm)\
**Post date:** [October 21, 2017, 1:15am UTC](https://discuss.elastic.co/t/impossible-to-use-both-monitoring-and-devtools-console-with-monitoring-cluster-on-basic-license/104756/1 "2017-10-21T01:15:44Z")

</div>

Hi,

I am in the process of migrating production services from ESv2 (last) to ES 5.6.3.

I have encountered a huge headache trying to replicate our vanilla management/monitoring setup with the 5.x Kibana - XPack Monitoring - DevTools console.

My situation is identical I think to the one described here: [Point Kibana 'Dev Tools' to remote ES cluster](https://discuss.elastic.co/t/point-kibana-dev-tools-to-remote-es-cluster/100768)

At root, all my problems begin with the fact that DevTools console no longer allows any change to "Server", or, as far as I can tell, any configuration setting which allows it to interrogate a different cluster than the Monitoring plugin.

Hence it appears totally broken for working with a monitoring cluster. I think????

That is,

I have two clusters, production, and monitoring.

Production exports data via exporters to monitoring cluster, as per usual.  
Monitoring did not export its own data; it has xpack.monitoring.disabled in elasticsearch.yml as per usual.

Up until now, in ESv2, we ran an instance of Kibana pointed at the monitoring cluster:  
kibana.yml had elasticsearch.url set to monitoring cluster.

This would source data for the monitoring correctly.

Then in Sense, we would edit the "Server" exposure of endpoint, to point at the _production_ cluster.

So: we were both _monitoring_ and able to _interact via Console_ with out production cluster.

This was I believe the standard way to use Kibana/Sense/Console when using a monitoring cluster.

Today my problemis that with ES/Kibana v5 this pattern is broken (as far as I can tell).

My ES v5 clusters are working correctly.  
My production cluster is exporting data to my monitoring cluster.  
My monitoring cluster has local export disabled.  
Kibana Monitoring is sourcing data (about the production cluster) correctly from the monitoring cluster.

But because the DevTools version of Console removed the exposure of "Server", it is no longer possible to _use_ DevTools console for any management of the _production_ cluster.

This is because Kibana is itself sourcing from the _monitoring_ cluster. And because the editable "Server" filed in the UI is removed, DevTools console only allows interaction with that cluster: the monitoring one.

The problem is that while the Monitoring plugin must source data from the monitoring cluster, the DevTools console _should be able to interrogate a different endpoint_: the production cluster.

I have read through the public documentation, and also developer discussion, of the removal of the "Server" field in the UI. I have read about the new "xpack.monitoring.elasticsearch.url" value in kibana.yml. I have tried every combination I can think of, to no avail.

The solution in the previous query like this, cited above, is no good for anything but queries.

It might (maybe) allow you to jury-rig access to _query_ your cluster, but we have always used Console for _all our administrative interrogation of the cluster_ - e.g. to check and change settings when performing recovery, ops tasks, rolling upgrades, etc etc etc.

This tool has been a godsend, I really want to be able to continue using it.

The _only_ workaround I have figured out so far is to run _two instances of Kibana_ just so I can configure _one_ for monitoring, and the _other_ for DevTools console activity. This is comical and a profound regression.

This is a real shame since I am overjoyed to see the return in Monitoring in 5x of a lot of the secondary analytics and nuance lost in the 1x to 2x refactor.

I am hoping I am just overlooking some magic combination...!

...but is it really no longer possible to use Kibana monitoring/administration with a monitoring cluster setup?

AFAI knew this was a very standard production deployment, I just can't believe something so fundamental is broken... 😕

All hints and pointers most welcome!

aaron

---

<div class="post-metadata">

**Author:** ![LeeDr](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/leedr/32/9289_2.png) [@LeeDr](https://discuss.elastic.co/u/LeeDr)\
**Post date:** [October 21, 2017, 12:42pm UTC](https://discuss.elastic.co/t/impossible-to-use-both-monitoring-and-devtools-console-with-monitoring-cluster-on-basic-license/104756/2 "2017-10-21T12:42:10Z")

</div>

Hi Aaron,

I think you have things switched around from the normal configuration. Normally people would set their elasticsearch.url to their production cluster (and that's where your .kibana index will be), and then set xpack.monitoring.elasticsearch.url to point to their monitoring cluster.

With these settings, monitoring should work. And your Kibana Dev Tools Console would also access the production cluster (only that cluster). And all your Kibana index patterns would be for data on the production cluster.

There is also another (slightly harder) way you could configure things. You could keep your Kibana pointing to your monitoring cluster (and it would have .kibana on it), and you could use cross cluster search to get to all the indices on your production cluster (including from the Console).  
Here's some info on it; [https://www.elastic.co/guide/en/elasticsearch/reference/current/modules-cross-cluster-search.html](https://www.elastic.co/guide/en/elasticsearch/reference/current/modules-cross-cluster-search.html)

Regards,  
Lee

---

<div class="post-metadata">

**Author:** ![aaron\_ximm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/aaron_ximm/32/61229_2.png) [@aaron\_ximm](https://discuss.elastic.co/u/aaron_ximm)\
**Post date:** [October 23, 2017, 11:16pm UTC](https://discuss.elastic.co/t/impossible-to-use-both-monitoring-and-devtools-console-with-monitoring-cluster-on-basic-license/104756/3 "2017-10-23T23:16:55Z")

</div>

Hi Lee,

Perils of posting late on a Friday,

I forgot to mention, I had tried that first, after reading about the introduction of the new configuration value xpack.monitoring.elasticsearch.url.

In Kibana 5.6.3, our result on first attempt was that Kibana receives data from two clusters, both production and monitoring...

...but found with our basic license, we are prohibited either from using monitoring with more than one cluster; and from specifying _which_ cluster is to be monitored. (We're a non-profit and buying a license is not really in scope. ☹ ) . In this case, the data source defaulted to the monitoring cluster itself (rather than its store of data from the production cluster) and this was immutable via the UI.

That might have been because on startup, I had not yet disabled xpack.monitoring in the elasticsearch.yml of the monitoring cluster nodes.

I had noticed and fixed that, and restarted the entire ES cluster, and Kibana... but it did not rectify the problem...

_But_ I just re-tried this on your advice, after wiping all the indices on the monitoring cluster, and restarting Kibana again, and now it seems to be working with that configuration. Yay!

(Possible tangentially related, Kibana did not detect when our (basic) license was posted to the monitoring cluster. I got the ack from the license acknowledgement step, but this was never reflected in Kibana's claim that we had a trial month long license.)

It is a huge relief that this setup is still possible!

Thanks for the sanity check!!!

aaron

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [November 20, 2017, 11:17pm UTC](https://discuss.elastic.co/t/impossible-to-use-both-monitoring-and-devtools-console-with-monitoring-cluster-on-basic-license/104756/4 "2017-11-20T23:17:05Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
