# Weird behavior with cross cluster settings search.remote vs cluster.remote (elastic v6.5.4)

**URL:** <https://discuss.elastic.co/t/weird-behavior-with-cross-cluster-settings-search-remote-vs-cluster-remote-elastic-v6-5-4/301980>\
**Category:** Elasticsearch\
**Tags:** ccs-cross-cluster-search\
**Created:** [April 8, 2022, 2:16pm UTC](https://discuss.elastic.co/t/weird-behavior-with-cross-cluster-settings-search-remote-vs-cluster-remote-elastic-v6-5-4/301980 "2022-04-08T14:16:18Z")\
**Posts on this page:** 3\
**Page:** 1

<div class="post-metadata">

**Author:** ![dcausse](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dcausse/32/97582_2.png) [@dcausse](https://discuss.elastic.co/u/dcausse)\
**Post date:** [April 8, 2022, 2:16pm UTC](https://discuss.elastic.co/t/weird-behavior-with-cross-cluster-settings-search-remote-vs-cluster-remote-elastic-v6-5-4/301980/1 "2022-04-08T14:16:18Z")

</div>

Hi,

we are running Elasticsearch 6.5.4 and we started to use cross cluster search since 6.3. Our settings were using the `search.remote` section in the cluster settings and since 6.5 we started using the new preferred `cluster.remote` section.

Recently I realized that we have both sections in our cluster settings with both configuring same clusters, e.g.:  
`persistent.search.remote.cluster1.seeds : ["node1", "node2"]`  
and  
`persistent.cluster.remote.cluster1.seeds : ["node10", "node12"]`

Note that `node1` and `node2` are no longer part of `cluster1`.  
After a rolling-restart of this cluster we noticed that search requests relyng on CCS failed with: ` remote_transport_exception: [error while communicating with remote cluster [cluster1]]`.

I tried removing the `persistent.search.remote` section but it failed saying `persistent setting [search.remote], not recognized`.  
I tried to _empty_ the seeds of `persistent.search.remote.cluster1` but it emptied the seeds of `persistent.cluster.remote.cluster1`.  
I re-added proper seeds (node10 and node12 here) to `persistent.search.remote.cluster1` and the errors stopped but it only affected `persistent.cluster.remote.cluster1` leaving `persistent.search.remote.cluster1` with the old nodes.

In the end the settings remain the same as when the errors occurred:  
`persistent.search.remote.cluster1.seeds : ["node1", "node2"]`  
`persistent.cluster.remote.cluster1.seeds : ["node10", "node12"]`

Could there be some loading inconsistency that could explain why the same settings caused CCS errors but that the errors disappeared when some of the settings were re-imported again?

Is there a way to purge the old `persistent.search` settings with 6.5.4?

I suspect that this might be related to:

- [Generalize search.remote settings to cluster.remote by jasontedor · Pull Request #33413 · elastic/elasticsearch · GitHub](https://github.com/elastic/elasticsearch/pull/33413)
- and [Fix remote cluster seeds fallback by jasontedor · Pull Request #34090 · elastic/elasticsearch · GitHub](https://github.com/elastic/elasticsearch/pull/34090)

But looking at the later (which seems to fix some issues related to what we see) I see that it might fail when there's a duplicated cluster in both `cluster.remote` and `search.remote` section and thus I worry that if we don't manage to clean up this old `search.remote` section we might hit a wall when upgrading to newer versions of Elasticsearch.

Thank you!

David.

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [April 8, 2022, 2:16pm UTC](https://discuss.elastic.co/t/weird-behavior-with-cross-cluster-settings-search-remote-vs-cluster-remote-elastic-v6-5-4/301980/2 "2022-04-08T14:16:18Z")

</div>

Elasticsearch 6.5 is [EOL](https://www.elastic.co/support/eol) and no longer supported. Please upgrade ASAP.

(This is an automated response from your friendly Elastic bot. Please report this post if you have any suggestions or concerns :elasticheart: )

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [May 6, 2022, 2:16pm UTC](https://discuss.elastic.co/t/weird-behavior-with-cross-cluster-settings-search-remote-vs-cluster-remote-elastic-v6-5-4/301980/3 "2022-05-06T14:16:58Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.