# Marvel not showing nodes stats

**URL:** <https://discuss.elastic.co/t/marvel-not-showing-nodes-stats/17783>\
**Category:** Elasticsearch\
**Created:** [May 28, 2014, 2:57pm UTC](https://discuss.elastic.co/t/marvel-not-showing-nodes-stats/17783 "2014-05-28T14:57:18Z")\
**Posts on this page:** 7\
**Page:** 1

<div class="post-metadata">

**Author:** ![prometheus](https://avatars.discourse-cdn.com/v4/letter/p/df788c/32.png) [@prometheus](https://discuss.elastic.co/u/prometheus)\
**Post date:** [May 28, 2014, 2:57pm UTC](https://discuss.elastic.co/t/marvel-not-showing-nodes-stats/17783/1 "2014-05-28T14:57:18Z")

</div>

Hi,

We have development test cluster 8 nodes running on 0.90.10 ES. Also we  
have one monitoring node separated from dev cluster for marvel.

We installed all nodes to marvel latest /1.1.1/ pointing to monitoring  
marvel IP in the ES config. Told the monitoring node not collect its data.

We restarted all nodes.

Waited hours......

we have only :

_CLUSTER SUMMARY_

- _Name:_ indictoYeni_Status:_ green_Nodes:_ 8_Indices:_ 15_Shards:_ 75  
_Data:_ 1.47 TB_CPU:_ 1311%_Memory:_ 111.68 GB / 235.20 GB\*Up time:\*19.9 h  
_Version:_ 0.90.10

But All other information is not available. It says in the dashboard below  
panel :

_Oops!_ FacetPhaseExecutionException[Facet [timestamp]: failed to find  
mapping for node.ip\_port.raw]

and

_Oops!_ FacetPhaseExecutionException[Facet [timestamp]: failed to find  
mapping for index.raw]

I couldnt find a fix.

Is there any solution to this ?

Thanks

PS

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/ce631c19-da03-4c31-9b11-98bf8d6d7d41%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/ce631c19-da03-4c31-9b11-98bf8d6d7d41%40googlegroups.com).  
For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).

---

<div class="post-metadata">

**Author:** ![prometheus](https://avatars.discourse-cdn.com/v4/letter/p/df788c/32.png) [@prometheus](https://discuss.elastic.co/u/prometheus)\
**Post date:** [May 28, 2014, 3:08pm UTC](https://discuss.elastic.co/t/marvel-not-showing-nodes-stats/17783/2 "2014-05-28T15:08:36Z")

</div>

Error log in the monitoring node:

* * *

[2014-05-28 17:28:20,009][DEBUG][action.search.type] [MarvelSE02]  
[.marvel-2014.05.28][2], node[44R9\_5vfRVmEJDgApyBRrQ], [P], s[STARTED]:  
Failed to execute [org.elasticsearch.action.search.SearchRequest@6c4e0d81]  
lastShard [true]  
org.elasticsearch.search.SearchParseException: [.marvel-2014.05.28][2]:  
query[ConstantScore(BooleanFilter(+cache(@timestamp:[1401283762615 TO  
1401287300008]) +cache(\_type:node\_stats) +cache(@timestamp:[1401286680000  
TO 1401287340000])))],from[-1],size[10]: Parse Failure [Failed to parse  
source  
[{"size":10,"query":{"filtered":{"query":{"match\_all":{}},"filter":{"bool":{"must":[{"range":{"@timestamp":{"from":1401283762615,"to":"now"}}},{"term":{"\_type":"node\_stats"}},{"range":{"@timestamp":{"from":"now-10m/m","to":"now/m"}}}]}}}},"facets":{"timestamp":{"terms\_stats":{"key\_field":"node.ip\_port.raw","value\_field":"@timestamp","order":"term","size":2000}},"master\_periods":{"terms\_stats":{"key\_field":"node.ip\_port.raw","value\_field":"@timestamp","order":"term","size":2000},"facet\_filter":{"term":{"node.master":"true"}}},"os.cpu.usage":{"terms\_stats":{"key\_field":"node.ip\_port.raw","value\_field":"os.cpu.usage","order":"term","size":2000}},"os.load\_average.1m":{"terms\_stats":{"key\_field":"node.ip\_port.raw","value\_field":"os.load\_average.1m","order":"term","size":2000}},"jvm.mem.heap\_used\_percent":{"terms\_stats":{"key\_field":"node.ip\_port.raw","value\_field":"jvm.mem.heap\_used\_percent","order":"term","size":2000}},"fs.total.available\_in\_bytes":{"terms\_stats":{"key\_field":"node.ip\_port.raw","value\_field":"fs.total.available\_in\_bytes","order":"term","size":2000}},"fs.total.disk\_io\_op":{"terms\_stats":{"key\_field":"node.ip\_port.raw","value\_field":"fs.total.disk\_io\_op","order":"term","size":2000}}}}]]  
at  
org.elasticsearch.search.SearchService.parseSource(SearchService.java:581)  
at  
org.elasticsearch.search.SearchService.createContext(SearchService.java:484)  
at  
org.elasticsearch.search.SearchService.createContext(SearchService.java:469)  
at  
org.elasticsearch.search.SearchService.createAndPutContext(SearchService.java:462)  
at  
org.elasticsearch.search.SearchService.executeQueryPhase(SearchService.java:234)  
at  
org.elasticsearch.search.action.SearchServiceTransportAction.sendExecuteQuery(SearchServiceTransportAction.java:202)  
at  
org.elasticsearch.action.search.type.TransportSearchQueryThenFetchAction$AsyncAction.sendExecuteFirstPhase(TransportSearchQueryThenFetchAction.java:80)  
at  
org.elasticsearch.action.search.type.TransportSearchTypeAction$BaseAsyncAction.performFirstPhase(TransportSearchTypeAction.java:216)  
at  
org.elasticsearch.action.search.type.TransportSearchTypeAction$BaseAsyncAction.performFirstPhase(TransportSearchTypeAction.java:203)  
at  
org.elasticsearch.action.search.type.TransportSearchTypeAction$BaseAsyncAction$2.run(TransportSearchTypeAction.java:186)  
at  
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)  
at  
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)  
at java.lang.Thread.run(Thread.java:724)  
Caused by: org.elasticsearch.search.facet.FacetPhaseExecutionException:  
Facet [timestamp]: failed to find mapping for node.ip\_port.raw  
at  
org.elasticsearch.search.facet.termsstats.TermsStatsFacetParser.parse(TermsStatsFacetParser.java:119)  
at  
org.elasticsearch.search.facet.FacetParseElement.parse(FacetParseElement.java:94)  
at  
org.elasticsearch.search.SearchService.parseSource(SearchService.java:569)  
... 12 more

* * *

On Wednesday, May 28, 2014 5:57:18 PM UTC+3, Prometheus WillSurvive wrote:

> Hi,
> 
> We have development test cluster 8 nodes running on 0.90.10 ES. Also we  
> have one monitoring node separated from dev cluster for marvel.
> 
> We installed all nodes to marvel latest /1.1.1/ pointing to monitoring  
> marvel IP in the ES config. Told the monitoring node not collect its data.
> 
> We restarted all nodes.
> 
> Waited hours......
> 
> we have only :
> 
> _CLUSTER SUMMARY_
> 
> - _Name:_ indictoYeni_Status:_ green_Nodes:_ 8_Indices:_ 15_Shards:_ 75  
> _Data:_ 1.47 TB_CPU:_ 1311%_Memory:_ 111.68 GB / 235.20 GB\*Up time:\*19.9 h  
> _Version:_ 0.90.10
> 
> But All other information is not available. It says in the dashboard below  
> panel :
> 
> _Oops!_ FacetPhaseExecutionException[Facet [timestamp]: failed to find  
> mapping for node.ip\_port.raw]
> 
> and
> 
> _Oops!_ FacetPhaseExecutionException[Facet [timestamp]: failed to find  
> mapping for index.raw]
> 
> I couldnt find a fix.
> 
> Is there any solution to this ?
> 
> Thanks
> 
> PS

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/fe8dd28d-1a27-44b8-8d00-5ebaffd5c428%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/fe8dd28d-1a27-44b8-8d00-5ebaffd5c428%40googlegroups.com).  
For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).

---

<div class="post-metadata">

**Author:** ![ElasticSearch\_Users\_](https://avatars.discourse-cdn.com/v4/letter/e/b4bc9f/32.png) [@ElasticSearch\_Users\_](https://discuss.elastic.co/u/ElasticSearch_Users_)\
**Post date:** [May 30, 2014, 10:05pm UTC](https://discuss.elastic.co/t/marvel-not-showing-nodes-stats/17783/3 "2014-05-30T22:05:07Z")

</div>

Are there any marvel errors on one of the data nodes that marvel is getting  
the data from? Usually you error means marvel could not ship the data over  
to the monitoring cluster.

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/c12edb40-cb79-46d5-a434-80a0b03cf731%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/c12edb40-cb79-46d5-a434-80a0b03cf731%40googlegroups.com).  
For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).

---

<div class="post-metadata">

**Author:** ![jeffbyrnes](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/jeffbyrnes/32/16424_2.png) [@jeffbyrnes](https://discuss.elastic.co/u/jeffbyrnes)\
**Post date:** [August 26, 2014, 9:23pm UTC](https://discuss.elastic.co/t/marvel-not-showing-nodes-stats/17783/4 "2014-08-26T21:23:22Z")

</div>

I'm experiencing a similar issue to this. We have two clusters:

- 2 node monitoring cluster (1 master/data & 1 just data)
- 5 node production cluster (2 data, 3 masters)

The output below is from the non-master data node of the Marvel monitoring  
cluster. There are no errors being reported by any of the production nodes.

[2014-08-26 21:10:51,503][DEBUG][action.search.type]  
[stage-search-marvel-1c] [.marvel-2014.08.26][2],  
node[iGRH8Gc2QO698RMlWy8rgQ], [P], s[STARTED]: Failed to execute  
[org.elasticsearch.action.search.SearchRequest@355e93ff]  
org.elasticsearch.transport.RemoteTransportException:  
[stage-search-marvel-1b][inet[/10.99.111.122:9300]][search/phase/query]  
Caused by: org.elasticsearch.search.SearchParseException:  
[.marvel-2014.08.26][2]: query[ConstantScore(BooleanFilter(+_:_  
+cache(\_type:index\_stats) +cache(@timestamp:[1409086800000 TO  
1409087460000])))],from[-1],size[10]: Parse Failure [Failed to parse source  
[{"size":10,"query":{"filtered":{"query":{"match\_all":{}},"filter":{"bool":{"must":[{"match\_all":{}},{"term":{"\_type":"index\_stats"}},{"range":{"@timestamp":{"from":"now-10m/m","to":"now/m"}}}]}}}},"facets":{"timestamp":{"terms\_stats":{"key\_field":"index.raw","value\_field":"@timestamp","order":"term","size":2000}},"primaries.docs.count":{"terms\_stats":{"key\_field":"index.raw","value\_field":"primaries.docs.count","order":"term","size":2000}},"primaries.indexing.index\_total":{"terms\_stats":{"key\_field":"index.raw","value\_field":"primaries.indexing.index\_total","order":"term","size":2000}},"total.search.query\_total":{"terms\_stats":{"key\_field":"index.raw","value\_field":"total.search.query\_total","order":"term","size":2000}},"total.merges.total\_size\_in\_bytes":{"terms\_stats":{"key\_field":"index.raw","value\_field":"total.merges.total\_size\_in\_bytes","order":"term","size":2000}},"total.fielddata.memory\_size\_in\_bytes":{"terms\_stats":{"key\_field":"index.raw","value\_field":"total.fielddata.memory\_size\_in\_bytes","order":"term","size":2000}}}}]]  
at  
org.elasticsearch.search.SearchService.parseSource(SearchService.java:664)  
at  
org.elasticsearch.search.SearchService.createContext(SearchService.java:515)  
at  
org.elasticsearch.search.SearchService.createAndPutContext(SearchService.java:487)  
at  
org.elasticsearch.search.SearchService.executeQueryPhase(SearchService.java:256)  
at  
org.elasticsearch.search.action.SearchServiceTransportAction$SearchQueryTransportHandler.messageReceived(SearchServiceTransportAction.java:688)  
at  
org.elasticsearch.search.action.SearchServiceTransportAction$SearchQueryTransportHandler.messageReceived(SearchServiceTransportAction.java:677)  
at  
org.elasticsearch.transport.netty.MessageChannelHandler$RequestHandler.run(MessageChannelHandler.java:275)  
at  
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)  
at  
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)  
at java.lang.Thread.run(Thread.java:745)  
Caused by: org.elasticsearch.search.facet.FacetPhaseExecutionException:  
Facet [timestamp]: failed to find mapping for index.raw  
at  
org.elasticsearch.search.facet.termsstats.TermsStatsFacetParser.parse(TermsStatsFacetParser.java:126)  
at  
org.elasticsearch.search.facet.FacetParseElement.parse(FacetParseElement.java:93)  
at  
org.elasticsearch.search.SearchService.parseSource(SearchService.java:648)  
... 9 more  
[2014-08-26 21:10:51,503][DEBUG][action.search.type]  
[stage-search-marvel-1c] [.marvel-2014.08.26][2],  
node[iGRH8Gc2QO698RMlWy8rgQ], [P], s[STARTED]: Failed to execute  
[org.elasticsearch.action.search.SearchRequest@32f235e9]  
org.elasticsearch.transport.RemoteTransportException:  
[stage-search-marvel-1b][inet[/10.99.111.122:9300]][search/phase/query]  
Caused by: org.elasticsearch.search.SearchParseException:  
[.marvel-2014.08.26][2]: query[ConstantScore(BooleanFilter(+_:_  
+cache(\_type:node\_stats) +cache(@timestamp:[1409086800000 TO  
1409087460000])))],from[-1],size[10]: Parse Failure [Failed to parse source  
[{"size":10,"query":{"filtered":{"query":{"match\_all":{}},"filter":{"bool":{"must":[{"match\_all":{}},{"term":{"\_type":"node\_stats"}},{"range":{"@timestamp":{"from":"now-10m/m","to":"now/m"}}}]}}}},"facets":{"timestamp":{"terms\_stats":{"key\_field":"node.ip\_port.raw","value\_field":"@timestamp","order":"term","size":2000}},"master\_nodes":{"terms":{"field":"node.ip\_port.raw","size":2000},"facet\_filter":{"term":{"node.master":"true"}}},"os.cpu.usage":{"terms\_stats":{"key\_field":"node.ip\_port.raw","value\_field":"os.cpu.usage","order":"term","size":2000}},"os.load\_average.1m":{"terms\_stats":{"key\_field":"node.ip\_port.raw","value\_field":"os.load\_average.1m","order":"term","size":2000}},"jvm.mem.heap\_used\_percent":{"terms\_stats":{"key\_field":"node.ip\_port.raw","value\_field":"jvm.mem.heap\_used\_percent","order":"term","size":2000}},"fs.total.available\_in\_bytes":{"terms\_stats":{"key\_field":"node.ip\_port.raw","value\_field":"fs.total.available\_in\_bytes","order":"term","size":2000}},"fs.total.disk\_io\_op":{"terms\_stats":{"key\_field":"node.ip\_port.raw","value\_field":"fs.total.disk\_io\_op","order":"term","size":2000}}}}]]  
at  
org.elasticsearch.search.SearchService.parseSource(SearchService.java:664)  
at  
org.elasticsearch.search.SearchService.createContext(SearchService.java:515)  
at  
org.elasticsearch.search.SearchService.createAndPutContext(SearchService.java:487)  
at  
org.elasticsearch.search.SearchService.executeQueryPhase(SearchService.java:256)  
at  
org.elasticsearch.search.action.SearchServiceTransportAction$SearchQueryTransportHandler.messageReceived(SearchServiceTransportAction.java:688)  
at  
org.elasticsearch.search.action.SearchServiceTransportAction$SearchQueryTransportHandler.messageReceived(SearchServiceTransportAction.java:677)  
at  
org.elasticsearch.transport.netty.MessageChannelHandler$RequestHandler.run(MessageChannelHandler.java:275)  
at  
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)  
at  
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)  
at java.lang.Thread.run(Thread.java:745)  
Caused by: org.elasticsearch.search.facet.FacetPhaseExecutionException:  
Facet [timestamp]: failed to find mapping for node.ip\_port.raw  
at  
org.elasticsearch.search.facet.termsstats.TermsStatsFacetParser.parse(TermsStatsFacetParser.java:126)  
at  
org.elasticsearch.search.facet.FacetParseElement.parse(FacetParseElement.java:93)  
at  
org.elasticsearch.search.SearchService.parseSource(SearchService.java:648)  
... 9 more  
[2014-08-26 21:10:51,504][DEBUG][action.search.type]  
[stage-search-marvel-1c] All shards failed for phase: [query]

On Wednesday, May 28, 2014 10:57:18 AM UTC-4, Prometheus WillSurvive wrote:

> Hi,
> 
> We have development test cluster 8 nodes running on 0.90.10 ES. Also we  
> have one monitoring node separated from dev cluster for marvel.
> 
> We installed all nodes to marvel latest /1.1.1/ pointing to monitoring  
> marvel IP in the ES config. Told the monitoring node not collect its data.
> 
> We restarted all nodes.
> 
> Waited hours......
> 
> we have only :
> 
> _CLUSTER SUMMARY_
> 
> - _Name:_ indictoYeni_Status:_ green_Nodes:_ 8_Indices:_ 15_Shards:_ 75  
> _Data:_ 1.47 TB_CPU:_ 1311%_Memory:_ 111.68 GB / 235.20 GB_Up time:_  
> 19.9 h_Version:_ 0.90.10
> 
> But All other information is not available. It says in the dashboard below  
> panel :
> 
> _Oops!_ FacetPhaseExecutionException[Facet [timestamp]: failed to find  
> mapping for node.ip\_port.raw]
> 
> and
> 
> _Oops!_ FacetPhaseExecutionException[Facet [timestamp]: failed to find  
> mapping for index.raw]
> 
> I couldnt find a fix.
> 
> Is there any solution to this ?
> 
> Thanks
> 
> PS

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/2940771a-7fbd-45f2-a617-3fcea36fff14%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/2940771a-7fbd-45f2-a617-3fcea36fff14%40googlegroups.com).  
For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).

---

<div class="post-metadata">

**Author:** ![Boaz\_Leskes](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/boaz_leskes/32/723_2.png) [@Boaz\_Leskes](https://discuss.elastic.co/u/Boaz_Leskes)\
**Post date:** [August 28, 2014, 8:41pm UTC](https://discuss.elastic.co/t/marvel-not-showing-nodes-stats/17783/5 "2014-08-28T20:41:13Z")

</div>

Jeff,

Two things can be at play:

1. Either you have no data (easily checked by direct call to the monitoring  
cluster, from Sense or curl )
2. Or something is wrong with the mapping - typically caused by missing an  
index template. Can you check wether your monitoring cluster has GET  
\_template/marvel ?

Cheers,  
Boaz

On Tuesday, August 26, 2014 11:23:22 PM UTC+2, Jeff Byrnes wrote:

> I'm experiencing a similar issue to this. We have two clusters:
> 
> - 2 node monitoring cluster (1 master/data & 1 just data)
> - 5 node production cluster (2 data, 3 masters)
> 
> The output below is from the non-master data node of the Marvel monitoring  
> cluster. There are no errors being reported by any of the production nodes.
> 
> [2014-08-26 21:10:51,503][DEBUG][action.search.type]  
> [stage-search-marvel-1c] [.marvel-2014.08.26][2],  
> node[iGRH8Gc2QO698RMlWy8rgQ], [P], s[STARTED]: Failed to execute  
> [org.elasticsearch.action.search.SearchRequest@355e93ff]  
> org.elasticsearch.transport.RemoteTransportException:  
> [stage-search-marvel-1b][inet[/10.99.111.122:9300]][search/phase/query]  
> Caused by: org.elasticsearch.search.SearchParseException:  
> [.marvel-2014.08.26][2]: query[ConstantScore(BooleanFilter(+_:_  
> +cache(\_type:index\_stats) +cache(@timestamp:[1409086800000 TO  
> 1409087460000])))],from[-1],size[10]: Parse Failure [Failed to parse source  
> [{"size":10,"query":{"filtered":{"query":{"match\_all":{}},"filter":{"bool":{"must":[{"match\_all":{}},{"term":{"\_type":"index\_stats"}},{"range":{"@timestamp":{"from":"now-10m/m","to":"now/m"}}}]}}}},"facets":{"timestamp":{"terms\_stats":{"key\_field":"index.raw","value\_field":"@timestamp","order":"term","size":2000}},"primaries.docs.count":{"terms\_stats":{"key\_field":"index.raw","value\_field":"primaries.docs.count","order":"term","size":2000}},"primaries.indexing.index\_total":{"terms\_stats":{"key\_field":"index.raw","value\_field":"primaries.indexing.index\_total","order":"term","size":2000}},"total.search.query\_total":{"terms\_stats":{"key\_field":"index.raw","value\_field":"total.search.query\_total","order":"term","size":2000}},"total.merges.total\_size\_in\_bytes":{"terms\_stats":{"key\_field":"index.raw","value\_field":"total.merges.total\_size\_in\_bytes","order":"term","size":2000}},"total.fielddata.memory\_size\_in\_bytes":{"terms\_stats":{"key\_field":"index.raw","value\_field":"total.fielddata.memory\_size\_in\_bytes","order":"term","size":2000}}}}]]  
> at  
> org.elasticsearch.search.SearchService.parseSource(SearchService.java:664)  
> at  
> org.elasticsearch.search.SearchService.createContext(SearchService.java:515)  
> at  
> org.elasticsearch.search.SearchService.createAndPutContext(SearchService.java:487)  
> at  
> org.elasticsearch.search.SearchService.executeQueryPhase(SearchService.java:256)  
> at  
> org.elasticsearch.search.action.SearchServiceTransportAction$SearchQueryTransportHandler.messageReceived(SearchServiceTransportAction.java:688)  
> at  
> org.elasticsearch.search.action.SearchServiceTransportAction$SearchQueryTransportHandler.messageReceived(SearchServiceTransportAction.java:677)  
> at  
> org.elasticsearch.transport.netty.MessageChannelHandler$RequestHandler.run(MessageChannelHandler.java:275)  
> at  
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)  
> at  
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)  
> at java.lang.Thread.run(Thread.java:745)  
> Caused by: org.elasticsearch.search.facet.FacetPhaseExecutionException:  
> Facet [timestamp]: failed to find mapping for index.raw  
> at  
> org.elasticsearch.search.facet.termsstats.TermsStatsFacetParser.parse(TermsStatsFacetParser.java:126)  
> at  
> org.elasticsearch.search.facet.FacetParseElement.parse(FacetParseElement.java:93)  
> at  
> org.elasticsearch.search.SearchService.parseSource(SearchService.java:648)  
> ... 9 more  
> [2014-08-26 21:10:51,503][DEBUG][action.search.type]  
> [stage-search-marvel-1c] [.marvel-2014.08.26][2],  
> node[iGRH8Gc2QO698RMlWy8rgQ], [P], s[STARTED]: Failed to execute  
> [org.elasticsearch.action.search.SearchRequest@32f235e9]  
> org.elasticsearch.transport.RemoteTransportException:  
> [stage-search-marvel-1b][inet[/10.99.111.122:9300]][search/phase/query]  
> Caused by: org.elasticsearch.search.SearchParseException:  
> [.marvel-2014.08.26][2]: query[ConstantScore(BooleanFilter(+_:_  
> +cache(\_type:node\_stats) +cache(@timestamp:[1409086800000 TO  
> 1409087460000])))],from[-1],size[10]: Parse Failure [Failed to parse source  
> [{"size":10,"query":{"filtered":{"query":{"match\_all":{}},"filter":{"bool":{"must":[{"match\_all":{}},{"term":{"\_type":"node\_stats"}},{"range":{"@timestamp":{"from":"now-10m/m","to":"now/m"}}}]}}}},"facets":{"timestamp":{"terms\_stats":{"key\_field":"node.ip\_port.raw","value\_field":"@timestamp","order":"term","size":2000}},"master\_nodes":{"terms":{"field":"node.ip\_port.raw","size":2000},"facet\_filter":{"term":{"node.master":"true"}}},"os.cpu.usage":{"terms\_stats":{"key\_field":"node.ip\_port.raw","value\_field":"os.cpu.usage","order":"term","size":2000}},"os.load\_average.1m":{"terms\_stats":{"key\_field":"node.ip\_port.raw","value\_field":"os.load\_average.1m","order":"term","size":2000}},"jvm.mem.heap\_used\_percent":{"terms\_stats":{"key\_field":"node.ip\_port.raw","value\_field":"jvm.mem.heap\_used\_percent","order":"term","size":2000}},"fs.total.available\_in\_bytes":{"terms\_stats":{"key\_field":"node.ip\_port.raw","value\_field":"fs.total.available\_in\_bytes","order":"term","size":2000}},"fs.total.disk\_io\_op":{"terms\_stats":{"key\_field":"node.ip\_port.raw","value\_field":"fs.total.disk\_io\_op","order":"term","size":2000}}}}]]  
> at  
> org.elasticsearch.search.SearchService.parseSource(SearchService.java:664)  
> at  
> org.elasticsearch.search.SearchService.createContext(SearchService.java:515)  
> at  
> org.elasticsearch.search.SearchService.createAndPutContext(SearchService.java:487)  
> at  
> org.elasticsearch.search.SearchService.executeQueryPhase(SearchService.java:256)  
> at  
> org.elasticsearch.search.action.SearchServiceTransportAction$SearchQueryTransportHandler.messageReceived(SearchServiceTransportAction.java:688)  
> at  
> org.elasticsearch.search.action.SearchServiceTransportAction$SearchQueryTransportHandler.messageReceived(SearchServiceTransportAction.java:677)  
> at  
> org.elasticsearch.transport.netty.MessageChannelHandler$RequestHandler.run(MessageChannelHandler.java:275)  
> at  
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)  
> at  
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)  
> at java.lang.Thread.run(Thread.java:745)  
> Caused by: org.elasticsearch.search.facet.FacetPhaseExecutionException:  
> Facet [timestamp]: failed to find mapping for node.ip\_port.raw  
> at  
> org.elasticsearch.search.facet.termsstats.TermsStatsFacetParser.parse(TermsStatsFacetParser.java:126)  
> at  
> org.elasticsearch.search.facet.FacetParseElement.parse(FacetParseElement.java:93)  
> at  
> org.elasticsearch.search.SearchService.parseSource(SearchService.java:648)  
> ... 9 more  
> [2014-08-26 21:10:51,504][DEBUG][action.search.type]  
> [stage-search-marvel-1c] All shards failed for phase: [query]
> 
> On Wednesday, May 28, 2014 10:57:18 AM UTC-4, Prometheus WillSurvive wrote:
> 
> > Hi,
> > 
> > We have development test cluster 8 nodes running on 0.90.10 ES. Also we  
> > have one monitoring node separated from dev cluster for marvel.
> > 
> > We installed all nodes to marvel latest /1.1.1/ pointing to monitoring  
> > marvel IP in the ES config. Told the monitoring node not collect its data.
> > 
> > We restarted all nodes.
> > 
> > Waited hours......
> > 
> > we have only :
> > 
> > _CLUSTER SUMMARY_
> > 
> > - _Name:_ indictoYeni_Status:_ green_Nodes:_ 8_Indices:_ 15_Shards:_  
> > 75_Data:_ 1.47 TB_CPU:_ 1311%_Memory:_ 111.68 GB / 235.20 GB_Up time:_  
> > 19.9 h_Version:_ 0.90.10
> > 
> > But All other information is not available. It says in the dashboard  
> > below panel :
> > 
> > _Oops!_ FacetPhaseExecutionException[Facet [timestamp]: failed to find  
> > mapping for node.ip\_port.raw]
> > 
> > and
> > 
> > _Oops!_ FacetPhaseExecutionException[Facet [timestamp]: failed to find  
> > mapping for index.raw]
> > 
> > I couldnt find a fix.
> > 
> > Is there any solution to this ?
> > 
> > Thanks
> > 
> > PS

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/5c4bdbd0-e80f-4357-81cc-d30a8120f6ce%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/5c4bdbd0-e80f-4357-81cc-d30a8120f6ce%40googlegroups.com).  
For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).

---

<div class="post-metadata">

**Author:** ![jeffbyrnes](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/jeffbyrnes/32/16424_2.png) [@jeffbyrnes](https://discuss.elastic.co/u/jeffbyrnes)\
**Post date:** [August 28, 2014, 8:42pm UTC](https://discuss.elastic.co/t/marvel-not-showing-nodes-stats/17783/6 "2014-08-28T20:42:35Z")

</div>

Boaz,

Thanks for the response; I checked on it late yesterday, and it seems to have righted itself somehow. I brought up another cluster this morning, and it immediately received all the node & index data properly, so I must have gotten something stuck on my first try.

Thanks for the response!

--  
Jeff Byrnes  
@berkleebassist  
Operations Engineer  
EverTrue  
704.516.4628

On August 28, 2014 at 4:41:13 PM, Boaz Leskes ([b.leskes@gmail.com](mailto:b.leskes@gmail.com)) wrote:

Jeff,

Two things can be at play:

1. Either you have no data (easily checked by direct call to the monitoring cluster, from Sense or curl )
2. Or something is wrong with the mapping - typically caused by missing an index template. Can you check wether your monitoring cluster has GET \_template/marvel ?

Cheers,  
Boaz

On Tuesday, August 26, 2014 11:23:22 PM UTC+2, Jeff Byrnes wrote:  
I'm experiencing a similar issue to this. We have two clusters:  
2 node monitoring cluster (1 master/data & 1 just data)  
5 node production cluster (2 data, 3 masters)  
The output below is from the non-master data node of the Marvel monitoring cluster. There are no errors being reported by any of the production nodes.

[2014-08-26 21:10:51,503][DEBUG][action.search.type] [stage-search-marvel-1c] [.marvel-2014.08.26][2], node[iGRH8Gc2QO698RMlWy8rgQ], [P], s[STARTED]: Failed to execute [org.elasticsearch.action.search.SearchRequest@355e93ff]  
org.elasticsearch.transport.RemoteTransportException: [stage-search-marvel-1b][inet[/10.99.111.122:9300]][search/phase/query]  
Caused by: org.elasticsearch.search.SearchParseException: [.marvel-2014.08.26][2]: query[ConstantScore(BooleanFilter(+_:_ +cache(\_type:index\_stats) +cache(@timestamp:[1409086800000 TO 1409087460000])))],from[-1],size[10]: Parse Failure [Failed to parse source [{"size":10,"query":{"filtered":{"query":{"match\_all":{}},"filter":{"bool":{"must":[{"match\_all":{}},{"term":{"\_type":"index\_stats"}},{"range":{"@timestamp":{"from":"now-10m/m","to":"now/m"}}}]}}}},"facets":{"timestamp":{"terms\_stats":{"key\_field":"index.raw","value\_field":"@timestamp","order":"term","size":2000}},"primaries.docs.count":{"terms\_stats":{"key\_field":"index.raw","value\_field":"primaries.docs.count","order":"term","size":2000}},"primaries.indexing.index\_total":{"terms\_stats":{"key\_field":"index.raw","value\_field":"primaries.indexing.index\_total","order":"term","size":2000}},"total.search.query\_total":{"terms\_stats":{"key\_field":"index.raw","value\_field":"total.search.query\_total","order":"term","size":2000}},"total.merges.total\_size\_in\_bytes":{"terms\_stats":{"key\_field":"index.raw","value\_field":"total.merges.total\_size\_in\_bytes","order":"term","size":2000}},"total.fielddata.memory\_size\_in\_bytes":{"terms\_stats":{"key\_field":"index.raw","value\_field":"total.fielddata.memory\_size\_in\_bytes","order":"term","size":2000}}}}]]  
at org.elasticsearch.search.SearchService.parseSource(SearchService.java:664)  
at org.elasticsearch.search.SearchService.createContext(SearchService.java:515)  
at org.elasticsearch.search.SearchService.createAndPutContext(SearchService.java:487)  
at org.elasticsearch.search.SearchService.executeQueryPhase(SearchService.java:256)  
at org.elasticsearch.search.action.SearchServiceTransportAction$SearchQueryTransportHandler.messageReceived(SearchServiceTransportAction.java:688)  
at org.elasticsearch.search.action.SearchServiceTransportAction$SearchQueryTransportHandler.messageReceived(SearchServiceTransportAction.java:677)  
at org.elasticsearch.transport.netty.MessageChannelHandler$RequestHandler.run(MessageChannelHandler.java:275)  
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)  
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)  
at java.lang.Thread.run(Thread.java:745)  
Caused by: org.elasticsearch.search.facet.FacetPhaseExecutionException: Facet [timestamp]: failed to find mapping for index.raw  
at org.elasticsearch.search.facet.termsstats.TermsStatsFacetParser.parse(TermsStatsFacetParser.java:126)  
at org.elasticsearch.search.facet.FacetParseElement.parse(FacetParseElement.java:93)  
at org.elasticsearch.search.SearchService.parseSource(SearchService.java:648)  
... 9 more  
[2014-08-26 21:10:51,503][DEBUG][action.search.type] [stage-search-marvel-1c] [.marvel-2014.08.26][2], node[iGRH8Gc2QO698RMlWy8rgQ], [P], s[STARTED]: Failed to execute [org.elasticsearch.action.search.SearchRequest@32f235e9]  
org.elasticsearch.transport.RemoteTransportException: [stage-search-marvel-1b][inet[/10.99.111.122:9300]][search/phase/query]  
Caused by: org.elasticsearch.search.SearchParseException: [.marvel-2014.08.26][2]: query[ConstantScore(BooleanFilter(+_:_ +cache(\_type:node\_stats) +cache(@timestamp:[1409086800000 TO 1409087460000])))],from[-1],size[10]: Parse Failure [Failed to parse source [{"size":10,"query":{"filtered":{"query":{"match\_all":{}},"filter":{"bool":{"must":[{"match\_all":{}},{"term":{"\_type":"node\_stats"}},{"range":{"@timestamp":{"from":"now-10m/m","to":"now/m"}}}]}}}},"facets":{"timestamp":{"terms\_stats":{"key\_field":"node.ip\_port.raw","value\_field":"@timestamp","order":"term","size":2000}},"master\_nodes":{"terms":{"field":"node.ip\_port.raw","size":2000},"facet\_filter":{"term":{"node.master":"true"}}},"os.cpu.usage":{"terms\_stats":{"key\_field":"node.ip\_port.raw","value\_field":"os.cpu.usage","order":"term","size":2000}},"os.load\_average.1m":{"terms\_stats":{"key\_field":"node.ip\_port.raw","value\_field":"os.load\_average.1m","order":"term","size":2000}},"jvm.mem.heap\_used\_percent":{"terms\_stats":{"key\_field":"node.ip\_port.raw","value\_field":"jvm.mem.heap\_used\_percent","order":"term","size":2000}},"fs.total.available\_in\_bytes":{"terms\_stats":{"key\_field":"node.ip\_port.raw","value\_field":"fs.total.available\_in\_bytes","order":"term","size":2000}},"fs.total.disk\_io\_op":{"terms\_stats":{"key\_field":"node.ip\_port.raw","value\_field":"fs.total.disk\_io\_op","order":"term","size":2000}}}}]]  
at org.elasticsearch.search.SearchService.parseSource(SearchService.java:664)  
at org.elasticsearch.search.SearchService.createContext(SearchService.java:515)  
at org.elasticsearch.search.SearchService.createAndPutContext(SearchService.java:487)  
at org.elasticsearch.search.SearchService.executeQueryPhase(SearchService.java:256)  
at org.elasticsearch.search.action.SearchServiceTransportAction$SearchQueryTransportHandler.messageReceived(SearchServiceTransportAction.java:688)  
at org.elasticsearch.search.action.SearchServiceTransportAction$SearchQueryTransportHandler.messageReceived(SearchServiceTransportAction.java:677)  
at org.elasticsearch.transport.netty.MessageChannelHandler$RequestHandler.run(MessageChannelHandler.java:275)  
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)  
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)  
at java.lang.Thread.run(Thread.java:745)  
Caused by: org.elasticsearch.search.facet.FacetPhaseExecutionException: Facet [timestamp]: failed to find mapping for node.ip\_port.raw  
at org.elasticsearch.search.facet.termsstats.TermsStatsFacetParser.parse(TermsStatsFacetParser.java:126)  
at org.elasticsearch.search.facet.FacetParseElement.parse(FacetParseElement.java:93)  
at org.elasticsearch.search.SearchService.parseSource(SearchService.java:648)  
... 9 more  
[2014-08-26 21:10:51,504][DEBUG][action.search.type] [stage-search-marvel-1c] All shards failed for phase: [query]

On Wednesday, May 28, 2014 10:57:18 AM UTC-4, Prometheus WillSurvive wrote:  
Hi,

We have development test cluster 8 nodes running on 0.90.10 ES. Also we have one monitoring node separated from dev cluster for marvel.

We installed all nodes to marvel latest /1.1.1/ pointing to monitoring marvel IP in the ES config. Told the monitoring node not collect its data.

We restarted all nodes.

Waited hours......

we have only :  
CLUSTER SUMMARY

Name: indictoYeniStatus: greenNodes: 8Indices: 15Shards: 75Data: 1.47 TBCPU: 1311%Memory: 111.68 GB / 235.20 GBUp time: 19.9 hVersion: 0.90.10  
But All other information is not available. It says in the dashboard below panel :

Oops! FacetPhaseExecutionException[Facet [timestamp]: failed to find mapping for node.ip\_port.raw]

and

Oops! FacetPhaseExecutionException[Facet [timestamp]: failed to find mapping for index.raw]

I couldnt find a fix.

Is there any solution to this ?

Thanks

PS

--  
You received this message because you are subscribed to a topic in the Google Groups "elasticsearch" group.  
To unsubscribe from this topic, visit [https://groups.google.com/d/topic/elasticsearch/79aAgZ\_YQHc/unsubscribe](https://groups.google.com/d/topic/elasticsearch/79aAgZ_YQHc/unsubscribe).  
To unsubscribe from this group and all its topics, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/5c4bdbd0-e80f-4357-81cc-d30a8120f6ce%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/5c4bdbd0-e80f-4357-81cc-d30a8120f6ce%40googlegroups.com).  
For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/etPan.53ff943f.66334873.2540%40Jeff-MacBook-Pro](https://groups.google.com/d/msgid/elasticsearch/etPan.53ff943f.66334873.2540%40Jeff-MacBook-Pro).  
For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [July 6, 2017, 1:05am UTC](https://discuss.elastic.co/t/marvel-not-showing-nodes-stats/17783/7 "2017-07-06T01:05:37Z")

</div>


