# Marvel not collecting system metrics

**URL:** <https://discuss.elastic.co/t/marvel-not-collecting-system-metrics/15792>\
**Category:** Elasticsearch\
**Created:** [February 14, 2014, 2:57am UTC](https://discuss.elastic.co/t/marvel-not-collecting-system-metrics/15792 "2014-02-14T02:57:46Z")\
**Posts on this page:** 14\
**Page:** 1

<div class="post-metadata">

**Author:** ![Scott\_Likens](https://avatars.discourse-cdn.com/v4/letter/s/b4bc9f/32.png) [@Scott\_Likens](https://discuss.elastic.co/u/Scott_Likens)\
**Post date:** [February 14, 2014, 2:57am UTC](https://discuss.elastic.co/t/marvel-not-collecting-system-metrics/15792/1 "2014-02-14T02:57:46Z")

</div>

Hi,

I've been deploying Elasticsearch with Docker and it's been working great.  
So I added the Marvel plugin and I get a ton of these in my Elasticsearch  
error log and no system metrics in Marvel. ☹

[2014-02-14 02:55:02,753][DEBUG][action.search.type] [Kamal]  
[.marvel-2014.02.14][0], node[\_Ofz6YYlTc2hA9ASu3qlRg], [P], s[STARTED]:  
Failed to execute [org.elasticsearch.action.search.SearchRequest@53b9f5]  
org.elasticsearch.search.SearchParseException: [.marvel-2014.02.14][0]:  
query[ConstantScore(BooleanFilter(+no\_cache(@timestamp:[1392342894189 TO  
1392346502752]) +cache(\_type:node\_stats) +cache(@timestamp:[1392345900000  
TO 1392346560000])))],from[-1],size[0]: Parse Failure [Failed to parse  
source  
[{"size":0,"query":{"filtered":{"query":{"match\_all":{}},"filter":{"bool":{"must":[{"range":{"@timestamp":{"from":1392342894189,"to":"now"}}},{"term":{"\_type":"node\_stats"}},{"range":{"@timestamp":{"from":"now-10m/m","to":"now/m"}}}]}}}},"facets":{"timestamp":{"terms\_stats":{"key\_field":"node.ip\_port.raw","value\_field":"@timestamp","order":"term","size":2000}},"os.cpu.usage":{"terms\_stats":{"key\_field":"node.ip\_port.raw","value\_field":"os.cpu.usage","order":"term","size":2000}},"os.load\_average.1m":{"terms\_stats":{"key\_field":"node.ip\_port.raw","value\_field":"os.load\_average.1m","order":"term","size":2000}},"jvm.mem.heap\_used\_percent":{"terms\_stats":{"key\_field":"node.ip\_port.raw","value\_field":"jvm.mem.heap\_used\_percent","order":"term","size":2000}},"fs.total.available\_in\_bytes":{"terms\_stats":{"key\_field":"node.ip\_port.raw","value\_field":"fs.total.available\_in\_bytes","order":"term","size":2000}},"fs.total.disk\_io\_op":{"terms\_stats":{"key\_field":"node.ip\_port.raw","value\_field":"fs.total.disk\_io\_op","order":"term","size":2000}}}}]]  
at  
org.elasticsearch.search.SearchService.parseSource(SearchService.java:586)  
at  
org.elasticsearch.search.SearchService.createContext(SearchService.java:489)  
at  
org.elasticsearch.search.SearchService.createContext(SearchService.java:474)  
at  
org.elasticsearch.search.SearchService.createAndPutContext(SearchService.java:467)  
at  
org.elasticsearch.search.SearchService.executeQueryPhase(SearchService.java:239)  
at  
org.elasticsearch.search.action.SearchServiceTransportAction.sendExecuteQuery(SearchServiceTransportAction.java:202)  
at  
org.elasticsearch.action.search.type.TransportSearchCountAction$AsyncAction.sendExecuteFirstPhase(TransportSearchCountAction.java:70)  
at  
org.elasticsearch.action.search.type.TransportSearchTypeAction$BaseAsyncAction.performFirstPhase(TransportSearchTypeAction.java:216)  
at  
org.elasticsearch.action.search.type.TransportSearchTypeAction$BaseAsyncAction.performFirstPhase(TransportSearchTypeAction.java:203)  
at  
org.elasticsearch.action.search.type.TransportSearchTypeAction$BaseAsyncAction$2.run(TransportSearchTypeAction.java:186)  
at  
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)  
at  
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)  
at java.lang.Thread.run(Thread.java:744)  
Caused by: org.elasticsearch.search.facet.FacetPhaseExecutionException:  
Facet [fs.total.available\_in\_bytes]: failed to find mapping for  
fs.total.available\_in\_bytes  
at  
org.elasticsearch.search.facet.termsstats.TermsStatsFacetParser.parse(TermsStatsFacetParser.java:132)  
at  
org.elasticsearch.search.facet.FacetParseElement.parse(FacetParseElement.java:93)  
at  
org.elasticsearch.search.SearchService.parseSource(SearchService.java:574)  
... 12 more

Making Marvel only semi-useful; I don't have anything disabled in my  
elasticsearch.yml it's pretty stock; any help?

I tried asking in IRC but #elasticsearch isn't very helpful with questions  
in regards to Marvel.

Thanks!

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/326afeb5-1282-4ccd-979e-689556f84403%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/326afeb5-1282-4ccd-979e-689556f84403%40googlegroups.com).  
For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out).

---

<div class="post-metadata">

**Author:** ![Scott\_Likens](https://avatars.discourse-cdn.com/v4/letter/s/b4bc9f/32.png) [@Scott\_Likens](https://discuss.elastic.co/u/Scott_Likens)\
**Post date:** [February 14, 2014, 4:03am UTC](https://discuss.elastic.co/t/marvel-not-collecting-system-metrics/15792/2 "2014-02-14T04:03:20Z")

</div>

I forgot to mention, the Dockerfiles I use to build my Elasticsearch are at  
[GitHub - damm/dockerfiles: My Dockerfiles](http://github.com/damm/dockerfiles); feel free to review the java/ image for how I  
build java and elasticsearch/ for ES.

Is it possible there's some external tools I need installed?

Thanks!

On Thu, Feb 13, 2014 at 6:57 PM, Scott Likens [smlikens@gmail.com](mailto:smlikens@gmail.com) wrote:

> Hi,
> 
> I've been deploying Elasticsearch with Docker and it's been working great.  
> So I added the Marvel plugin and I get a ton of these in my Elasticsearch  
> error log and no system metrics in Marvel. ☹
> 
> [2014-02-14 02:55:02,753][DEBUG][action.search.type] [Kamal]  
> [.marvel-2014.02.14][0], node[\_Ofz6YYlTc2hA9ASu3qlRg], [P], s[STARTED]:  
> Failed to execute [org.elasticsearch.action.search.SearchRequest@53b9f5]  
> org.elasticsearch.search.SearchParseException: [.marvel-2014.02.14][0]:  
> query[ConstantScore(BooleanFilter(+no\_cache(@timestamp:[1392342894189 TO  
> 1392346502752]) +cache(\_type:node\_stats) +cache(@timestamp:[1392345900000  
> TO 1392346560000])))],from[-1],size[0]: Parse Failure [Failed to parse  
> source  
> [{"size":0,"query":{"filtered":{"query":{"match\_all":{}},"filter":{"bool":{"must":[{"range":{"@timestamp":{"from":1392342894189,"to":"now"}}},{"term":{"\_type":"node\_stats"}},{"range":{"@timestamp":{"from":"now-10m/m","to":"now/m"}}}]}}}},"facets":{"timestamp":{"terms\_stats":{"key\_field":"node.ip\_port.raw","value\_field":"@timestamp","order":"term","size":2000}},"os.cpu.usage":{"terms\_stats":{"key\_field":"node.ip\_port.raw","value\_field":"os.cpu.usage","order":"term","size":2000}},"os.load\_average.1m":{"terms\_stats":{"key\_field":"node.ip\_port.raw","value\_field":"os.load\_average.1m","order":"term","size":2000}},"jvm.mem.heap\_used\_percent":{"terms\_stats":{"key\_field":"node.ip\_port.raw","value\_field":"jvm.mem.heap\_used\_percent","order":"term","size":2000}},"fs.total.available\_in\_bytes":{"terms\_stats":{"key\_field":"node.ip\_port.raw","value\_field":"fs.total.available\_in\_bytes","order":"term","size":2000}},"fs.total.disk\_io\_op":{"terms\_stats":{"key\_field":"node.ip\_port.raw","value\_field":"fs.total.disk\_io\_op","order":"term","size":2000}}}}]]  
> at  
> org.elasticsearch.search.SearchService.parseSource(SearchService.java:586)  
> at  
> org.elasticsearch.search.SearchService.createContext(SearchService.java:489)  
> at  
> org.elasticsearch.search.SearchService.createContext(SearchService.java:474)  
> at  
> org.elasticsearch.search.SearchService.createAndPutContext(SearchService.java:467)  
> at  
> org.elasticsearch.search.SearchService.executeQueryPhase(SearchService.java:239)  
> at  
> org.elasticsearch.search.action.SearchServiceTransportAction.sendExecuteQuery(SearchServiceTransportAction.java:202)  
> at  
> org.elasticsearch.action.search.type.TransportSearchCountAction$AsyncAction.sendExecuteFirstPhase(TransportSearchCountAction.java:70)  
> at  
> org.elasticsearch.action.search.type.TransportSearchTypeAction$BaseAsyncAction.performFirstPhase(TransportSearchTypeAction.java:216)  
> at  
> org.elasticsearch.action.search.type.TransportSearchTypeAction$BaseAsyncAction.performFirstPhase(TransportSearchTypeAction.java:203)  
> at  
> org.elasticsearch.action.search.type.TransportSearchTypeAction$BaseAsyncAction$2.run(TransportSearchTypeAction.java:186)  
> at  
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)  
> at  
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)  
> at java.lang.Thread.run(Thread.java:744)  
> Caused by: org.elasticsearch.search.facet.FacetPhaseExecutionException:  
> Facet [fs.total.available\_in\_bytes]: failed to find mapping for  
> fs.total.available\_in\_bytes  
> at  
> org.elasticsearch.search.facet.termsstats.TermsStatsFacetParser.parse(TermsStatsFacetParser.java:132)  
> at  
> org.elasticsearch.search.facet.FacetParseElement.parse(FacetParseElement.java:93)  
> at  
> org.elasticsearch.search.SearchService.parseSource(SearchService.java:574)  
> ... 12 more
> 
> Making Marvel only semi-useful; I don't have anything disabled in my  
> elasticsearch.yml it's pretty stock; any help?
> 
> I tried asking in IRC but #elasticsearch isn't very helpful with questions  
> in regards to Marvel.
> 
> Thanks!
> 
> --  
> You received this message because you are subscribed to a topic in the  
> Google Groups "elasticsearch" group.  
> To unsubscribe from this topic, visit  
> [https://groups.google.com/d/topic/elasticsearch/dhpxaOuoZWI/unsubscribe](https://groups.google.com/d/topic/elasticsearch/dhpxaOuoZWI/unsubscribe).  
> To unsubscribe from this group and all its topics, send an email to  
> [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
> To view this discussion on the web visit  
> [https://groups.google.com/d/msgid/elasticsearch/326afeb5-1282-4ccd-979e-689556f84403%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/326afeb5-1282-4ccd-979e-689556f84403%40googlegroups.com)  
> .  
> For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out).

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/CALDJu4VnrbgMfGmcz\_hKsnAo5re0Jun%2BttF101OBJ7vWVe6Btg%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CALDJu4VnrbgMfGmcz_hKsnAo5re0Jun%2BttF101OBJ7vWVe6Btg%40mail.gmail.com).  
For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out).

---

<div class="post-metadata">

**Author:** ![jprante](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/jprante/32/44941_2.png) [@jprante](https://discuss.elastic.co/u/jprante)\
**Post date:** [February 14, 2014, 8:17am UTC](https://discuss.elastic.co/t/marvel-not-collecting-system-metrics/15792/3 "2014-02-14T08:17:08Z")

</div>

How did you install Marvel?

You need to add Marvel plugin on every node and each node must be restarted.

Also take care of the setting marvel.agent.exporter.es.hosts if you use  
other host/port than localhost:9200

Jörg

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/CAKdsXoEWrMoZPm8bHfkQbq\_-uJojAFLQgaexu0UXXjz5M%2B0biQ%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CAKdsXoEWrMoZPm8bHfkQbq_-uJojAFLQgaexu0UXXjz5M%2B0biQ%40mail.gmail.com).  
For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out).

---

<div class="post-metadata">

**Author:** ![Scott\_Likens](https://avatars.discourse-cdn.com/v4/letter/s/b4bc9f/32.png) [@Scott\_Likens](https://discuss.elastic.co/u/Scott_Likens)\
**Post date:** [February 14, 2014, 8:46am UTC](https://discuss.elastic.co/t/marvel-not-collecting-system-metrics/15792/4 "2014-02-14T08:46:05Z")

</div>

Hi,

As I am using Docker Elasticsearch is not running during the build process.  
I have posted my Dockerfile below.

> <https://github.com/damm/dockerfiles/blob/master/elasticsearch/Dockerfile#L7>

FWIW my /\_node/stats is correct and fully populated.

Additionally I have looked over  
[https://groups.google.com/forum/#!msg/elasticsearch/UPBMKvxwwM8/VBaqh0B11tQJand](https://groups.google.com/forum/#!msg/elasticsearch/UPBMKvxwwM8/VBaqh0B11tQJand)  
tried applying that as a custom template and deleting my indices and  
starting over; did not help.

Additionally the elasticsearch.yml in that repo is the current one in use.

Thanks!

On Fri, Feb 14, 2014 at 12:17 AM, [joergprante@gmail.com](mailto:joergprante@gmail.com) \<  
[joergprante@gmail.com](mailto:joergprante@gmail.com)\> wrote:

> How did you install Marvel?
> 
> You need to add Marvel plugin on every node and each node must be  
> restarted.
> 
> Also take care of the setting marvel.agent.exporter.es.hosts if you use  
> other host/port than localhost:9200
> 
> Jörg
> 
> --  
> You received this message because you are subscribed to a topic in the  
> Google Groups "elasticsearch" group.  
> To unsubscribe from this topic, visit  
> [https://groups.google.com/d/topic/elasticsearch/dhpxaOuoZWI/unsubscribe](https://groups.google.com/d/topic/elasticsearch/dhpxaOuoZWI/unsubscribe).  
> To unsubscribe from this group and all its topics, send an email to  
> [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
> To view this discussion on the web visit  
> [https://groups.google.com/d/msgid/elasticsearch/CAKdsXoEWrMoZPm8bHfkQbq\_-uJojAFLQgaexu0UXXjz5M%2B0biQ%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CAKdsXoEWrMoZPm8bHfkQbq_-uJojAFLQgaexu0UXXjz5M%2B0biQ%40mail.gmail.com)  
> .
> 
> For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out).

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/CALDJu4XJRFyWWk7mhHcKt2i%3D9-kXf8Ji54LQTLU4ebmAjTZNRA%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CALDJu4XJRFyWWk7mhHcKt2i%3D9-kXf8Ji54LQTLU4ebmAjTZNRA%40mail.gmail.com).  
For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out).

---

<div class="post-metadata">

**Author:** ![Binh\_Ly](https://avatars.discourse-cdn.com/v4/letter/b/ce7236/32.png) [@Binh\_Ly](https://discuss.elastic.co/u/Binh_Ly)\
**Post date:** [February 14, 2014, 12:06pm UTC](https://discuss.elastic.co/t/marvel-not-collecting-system-metrics/15792/5 "2014-02-14T12:06:06Z")

</div>

May I ask which OS you are running ES on?

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/c840c19d-e04d-4f51-bd3f-4c8bc7d7fe0d%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/c840c19d-e04d-4f51-bd3f-4c8bc7d7fe0d%40googlegroups.com).  
For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out).

---

<div class="post-metadata">

**Author:** ![Boaz\_Leskes](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/boaz_leskes/32/723_2.png) [@Boaz\_Leskes](https://discuss.elastic.co/u/Boaz_Leskes)\
**Post date:** [February 14, 2014, 3:35pm UTC](https://discuss.elastic.co/t/marvel-not-collecting-system-metrics/15792/6 "2014-02-14T15:35:08Z")

</div>

Hi scott

next to Binh's question can you check you have the following field in your  
nodes stats( GET \_node/stats): fs.total.available\_in\_bytes ?

On Friday, February 14, 2014 1:06:06 PM UTC+1, Binh Ly wrote:

> May I ask which OS you are running ES on?

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/466b1bd5-173d-46df-a8e2-39d52f2b8146%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/466b1bd5-173d-46df-a8e2-39d52f2b8146%40googlegroups.com).  
For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out).

---

<div class="post-metadata">

**Author:** ![Tony\_Su](https://avatars.discourse-cdn.com/v4/letter/t/8dc957/32.png) [@Tony\_Su](https://discuss.elastic.co/u/Tony_Su)\
**Post date:** [February 14, 2014, 3:41pm UTC](https://discuss.elastic.co/t/marvel-not-collecting-system-metrics/15792/7 "2014-02-14T15:41:41Z")

</div>

On Friday, February 14, 2014 4:06:06 AM UTC-8, Binh Ly wrote:

> May I ask which OS you are running ES on?

IIRC Docker is a management tool for LXC.  
So, it does pique the thoughts...

Where should marvel be pulling stats in an LXC deployment? It's not fully  
isolated like other virtualization technologies and access to various Host  
processes are blocked. I suppose it might be possible to point to  
statistics derived by Docker, but that probably requires special  
configuration.

Some thoughts,  
Tony

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/b409c6f0-1ea3-44f1-bffc-423edc4bb792%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/b409c6f0-1ea3-44f1-bffc-423edc4bb792%40googlegroups.com).  
For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out).

---

<div class="post-metadata">

**Author:** ![Scott\_Likens](https://avatars.discourse-cdn.com/v4/letter/s/b4bc9f/32.png) [@Scott\_Likens](https://discuss.elastic.co/u/Scott_Likens)\
**Post date:** [February 14, 2014, 7:21pm UTC](https://discuss.elastic.co/t/marvel-not-collecting-system-metrics/15792/8 "2014-02-14T19:21:26Z")

</div>

Hi Boaz,

```
  "fs": {
    "data": [
      {
        "path": "/data/elasticsearch/shared/docker/nodes/0"
      }
    ],

```

Does not appear to be. This field is populated when I run it without  
Docker; so is it expecting any particular file to exist like /etc/fstab or  
/etc/mtab?

Thanks!

On Fri, Feb 14, 2014 at 7:35 AM, Boaz Leskes [b.leskes@gmail.com](mailto:b.leskes@gmail.com) wrote:

> Hi scott
> 
> next to Binh's question can you check you have the following field in your  
> nodes stats( GET \_node/stats): fs.total.available\_in\_bytes ?
> 
> On Friday, February 14, 2014 1:06:06 PM UTC+1, Binh Ly wrote:
> 
> > May I ask which OS you are running ES on?
> 
> --  
> You received this message because you are subscribed to a topic in the  
> Google Groups "elasticsearch" group.  
> To unsubscribe from this topic, visit  
> [https://groups.google.com/d/topic/elasticsearch/dhpxaOuoZWI/unsubscribe](https://groups.google.com/d/topic/elasticsearch/dhpxaOuoZWI/unsubscribe).  
> To unsubscribe from this group and all its topics, send an email to  
> [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
> To view this discussion on the web visit  
> [https://groups.google.com/d/msgid/elasticsearch/466b1bd5-173d-46df-a8e2-39d52f2b8146%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/466b1bd5-173d-46df-a8e2-39d52f2b8146%40googlegroups.com)  
> .
> 
> For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out).

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/CALDJu4U%3D\_\_oqEDGVQQcUGK%2Ba9vvKMu8deJEEtrRRyDO7zW0BCw%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CALDJu4U%3D__oqEDGVQQcUGK%2Ba9vvKMu8deJEEtrRRyDO7zW0BCw%40mail.gmail.com).  
For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out).

---

<div class="post-metadata">

**Author:** ![Scott\_Likens](https://avatars.discourse-cdn.com/v4/letter/s/b4bc9f/32.png) [@Scott\_Likens](https://discuss.elastic.co/u/Scott_Likens)\
**Post date:** [February 14, 2014, 7:23pm UTC](https://discuss.elastic.co/t/marvel-not-collecting-system-metrics/15792/9 "2014-02-14T19:23:26Z")

</div>

Hi Binh,

My Java image is built off of the Docker image ubuntu:latest (which I  
believe is 12.10) ([Docker](https://index.docker.io/_/ubuntu/))

> <https://github.com/damm/dockerfiles/blob/master/java/Dockerfile#L1>

You are more than welcome to build the Docker image yourself from what I  
have provided and reproduce this yourself.

Thanks!

On Fri, Feb 14, 2014 at 4:06 AM, Binh Ly [binh@hibalo.com](mailto:binh@hibalo.com) wrote:

> May I ask which OS you are running ES on?
> 
> --  
> You received this message because you are subscribed to a topic in the  
> Google Groups "elasticsearch" group.  
> To unsubscribe from this topic, visit  
> [https://groups.google.com/d/topic/elasticsearch/dhpxaOuoZWI/unsubscribe](https://groups.google.com/d/topic/elasticsearch/dhpxaOuoZWI/unsubscribe).  
> To unsubscribe from this group and all its topics, send an email to  
> [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
> To view this discussion on the web visit  
> [https://groups.google.com/d/msgid/elasticsearch/c840c19d-e04d-4f51-bd3f-4c8bc7d7fe0d%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/c840c19d-e04d-4f51-bd3f-4c8bc7d7fe0d%40googlegroups.com)  
> .
> 
> For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out).

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/CALDJu4W6%3DAB42HtV3NN8pZY-ew%3DLnHfwipA\_2Bn1BLQ%3DihFWBg%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CALDJu4W6%3DAB42HtV3NN8pZY-ew%3DLnHfwipA_2Bn1BLQ%3DihFWBg%40mail.gmail.com).  
For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out).

---

<div class="post-metadata">

**Author:** ![Binh\_Ly](https://avatars.discourse-cdn.com/v4/letter/b/ce7236/32.png) [@Binh\_Ly](https://discuss.elastic.co/u/Binh_Ly)\
**Post date:** [February 14, 2014, 8:09pm UTC](https://discuss.elastic.co/t/marvel-not-collecting-system-metrics/15792/10 "2014-02-14T20:09:23Z")

</div>

It does indeed sound like some metrics are not available from your  
environment. Marvel/ES uses Sigar to collect these metrics  
([https://support.hyperic.com/display/SIGAR/Home](https://support.hyperic.com/display/SIGAR/Home)). Each OS has different  
ways to provide (or not provide) these metrics. If you absolutely cannot  
get these metrics, you can create a Marvel index template  
([http://www.elasticsearch.org/guide/en/marvel/current/](http://www.elasticsearch.org/guide/en/marvel/current/)) and introduce these  
missing fields that Sigar cannot collect from your environment.

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/886a1c50-4eb6-4a87-99a2-d2916032e04d%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/886a1c50-4eb6-4a87-99a2-d2916032e04d%40googlegroups.com).  
For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out).

---

<div class="post-metadata">

**Author:** ![Scott\_Likens](https://avatars.discourse-cdn.com/v4/letter/s/b4bc9f/32.png) [@Scott\_Likens](https://discuss.elastic.co/u/Scott_Likens)\
**Post date:** [February 14, 2014, 8:16pm UTC](https://discuss.elastic.co/t/marvel-not-collecting-system-metrics/15792/11 "2014-02-14T20:16:34Z")

</div>

Hi,

It looks like you depend on /etc/mtab or /etc/fstab. After adding some  
simple ways to re-create the files in the container the "fs" key was  
populated right. Unfortunately that Sigar page was not too helpful in  
this; so I'm glad I was able to fix it myself.

I can't imagine I will be the first (nor the last) to hit simple stumbling  
blocks like this; so I think it would be good to detail what is required  
for Marvel to run correctly? Especially as the goal is to get a license fee  
from us.

Thanks!

On Fri, Feb 14, 2014 at 12:09 PM, Binh Ly [binh@hibalo.com](mailto:binh@hibalo.com) wrote:

> It does indeed sound like some metrics are not available from your  
> environment. Marvel/ES uses Sigar to collect these metrics (  
> [https://support.hyperic.com/display/SIGAR/Home](https://support.hyperic.com/display/SIGAR/Home)). Each OS has different  
> ways to provide (or not provide) these metrics. If you absolutely cannot  
> get these metrics, you can create a Marvel index template (  
> [Elasticsearch Platform — Find real-time answers at scale | Elastic](http://www.elasticsearch.org/guide/en/marvel/current/)) and introduce  
> these missing fields that Sigar cannot collect from your environment.
> 
> --  
> You received this message because you are subscribed to a topic in the  
> Google Groups "elasticsearch" group.  
> To unsubscribe from this topic, visit  
> [https://groups.google.com/d/topic/elasticsearch/dhpxaOuoZWI/unsubscribe](https://groups.google.com/d/topic/elasticsearch/dhpxaOuoZWI/unsubscribe).  
> To unsubscribe from this group and all its topics, send an email to  
> [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
> To view this discussion on the web visit  
> [https://groups.google.com/d/msgid/elasticsearch/886a1c50-4eb6-4a87-99a2-d2916032e04d%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/886a1c50-4eb6-4a87-99a2-d2916032e04d%40googlegroups.com)  
> .
> 
> For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out).

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/CALDJu4XnSZFYmwbYehEDZUmWCSUq%2BopcxVm%2BDd4cJ2pCkwzbRQ%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CALDJu4XnSZFYmwbYehEDZUmWCSUq%2BopcxVm%2BDd4cJ2pCkwzbRQ%40mail.gmail.com).  
For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out).

---

<div class="post-metadata">

**Author:** ![Binh\_Ly](https://avatars.discourse-cdn.com/v4/letter/b/ce7236/32.png) [@Binh\_Ly](https://discuss.elastic.co/u/Binh_Ly)\
**Post date:** [February 14, 2014, 8:19pm UTC](https://discuss.elastic.co/t/marvel-not-collecting-system-metrics/15792/12 "2014-02-14T20:19:29Z")

</div>

Very cool Scott, thanks for the information!

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/17d56270-1b96-4105-b1ee-754071655c05%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/17d56270-1b96-4105-b1ee-754071655c05%40googlegroups.com).  
For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out).

---

<div class="post-metadata">

**Author:** ![Scott\_Likens](https://avatars.discourse-cdn.com/v4/letter/s/b4bc9f/32.png) [@Scott\_Likens](https://discuss.elastic.co/u/Scott_Likens)\
**Post date:** [February 14, 2014, 9:04pm UTC](https://discuss.elastic.co/t/marvel-not-collecting-system-metrics/15792/13 "2014-02-14T21:04:13Z")

</div>

Tony,

We appear to be getting the information back in the cgroup currently; so  
what's provided is fairly good. It would be better obviously to grab them  
from the cgroup and push it in; but that would be external to the container  
(unless you mounted the cgroups in the container)

So for my case it works; some spots I do get the 'host' data and not the  
container data but it's good enough for the moment.

Scott

On Fri, Feb 14, 2014 at 7:41 AM, Tony Su [tonysu999@gmail.com](mailto:tonysu999@gmail.com) wrote:

> On Friday, February 14, 2014 4:06:06 AM UTC-8, Binh Ly wrote:
> 
> > May I ask which OS you are running ES on?
> 
> IIRC Docker is a management tool for LXC.  
> So, it does pique the thoughts...
> 
> Where should marvel be pulling stats in an LXC deployment? It's not fully  
> isolated like other virtualization technologies and access to various Host  
> processes are blocked. I suppose it might be possible to point to  
> statistics derived by Docker, but that probably requires special  
> configuration.
> 
> Some thoughts,  
> Tony
> 
> --  
> You received this message because you are subscribed to a topic in the  
> Google Groups "elasticsearch" group.  
> To unsubscribe from this topic, visit  
> [https://groups.google.com/d/topic/elasticsearch/dhpxaOuoZWI/unsubscribe](https://groups.google.com/d/topic/elasticsearch/dhpxaOuoZWI/unsubscribe).  
> To unsubscribe from this group and all its topics, send an email to  
> [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
> To view this discussion on the web visit  
> [https://groups.google.com/d/msgid/elasticsearch/b409c6f0-1ea3-44f1-bffc-423edc4bb792%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/b409c6f0-1ea3-44f1-bffc-423edc4bb792%40googlegroups.com)  
> .
> 
> For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out).

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/CALDJu4XXVEJSdb4zs9sF6%3DgM92UK15K7A%2BUJ%2B8ugBg6Kn\_yB\_Q%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CALDJu4XXVEJSdb4zs9sF6%3DgM92UK15K7A%2BUJ%2B8ugBg6Kn_yB_Q%40mail.gmail.com).  
For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out).

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [July 6, 2017, 1:49am UTC](https://discuss.elastic.co/t/marvel-not-collecting-system-metrics/15792/14 "2017-07-06T01:49:55Z")

</div>


