Errors with Metricbeat rabbitmq module and RabbitMQ 2.7.1

Kaouther_Mechri · January 16, 2018, 8:43am

Hello;

when I enable rabbitmq module with metricbeats; I have the following error in my metricbeats logfile

2018-01-16T09:33:54+01:00 ERR  Error on field 'state': Missing field: state, Error: Key state not found: key=state: key not found
2018-01-16T09:33:54+01:00 ERR  Error on field 'count': Missing field: count, Error: Key messages_persistent not found
2018-01-16T09:33:54+01:00 ERR  Error on field 'count': Missing field: count, Error: Key disk_writes not found
2018-01-16T09:33:54+01:00 ERR  Error on field 'count': Missing field: count, Error: Key disk_reads not found
2018-01-16T09:33:54+01:00 ERR  Error on field 'exclusive': Missing field: exclusive, Error: Key exclusive not found
2018-01-16T09:33:54+01:00 ERR  Error on field 'count': Missing field: count, Error: Key messages_persistent not found
2018-01-16T09:33:54+01:00 ERR  Error on field 'state': Missing field: state, Error: Key state not found: key=state: key not found
2018-01-16T09:33:54+01:00 ERR  Error on field 'exclusive': Missing field: exclusive, Error: Key exclusive not found
2018-01-16T09:33:54+01:00 ERR  Error on field 'count': Missing field: count, Error: Key disk_reads not found
2018-01-16T09:33:54+01:00 ERR  Error on field 'count': Missing field: count, Error: Key disk_writes not found
2018-01-16T09:33:54+01:00 ERR  Error on field 'count': Missing field: count, Error: Key disk_reads not found
2018-01-16T09:33:54+01:00 ERR  Error on field 'count': Missing field: count, Error: Key disk_writes not found
2018-01-16T09:33:54+01:00 ERR  Error on field 'exclusive': Missing field: exclusive, Error: Key exclusive not found
2018-01-16T09:33:54+01:00 ERR  Error on field 'state': Missing field: state, Error: Key state not found: key=state: key not found
2018-01-16T09:33:54+01:00 ERR  Error on field 'count': Missing field: count, Error: Key messages_persistent not found
2018-01-16T09:33:54+01:00 ERR  Error on field 'state': Missing field: state, Error: Key state not found: key=state: key not found
2018-01-16T09:33:54+01:00 ERR  Error on field 'count': Missing field: count, Error: Key messages_persistent not found
2018-01-16T09:33:54+01:00 ERR  Error on field 'exclusive': Missing field: exclusive, Error: Key exclusive not found
2018-01-16T09:33:54+01:00 ERR  Error on field 'count': Missing field: count, Error: Key disk_reads not found
2018-01-16T09:33:54+01:00 ERR  Error on field 'count': Missing field: count, Error: Key disk_writes not found
2018-01-16T09:33:59+01:00 ERR  Error on field 'count': Missing field: count, Error: Key queue_index_journal_write_count not found
2018-01-16T09:33:59+01:00 ERR  Error on field 'count': Missing field: count, Error: Key queue_index_read_count not found
2018-01-16T09:33:59+01:00 ERR  Error on field 'count': Missing field: count, Error: Key queue_index_write_count not found
2018-01-16T09:33:59+01:00 ERR  Error on field 'count': Missing field: count, Error: Key mnesia_disk_tx_count not found
2018-01-16T09:33:59+01:00 ERR  Error on field 'count': Missing field: count, Error: Key mnesia_ram_tx_count not found
2018-01-16T09:33:59+01:00 ERR  Error on field 'bytes': Missing field: bytes, Error: Key gc_bytes_reclaimed not found
2018-01-16T09:33:59+01:00 ERR  Error on field 'count': Missing field: count, Error: Key gc_num not found
2018-01-16T09:33:59+01:00 ERR  Error on field 'ms': Missing field: ms, Error: Key io_file_handle_open_attempt_avg_time not found
2018-01-16T09:33:59+01:00 ERR  Error on field 'count': Missing field: count, Error: Key io_file_handle_open_attempt_count not found
2018-01-16T09:33:59+01:00 ERR  Error on field 'ms': Missing field: ms, Error: Key io_read_avg_time not found
2018-01-16T09:33:59+01:00 ERR  Error on field 'bytes': Missing field: bytes, Error: Key io_read_bytes not found
2018-01-16T09:33:59+01:00 ERR  Error on field 'count': Missing field: count, Error: Key io_read_count not found
2018-01-16T09:33:59+01:00 ERR  Error on field 'count': Missing field: count, Error: Key io_read_count not found
2018-01-16T09:33:59+01:00 ERR  Error on field 'ms': Missing field: ms, Error: Key io_seek_avg_time not found
2018-01-16T09:33:59+01:00 ERR  Error on field 'count': Missing field: count, Error: Key io_seek_count not found
2018-01-16T09:33:59+01:00 ERR  Error on field 'ms': Missing field: ms, Error: Key io_sync_avg_time not found
2018-01-16T09:33:59+01:00 ERR  Error on field 'count': Missing field: count, Error: Key io_sync_count not found
2018-01-16T09:33:59+01:00 ERR  Error on field 'count': Missing field: count, Error: Key io_write_count not found
2018-01-16T09:33:59+01:00 ERR  Error on field 'ms': Missing field: ms, Error: Key io_write_avg_time not found
2018-01-16T09:33:59+01:00 ERR  Error on field 'bytes': Missing field: bytes, Error: Key io_write_bytes not found
2018-01-16T09:33:59+01:00 ERR  Error on field 'bytes': Missing field: bytes, Error: Expected integer, found string
2018-01-16T09:33:59+01:00 ERR  Error on field 'bytes': Missing field: bytes, Error: Expected integer, found string
2018-01-16T09:33:59+01:00 ERR  Error on field 'count': Missing field: count, Error: Key msg_store_write_count not found
2018-01-16T09:33:59+01:00 ERR  Error on field 'count': Missing field: count, Error: Key msg_store_read_count not found

Rabbit 2.7.1
Metricbeat 6.1

Can anyone help me please

thank you

andrewkroh · January 16, 2018, 7:08pm

I believe this module was developed against RabbitMQ 3. So probably the data model for the API changed between RabbitMQ 2.7 and 3.x.

Docker file showing it's tested against RabbitMQ 3 -
https://github.com/elastic/beats/blob/59f728a60239d5464575beef911b2ee9a9f2427e/metricbeat/module/rabbitmq/_meta/Dockerfile#L1
Original PR - https://github.com/elastic/beats/pull/4394

Are you still able to get some data reported to ES? We could squelch the errors by marking the missing fields as optional and adding test case for RabbitMQ 2.7 JSON response.

Kaouther_Mechri · February 7, 2018, 10:25am

thank you for your response

Yes I am geuuting some data reported aboout queues and nodes

I am not able to list all data I guet. could you give me the command to lis all rabbit metrics I guet .
thank you

system · March 7, 2018, 10:25am

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.