Error retrieving collection totals from Mongo module metric beat

Elastic Stack Beats
1

Hi,

I have configured metric beat on mongodb sending data to Elasticsearch. I am getting data except for collstats. I am 2000+ databases in mongo. So, probably the number of metrics of collstats is large.
I am getting the below error from metricbeat mongodb module for collstats metricset.
Is there a limit of 16MB on the json size. How can we increase it ?

{
  "_index": "metricbeat-7.3.2-2020.06.03-000001",
  "_type": "_doc",
  "_id": "q-ISsXUB8oCfemQBNWYp",
  "_version": 1,
  "_score": null,
  "_source": {
    "@timestamp": "2020-11-10T07:32:07.009Z",
    "ecs": {
      "version": "1.0.1"
    },
    "host": {
      "containerized": false,
      "name": "mongo",
      "hostname": "mongo.nze.com",
      "architecture": "x86_64",
      "os": {
        "kernel": "3.10.0-514.el7.x86_64",
        "codename": "Core",
        "platform": "centos",
        "version": "7 (Core)",
        "family": "redhat",
        "name": "CentOS Linux"
      },
      "id": "05e5a8dc48ed4764ad739d4df280b6dd"
    },
    "metricset": {
      "name": "collstats"
    },
    "service": {
      "type": "mongodb",
      "address": "test.nze.com:27019"
    },
    "event": {
      "module": "mongodb",
      "duration": 1168734966,
      "dataset": "mongodb.collstats"
    },
    "error": {
      "message": "Error retrieving collection totals from Mongo instance: BSONObj size: 19536693 (0x12A1B35) is invalid. Size must be between 0 and 16793600(16MB) First element: note: \"all times in microseconds\""
    },
    "tags": [
      "3",
    ],
    "agent": {
      "version": "7.3.2",
      "name": "mongo",
      "type": "metricbeat",
      "ephemeral_id": "a8a8b0da-a18d-4306-8e6b-69e859c9517b",
      "hostname": "mongo.nze.com",
      "id": "17d0d1d9-c9c8-445c-b388-7d9ef6ead244"
    }
  },
  "fields": {
    "@timestamp": [
      "2020-11-10T07:32:07.009Z"
    ]
  },
  "highlight": {
    "metricset.name": [
      "@kibana-highlighted-field@collstats@/kibana-highlighted-field@"
    ]
  },
  "sort": [
    1604993527009
  ]
}

indent preformatted text by 4 spaces

2

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.