Dynamic Template and object type

Elastic Stack Elasticsearch
1

Hello,

I try to create a template that store in Elasticsearch only the properties inside "Data" with a dynamic Template.
My output come from the MetricBeat (call by Jolokia the Endpoint metrics of Spring boot application).

My output is as follow :

{
  "@timestamp": "2017-07-17T10:09:50.248Z",
  "beat": {
    "hostname": "XXXX",
    "name": "XXXX",
    "version": "5.5.0"
  },
  "jolokia": {
    "metric": {
      "data": {
        "classes": 9203.000000,
        "classes.loaded": 9203.000000,
        "classes.unloaded": 0.000000,
        "counter.status.200.jolokia.star-star": 1.000000,
        "gauge.response.jolokia.star-star": 173.000000,
        "gc.copy.count": 108.000000,
        "gc.copy.time": 344.000000,
        "gc.marksweepcompact.count": 3.000000,
        "gc.marksweepcompact.time": 122.000000,
        "heap": 253440.000000,
        "heap.committed": 48804.000000,
        "heap.init": 16384.000000,
        "heap.used": 34625.000000,
        "instance.uptime": 2826140.000000,
        "mem": 81738.000000,
        "mem.free": 14178.000000,
        "nonheap": 0.000000,
        "nonheap.committed": 34144.000000,
        "nonheap.init": 160.000000,
        "nonheap.used": 32934.000000,
        "processors": 4.000000,
        "systemload.average": -1.000000,
        "threads": 21.000000,
        "threads.daemon": 12.000000,
        "threads.peak": 21.000000,
        "threads.totalStarted": 25.000000,
        "uptime": 2836409.000000
      }
    }
  },
  "metricset": {
    "host": "localhost:XXXX",
    "module": "jolokia",
    "name": "jmx",
    "namespace": "metric",
    "rtt": 83257
  },
  "type": "metricsets"
}

My template is :

{
	"template": "metric-springboot-*",
	"mappings": {
		"metric_data": {
			"properties": {
				"@timestamp": {
					"type": "date"
				},
				"jolokia": {
					"properties": {
						"metric": {
							"properties": {
								"data": {
									"dynamic": "true",
									"type": "object"
								}
							}
						}
					}
				}
			},
			"dynamic_templates": [
			{	
				"data_value_mapping": {
					"path_match": "jolokia.metric.data.*",
					"mapping": {
						"type": "float",
						"index": false
					}
				}
			}
			]
		}
	}
}

But I have the following error :

java.lang.IllegalArgumentException: Can't merge a non object mapping [jolokia.me
tric.data.classes] with an object mapping [jolokia.metric.data.classes]

My metricbeat configuration is :

metricbeat.modules:
- module: jolokia
  metricsets: ["jmx"]
  enabled: true
  period: 10s
  hosts: ["localhost:8081"]
  namespace: "metric"
  path: "xxxx/jolokia/read"
  jmx.mappings:
    - mbean: 'org.springframework.boot:name=metricsEndpoint,type=Endpoint'
      attributes:
        - attr: Data
          field: data
          field_type: java.Object

output.elasticsearch:
  hosts: ["localhost:9200"]
  index: "metric-springboot-smartphone"
  template.name: "metric_springboot"
  template.path: "metricbeat.template-metrics.json"
  template.versions.2x.enabled: false
  template.versions.6x.enabled: false

Thank for your help

2

No body for help me ?

3

This is the problem, the first line makes classes a float but the second line requires classes to be an object.

1 Like
4

Thank for your answer.

If I understand :
prefix : value
prefix.XX : value
"prefix" must be an object in my template ?

I cannot change my data (it is the endpoints "metric" of the spring boot). How can I change my template ?
I would like each line of my data are one type in my index

5

There is no way that you can make Elasticsearch accept this data, it has to be changed. Note that you could do this automatically with the ingest feature if necessary.

6

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.