Hi,
I have been using varnishstatbeat in the past to ship varnish statistics to Elasticsearch.
I am currently in the process of upgrading my cluster to 7.x - and there is no es7 template for the varnishstatbeat project.
Here is the current es6 template:
{
"mappings": {
"_default_": {
"_all": {
"norms": {
"enabled": false
}
},
"_meta": {
"version": "6.0.0-alpha1"
},
"date_detection": false,
"dynamic_templates": [
{
"strings_as_keyword": {
"mapping": {
"ignore_above": 1024,
"index": false,
"type": "text"
},
"match_mapping_type": "string"
}
}
],
"properties": {
"@timestamp": {
"type": "date"
},
"beat": {
"properties": {
"hostname": {
"index": false,
"type": "text"
},
"name": {
"index": false,
"type": "text"
},
"version": {
"index": false,
"type": "text"
}
}
},
"counter": {
"type": "long"
},
"fields": {
"properties": {}
},
"meta": {
"properties": {
"cloud": {
"properties": {
"availability_zone": {
"index": false,
"type": "text"
},
"instance_id": {
"index": false,
"type": "text"
},
"machine_type": {
"index": false,
"type": "text"
},
"project_id": {
"index": false,
"type": "text"
},
"provider": {
"index": false,
"type": "text"
},
"region": {
"index": false,
"type": "text"
}
}
}
}
},
"tags": {
"index": false,
"type": "text"
}
}
}
},
"order": 0,
"settings": {
"index.refresh_interval": "5s"
},
"template": "varnishstatbeat-*"
}
I get the following error when I try to POST it into es7:
2021/03/05 10:32:32.951844 client.go:673: DBG PUT http://172.16.0.166:9200/_template/varnishstatbeat.template-es6x.json map[mappings:map[_default_:map[properties:map[@timestamp:map[type:date] beat:map[properties:map[name:map[index:false type:text] version:map[index:false type:text] hostname:map[index:false type:text]]] counter:map[type:long] fields:map[properties:map[]] meta:map[properties:map[cloud:map[properties:map[project_id:map[index:false type:text] provider:map[index:false type:text] region:map[index:false type:text] availability_zone:map[index:false type:text] instance_id:map[type:text index:false] machine_type:map[index:false type:text]]]]] tags:map[index:false type:text]] _all:map[norms:map[enabled:false]] _meta:map[version:6.0.0-alpha1] date_detection:false dynamic_templates:[map[strings_as_keyword:map[mapping:map[ignore_above:1024 index:false type:text] match_mapping_type:string]]]]] order:0 settings:map[index.refresh_interval:5s] template:varnishstatbeat-*]
2021/03/05 10:32:32.959299 sync_worker.go:87: ERR Connect failed with: Connection marked as failed because the onConnect callback failed: Could not load template: couldn't load template: couldn't load json. Error: 400 Bad Request. Response body: {"error":{"root_cause":[{"type":"mapper_parsing_exception","reason":"Root mapping definition has unsupported parameters: [_default_ : {_meta={version=6.0.0-alpha1}, dynamic_templates=[{strings_as_keyword={mapping={ignore_above=1024, index=false, type=text}, match_mapping_type=string}}], _all={norms={enabled=false}}, date_detection=false, properties={@timestamp={type=date}, meta={properties={cloud={properties={machine_type={index=false, type=text}, availability_zone={index=false, type=text}, instance_id={index=false, type=text}, project_id={index=false, type=text}, provider={index=false, type=text}, region={index=false, type=text}}}}}, beat={properties={hostname={index=false, type=text}, name={index=false, type=text}, version={index=false, type=text}}}, counter={type=long}, fields={properties={}}, tags={index=false, type=text}}}]"}],"type":"mapper_parsing_exception","reason":"Failed to parse mapping [_doc]: Root mapping definition has unsupported parameters: [_default_ : {_meta={version=6.0.0-alpha1}, dynamic_templates=[{strings_as_keyword={mapping={ignore_above=1024, index=false, type=text}, match_mapping_type=string}}], _all={norms={enabled=false}}, date_detection=false, properties={@timestamp={type=date}, meta={properties={cloud={properties={machine_type={index=false, type=text}, availability_zone={index=false, type=text}, instance_id={index=false, type=text}, project_id={index=false, type=text}, provider={index=false, type=text}, region={index=false, type=text}}}}}, beat={properties={hostname={index=false, type=text}, name={index=false, type=text}, version={index=false, type=text}}}, counter={type=long}, fields={properties={}}, tags={index=false, type=text}}}]","caused_by":{"type":"mapper_parsing_exception","reason":"Root mapping definition has unsupported parameters: [_default_ : {_meta={version=6.0.0-alpha1}, dynamic_templates=[{strings_as_keyword={mapping={ignore_above=1024, index=false, type=text}, match_mapping_type=string}}], _all={norms={enabled=false}}, date_detection=false, properties={@timestamp={type=date}, meta={properties={cloud={properties={machine_type={index=false, type=text}, availability_zone={index=false, type=text}, instance_id={index=false, type=text}, project_id={index=false, type=text}, provider={index=false, type=text}, region={index=false, type=text}}}}}, beat={properties={hostname={index=false, type=text}, name={index=false, type=text}, version={index=false, type=text}}}, counter={type=long}, fields={properties={}}, tags={index=false, type=text}}}]"}},"status":400}
^C2021/03/05 10:32:34.091579 service.go:33: DBG Received sigterm/sigint, stopping
Any pointers as to what I need to change in the template to get this working would be greatly appreciated.
thanks