List dynamic field mapping

gborg · December 9, 2019, 2:35pm

Hello, for my main index I have pre-defined fields using ECS and defining my own expanded fields.

There are however some fields in there that I did not define and they get in via dynamic mapping and get mapped as keyword. I wanna keep defining things, is there any simple way for me to get a list of fields in an index that were created dynamically ?

If not, I guess I will just be writing some software to compare the index template and the response from the mapping API

gborg · December 10, 2019, 12:00pm

Not having found a solution I sat down and wrote some dirty code for this.

If anyone needs to solve the same issue, here you go:

gist.github.com

https://gist.github.com/gbit-is/d9eab152d4b2ddd54e6bc5d8db9d3ce5

compare.py

#! /usr/bin/python3
import json


# This is not a beutiful piece of code, however it works.
# If you have an elasticsearch index with defined fields in an index template but also dynamic mapping enabled
# you can run into not knowing what dynamic fields exist, which is not a good idea 
# so the idea here is to be able to list fields existing in templates and indices and compare them

This file has been truncated. show original

system · January 7, 2020, 12:00pm

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.

Topic		Replies	Views
Derive new fields from existing fields Elasticsearch	3	2406	February 23, 2018
Dynamic template mappings Elasticsearch	1	347	February 23, 2019
Dynamic Templates & Static Mappings Elasticsearch	2	469	July 6, 2017
Dynamic mappings using dynamic templates Elasticsearch	2	857	July 5, 2017
Dynamic mapping of types excluded from custom mapping Elasticsearch	2	547	February 7, 2018

List dynamic field mapping

Related topics