I need help regarding elastic search mapping of nested json response. I am using the meatricbeat's http module to query data from our asset management system and I am getting the following response in return
"fields": [
{
"displayName": "IT Vertical",
"value": "Data Analytics"
},
{
"displayName": "Serial Number",
"value": "VMware-XXXXXXXXXXXX"
},
{
"displayName": "System Name",
"value": "Test-Virtual-Machine"
}
]
Based on what I found on google, it looks like this is a nested json response where the "key" is the value for "displayName" and the "value" is the value of the value field. for example:
----Key---------------value----------
IT Vertical-------Data Analytics
Serial Number-----VMware-XXXXXXXXXXXX
System Name-------Test-Virtual-Machine
I am able to use processors inside the http module and ideally i would like to shape the data before it gets to logstash/elasticsearch. but if it is not possible, is it possible to modify this data accordingly by using ingest node pipelines? if so, any ideas how? any other responses are welcomed.