We are doing analysis twice a week in pyspark. I am currently writing only the latest data to elasticsearch, but now we want to append the data. Once we start appending the data, all charts in kibana will start taking average of all the available data. But we want to see latest analysis date data by default later user wish to change he / she can.
Is it possible that we can create a filter in kibana using query DSL which will be applied by default when user opens the dashboard. Later user can deselect max(Analysis Date) and select Analysis Date of his/her choice.
I tried below query in Kibana->Filter -> Query DSL but it didn't work. When I try the same in Dev Tools with index name and _search then it works.
"field": "Analysis Date"
Thanks & Regards