Am I being so difficult to state problem...my bad.
Use case:
I have WebPageTest Results for multiple URL Performance Tests and for Multiple Runs.
I get them in Folder Structure
WebPageTest/RUN1432621877157
WebPageTest/RUN1432621608713
XML Data:
Note: Please change file extension from png to xml.
I want to push them into Elasticsearch using same INDEX in such a way to get below charts at Kibana.
1 Line chart Visual Progress (FV & RV)
2 Bar chart Timings (FV & RV) (Median)
-Visually Complete
-Last Visual Change
-Load Time (onload)
-Load Time (Fully Loaded)
-Speed Index
-Time to First Byte
-Time to Title
3 Score Board | bar Chart (FV &RV) (Median)
<?score_cache>71</?score_cache>
<?score_cdn>28</?score_cdn>
<?score_gzip>100</?score_gzip>
<?score_cookies>-1</?score_cookies>
<?score_keep-alive>100</?score_keep-alive>
<?score_minify>-1</?score_minify>
<?score_combine>100</?score_combine>
<?score_compress>-1</?score_compress>
<?score_etags>-1</?score_etags>
4 Bar chart on CPU consumtion (FV &RV) (Median)
<?docCPUms>3057.62</?docCPUms>
<?fullyLoadedCPUms>4976.432</?fullyLoadedCPUms>
<?docCPUpct>85</?docCPUpct>
<?fullyLoadedCPUpct>70</?fullyLoade
"For chart 2 to 4 Logstash worked perfectly to parse my data and push to ELK"
Using Below Config.
Note: Please change file extension from png to conf.
In attached XML Time FirstView & RepeatView data are coming from array elements hence when parsing all values from respective fields being stored as list in ELK.
Being in List not sufficing desired chart as expecting variations of Progress against time for both FirstView & RepeatView.
For Data Modelling I need to parse the RUN files one by one which i can see as work around rather parsing all run files and processing them and pushing to ELK at once.
Is there any suggestions for handling/processing mutiple XML files or Best Practice.
Thanks Saket.