We have financial application which works on FIX protocol . users Sends order and our application sends the response back within few milliseconds , application also generate the log with processing time of each order .. Below is how we store Data in ES . We are interested generating the vertical graph for each FIX users with their corresponding OrderId and the time it took for our application to response back the order.
I want to understand what is the best way to convert and the milliseconds value to seconds or minute and show on the Y-axis with the time of order receive on the X-Axis .
Order Receive time , App response time milliseonds(us) , Order ID , Source IP , FIX USER
Kibana visualizations are intended more for viewing aggregate data, rather than the individual data points that make up the aggregate. Because of this you will need to use an average of the response time (which will match the single response time if you filter down your data enough).
I would probably start with a vertical bar chart, then:
"Split charts" by the Terms of the FIX USER field
"X-Axis" using a Date Histogram of the Order Received Time field
Average metric of the App response time field
When you are zoomed in close enough you will see individual orders on the chart, but as you zoom out and look at larger amounts of time the date buckets will start to cover multiple orders and the average response time will be based on all of the orders that fit into those buckets. Because of this you will be able to scale from a 10 minute time window to a year long time window
PS: you will probably want to expand your Order Receive Time to a more complete timestamp (including the date)
Thanks for the reply Spencer
what is the best way to Convert App response time from 3860 to like 3.8ms as this will make more sens for user to check the average based this format . Also is there any way where i can add the drop down menu where users can select the FIX user, which can then show the graph based on per user inthe same format which you mentioned on the last reply.
I can help with the milliseconds to seconds formatting. If you go to your index pattern in Kibana, and select the edit pencil icon for the field, you can set the Format: Duration Input Format: Milliseconds Output Format: Seconds
click Update Field
You can't add a drop-down menu, but if you add your visualization to a dashboard, and you also create a data table visualization of your "FIX users" and add that to the dashboard, you can sort of use it like a drop-down. When click click on one of the names it will add a filter that affects the whole dashboard. Then you can either delete or disable the filter. So you could disable, add another filter, etc, until you had the filters you wanted (unless there's a lot), and then enable which ever one you want. I realize its a clumsy work-around, but if you really need it you could try that.
This data doesn't demonstrate the technique very well, but you get the idea.
Apache, Apache Lucene, Apache Hadoop, Hadoop, HDFS and the yellow elephant
logo are trademarks of the
Apache Software Foundation
in the United States and/or other countries.
