Combine multiple source data to one by joining based on unique key


(Vinay Garg) #1

Hi,

I'm planning for combine data base on unique key which are coming from multiple source, all are having unique key. Is it possible to create one graph based on such unique ID?


(CJ Cenizal) #2

Hi there,

Could you give me an example of your data, and what you'd like to do with it? If I understand correctly, it sounds like you have many different documents, each one with a unique "id" field. And you want to create a line chart? What do you want to show on the line chart?

Thanks,
CJ


(Vinay Garg) #3

Hi there,

Exactly i have fuse log and haproxy log. Both log have some unique ID for each request.
Example:
fuse logs are:
2017-08-19 12:47:31,933 | INFO | Test_service | ID-uat-333-1502370804486-274-404 | RT5_Route | X-Correlation-Id_201708191242100 | UserId_104

Haproxy logs are:
Aug 19 12:47:31 localhost haproxy[16781]: 10.10.10.2:53021 [19/Aug/2017:12:47:31.947] Test_service 0/0/0/126/126 200 493 - - ---- 13/13/0/0/0 0/0 {X-Correlation-Id_201708191242100} "POST /api/service HTTP/1.1"

In haproxy 200 response code and correlation ID is included in logs.
I have to merge the each request response code of haproxy with fuse log in dashboard. So i can check Haproxy and fuse server logs in same graph or pie chart rather than check graph individually.

I hope its clear now.


(Vinay Garg) #5

Hi there,

Exactly i have fuse log and haproxy log. Both log have some unique ID for each request.

Example:

fuse logs are:

2017-08-19 12:47:31,933 | INFO | Test_service | ID-uat-333-1502370804486-274-404 | RT5_Route | X-Correlation-Id_201708191242100 | UserId_104

Haproxy logs are:

Aug 19 12:47:31 localhost haproxy[16781]: 10.10.10.2:53021 [19/Aug/2017:12:47:31.947] Test_service 0/0/0/126/126 200 493 - - ---- 13/13/0/0/0 0/0 {X-Correlation-Id_201708191242100} “POST /api/service HTTP/1.1”

In haproxy 200 response code and correlation ID is included in logs.

I have to merge the each request response code of haproxy with fuse log in dashboard. So i can check Haproxy and fuse server logs in same graph or pie chart rather than check graph individually.

I hope it's clear now.


(system) #6

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.