How to visualize data from different CSV file?

[atiqah_yusri]

Hi everyone, I already load 2 CSV files into the elasticsearch. so, now I want to visualize them using kibana, but not all data I want to visualize.

for example:
-csv_1: have columns name [Student name, student id, gender, course name]
-csv_2: columns name [student id, test1 score, test2 score]

I want to visualize [student name, student id, test1 score, test2 score] in a table. Means that student name data takes from csv_1, test1 score and test2 score takes from csv_2. My question is, how to visualize these data (from 2 csv file)?

[poff (Poff Poffenberger)]

Hey there!

ES doesn't really provide a way to do joins across indexes on fields like ID. You might consider processing your data before loading it into ES by generating just one CSV that includes all the information from both CSVs

[atiqah_yusri]

ouh really? Thank you so much Poff for this info.

[atiqah_yusri]

Hi poff,

You mentioned that ES not really provide a way to joins across indexes. What if I put different CSV files in the same index id?

   input{
    file{
        #first scv file
        path => "C:/Users/Win 10/Desktop/Iqah/datasets/mockdataset/MOCK_DATA.csv"
        start_position => "beginning"
        sincedb_path => "NULL"
    }

    file{
        #second csv file
        path => "C:/Users/Win 10/Desktop/Iqah/datasets/mockdataset/MOCK_DATA testscore.csv"
        start_position => "beginning"
        sincedb_path => "NULL"
    }
}

filter{
    if [path] == "C:/Users/Win 10/Desktop/Iqah/datasets/mockdataset/MOCK_DATA.csv"{
        csv{
            separator => ","
            columns => ["student_ID","student_name","gender","email"]
        }

    }
    else if [path] == "C:/Users/Win 10/Desktop/Iqah/datasets/mockdataset/MOCK_DATA testscore.csv"{
        csv{
            separator => ","
            columns => ["student_ID","test1_score %","Test2_score %"]
        }

        mutate {convert => ["test1_score %", "integer"]}
        mutate {convert => ["Test2_score %", "integer"]}

    }

}

output{
    elasticsearch{
        hosts => "http://localhost:9200"
        index => "studentscore"
        document_type => "studentscore_dataset"
  }
  stdout{}
}