I am building webapp that allows users to search for charts and data. I have a number of csv files to be ingested. Each file contains data that will be processed and visualized as a chart on the front end of my web app. Basically each csv file represents a chart.
I was going to store metadata on each chart (title, tags, industry etc) into a document and nest the generated documents from the csv in it. So basically a nested object with the parent document having searchable fields (title, tags, industry) and the nested column data from the CSV.
First of all is this a good idea? Can it be done more efficiently and what do you suggest?
Secondly if this is not a bad idea, how do I use logstash to ingest the csv files as nested docs in this parent document?