# Pushing excel data with row and coulumn header in elastic search **URL:** \ **Category:** Elasticsearch\ **Created:** [January 31, 2019, 9:24am UTC](https://discuss.elastic.co/t/pushing-excel-data-with-row-and-coulumn-header-in-elastic-search/166508 "2019-01-31T09:24:42Z")\ **Posts on this page:** 7\ **Page:** 1
**Author:** ![Be1](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/be1/32/63657_2.png) [@Be1](https://discuss.elastic.co/u/Be1)\ **Post date:** [January 31, 2019, 9:24am UTC](https://discuss.elastic.co/t/pushing-excel-data-with-row-and-coulumn-header-in-elastic-search/166508/1 "2019-01-31T09:24:43Z")
Hello, I need suggestion on how to proceed with this problem. The following is my csv file.. |value\_type |1-Sep|3-Sep|4-Sep|5-Sep|6-Sep|7-Sep|8-Sep|10-Sep|11-Sep|12-Sep|13-Sep|14-Sep|15-Sep|17-Sep|18-Sep|19-Sep|20-Sep|21-Sep|22-Sep|24-Sep|25-Sep|26-Sep|27-Sep|28-Sep|29-Sep| |example1|0.00|10.45|18.65|16.85|16.65|17.95|3.25|20.25|16.90|16.45|15.40|14.05|2.85|23.50|16.95|15.25|17.70|15.00|0.00|21.90|15.60|15.35|13.95|13.50|4.60| |example2|0.00|51.32|66.19|57.69|57.01|60.95|0.00|51.08|51.31|43.95|48.41|52.39|0.00|57.40|57.51|43.84|47.09|47.58|3.60|56.85|42.87|38.80|49.89|43.52|0.00| there are row and column headers for my data.The row header is of the date format and column header is a string.I want to push this data to elastic search and later in kibana i would want to visulize the data based on the date(current,weekly,monthly). Here is an example like the current visulization should display 'value\_type' field as the x axis and roi on y axis such that roi specified on the current date. Weekly visulization: 'value\_type' field as the x axis and roi on y axis such that roi be the average value over the last week. monthly visulization:'value\_type' field as the x axis and roi on y axis such that roi be the average value over the entire month. Please if somebody would guide me or provide some relevant urls on how to push the above data in elastic search and visulize in kibana..it would be much of a help. ps:I am a beginner. Thanks in advance ---
**Author:** ![juka](https://avatars.discourse-cdn.com/v4/letter/j/8491ac/32.png) [@juka](https://discuss.elastic.co/u/juka)\ **Post date:** [January 31, 2019, 10:22am UTC](https://discuss.elastic.co/t/pushing-excel-data-with-row-and-coulumn-header-in-elastic-search/166508/2 "2019-01-31T10:22:18Z")
Hi, well as simple as it seems if you don't process a lot of data stick to excel. If you want Elasticsearch, you need Kibana and also Logstash which can process the data and send it to your Elasticsearch Instance. You need to write a Logstash event processing pipeline ([https://www.elastic.co/guide/en/logstash/current/pipeline.html](https://www.elastic.co/guide/en/logstash/current/pipeline.html)) Your input is probably the csv file so you need the input plugin "file" ([https://www.elastic.co/guide/en/logstash/current/plugins-inputs-file.html](https://www.elastic.co/guide/en/logstash/current/plugins-inputs-file.html)) If you don't need to transform your data you might not need a filter plugin and can go straight to the output plugin "elasticsearch" ([https://www.elastic.co/guide/en/logstash/current/plugins-outputs-elasticsearch.html](https://www.elastic.co/guide/en/logstash/current/plugins-outputs-elasticsearch.html)) In general I would recommend using Logstash with json files. So if you can provide your data within a json file with json structure the processing within Logstash will be much easier. Example with json: ```auto input{ file { type => "typename" path => "foldertoyourfiles/*" codec => "json" # start_position=> "beginning" } } filter{ # if necessary put stuff here too! } output{ elasticsearch { hosts=> ["127.0.0.1"] index=> "yourindexname-%{+YYYY.MM.dd}" codec => "json" } } ``` Good Luck! ---
**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\ **Post date:** [January 31, 2019, 10:50am UTC](https://discuss.elastic.co/t/pushing-excel-data-with-row-and-coulumn-header-in-elastic-search/166508/3 "2019-01-31T10:50:48Z")
You can also have a look at > **[johtani/elasticsearch-ingest-csv](https://github.com/johtani/elasticsearch-ingest-csv)** > > Ingest CSV processor parses CSV data and stores it as individual fields - johtani/elasticsearch-ingest-csv Note that in Elasticsearch 6.6.0 you now have a CSV importer in Kibana which is experimental but might be useful. Have a look at [https://www.elastic.co/guide/en/kibana/6.6/xpack-ml.html](https://www.elastic.co/guide/en/kibana/6.6/xpack-ml.html) ---
**Author:** ![Be1](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/be1/32/63657_2.png) [@Be1](https://discuss.elastic.co/u/Be1)\ **Post date:** [January 31, 2019, 11:17am UTC](https://discuss.elastic.co/t/pushing-excel-data-with-row-and-coulumn-header-in-elastic-search/166508/4 "2019-01-31T11:17:24Z")
Hello,thank you for the reply but the thing is my logstash is not working..whenever i run the config file..the output gets stuck.i have already raised this problem in the forum. So i have to do this with elastic search.I wanted to know how can i push csv data with row and column header to elastic search. ---
**Author:** ![Be1](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/be1/32/63657_2.png) [@Be1](https://discuss.elastic.co/u/Be1)\ **Post date:** [January 31, 2019, 11:18am UTC](https://discuss.elastic.co/t/pushing-excel-data-with-row-and-coulumn-header-in-elastic-search/166508/5 "2019-01-31T11:18:55Z")
and also the row header is of date format..so i wanted to take that as timestamp.can i do that and how? Thanks in advance ---
**Author:** ![juka](https://avatars.discourse-cdn.com/v4/letter/j/8491ac/32.png) [@juka](https://discuss.elastic.co/u/juka)\ **Post date:** [January 31, 2019, 11:30am UTC](https://discuss.elastic.co/t/pushing-excel-data-with-row-and-coulumn-header-in-elastic-search/166508/6 "2019-01-31T11:30:20Z")
Well I would recommend fixing your logstash but you can also try to send data to elasticsearch directly. You can read here how to Index Data using curl or via Kibana DevTools: [https://www.elastic.co/guide/en/elasticsearch/guide/master/index-doc.html](https://www.elastic.co/guide/en/elasticsearch/guide/master/index-doc.html) Good Luck! ---
**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\ **Post date:** [February 28, 2019, 11:30am UTC](https://discuss.elastic.co/t/pushing-excel-data-with-row-and-coulumn-header-in-elastic-search/166508/7 "2019-02-28T11:30:20Z")
This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.