# Sending of data logs from csv

**URL:** https://discuss.elastic.co/t/sending-of-data-logs-from-csv/92758
**Category:** Elasticsearch
**Created:** [July 12, 2017, 5:48am UTC](https://discuss.elastic.co/t/sending-of-data-logs-from-csv/92758 "2017-07-12T05:48:52Z")
**Posts on this page:** 4
**Page:** 1

<div class="post-metadata">

### Author: ![jogoinar10](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/jogoinar10/32/20068_2.png) [@jogoinar10](https://discuss.elastic.co/u/jogoinar10)
#### Post date: [July 12, 2017, 5:48am UTC](https://discuss.elastic.co/t/sending-of-data-logs-from-csv/92758/1 "2017-07-12T05:48:52Z")

</div>

I want to send logs from csv to elasticsearch.

csv ex.  
001, mike, 17

but every five minutes there's an appended data to the csv.  
ex. after 5 mins.

001, mike, 17  
002, oscar, 19

how can i send data from csv realtime to the elasticsearch?  
what technologies will i use?

---

<div class="post-metadata">

### Author: ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)
#### Post date: [July 12, 2017, 7:07am UTC](https://discuss.elastic.co/t/sending-of-data-logs-from-csv/92758/2 "2017-07-12T07:07:26Z")

</div>

I'd use filebeat to monitor file changes.

Then logstash to parse the CSV and transform to JSon.

Read: [http://david.pilato.fr/blog/2015/04/28/exploring-capitaine-train-dataset/](http://david.pilato.fr/blog/2015/04/28/exploring-capitaine-train-dataset/)

Or ingest CSV plugin:

> **[johtani/elasticsearch-ingest-csv](https://github.com/johtani/elasticsearch-ingest-csv)**
>
> elasticsearch-ingest-csv - Ingest CSV processor parses CSV data and stores it as individual fields

Also read:

> **[Indexing your CSV files with Elasticsearch Ingest Node
	  	 | Elastic](http://www.elastic.co/blog/indexing-csv-elasticsearch-ingest-node)**
>
> The idea of this article is to go over the capabilities of some of the features of Ingest node,  which will be combined to parse a Comma Separated Value (CSV) file. We will go over what is an Ing...

---

<div class="post-metadata">

### Author: ![jogoinar10](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/jogoinar10/32/20068_2.png) [@jogoinar10](https://discuss.elastic.co/u/jogoinar10)
#### Post date: [July 12, 2017, 7:49am UTC](https://discuss.elastic.co/t/sending-of-data-logs-from-csv/92758/3 "2017-07-12T07:49:10Z")

</div>

Thank you very much @dadoonet. I'll try this.

---

<div class="post-metadata">

### Author: ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)
#### Post date: [August 9, 2017, 7:49am UTC](https://discuss.elastic.co/t/sending-of-data-logs-from-csv/92758/4 "2017-08-09T07:49:49Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.