Index dataset in text file


(A.R.Tahir) #1

Hi,
I am new to elastic search .i have to index data(half million entries) available in text file. i don't understand how i have to start doing it


(Isabel Drost-Fromm) #2

Did you look at Logstash or Filebeat already?

https://www.elastic.co/guide/en/logstash/current/plugins-inputs-file.html

https://www.elastic.co/products/beats/filebeat

Other options would include writing code to parse the file and send separate index requests/ bulk index requests to ES. However I've found using one of the two options above much faster in terms of development time needed in the past.

Hope this helps,
Isabel


(David Pilato) #3

Adding to Isabel's answer that if it's non structured data (well, just text), you can have a look at FSCrawler project.


(system) #4