Need to index .txt file to elastic search using logstash


(Deepak Jaganath) #1

My txt file location is https://s3.us-east-2.amazonaws.com/elasticbeanstalk-us-east-2-981790547314/Affiliations.txt

So technically not an .sql file. Any help in terms of how to configure logstash to ingest / index into elastic search would be greatly appreciated.

My table fields are shown in the image

I have created a elastic service in aws how should I index .txt files data to it and perform search


(Magnus B├Ąck) #2

You can use an http_poller input to fetch the file from S3 (or a file input if the file is actually in a local file system), then use a csv filter to split the columns into separate fields, then use an elasticsearch output to ship the resulting documents to Elasticsearch.


(system) #3

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.