Need to index .txt file to elastic search using logstash

My txt file location is https://s3.us-east-2.amazonaws.com/elasticbeanstalk-us-east-2-981790547314/Affiliations.txt

So technically not an .sql file. Any help in terms of how to configure logstash to ingest / index into elastic search would be greatly appreciated.

My table fields are shown in the image

I have created a elastic service in aws how should I index .txt files data to it and perform search

You can use an http_poller input to fetch the file from S3 (or a file input if the file is actually in a local file system), then use a csv filter to split the columns into separate fields, then use an elasticsearch output to ship the resulting documents to Elasticsearch.

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.