Can I use LogStash to sent only some TAGs from an XML file and store the physical XML file on an S3?
|----> ElasticSearch |
XML --> LogStash -->|
From the XML file, I need sending to ElasticSearch index only some specific TAGS.
To the S3 storage, I need send the complete XML file. In that case, I can not transform the XML file to JSON due to a government rule. I need store this file in the original XML format without changes.
The XML file is in a directory on my disk local.
I need store this files on an S3 due to when requested, the user can search on ElasticSeacrh and download the physical file from S3 by a Webpage that I will create.
Anyone with a similar situation?
My output on LogStash Conf file:
#testing with a local file
codec => rubydebug
hosts ="MY ElasticSearch Host";
password ="My Password";
access_key_id ="My Access Key";
secret_access_key ="My Secret Access Key";
time_file = 1