When I pull data from S3, the tar file gets overwritten every time. Is there any way to save each file without having them be overwritten in S3 temporary directory?
Logstash configuration:
input{
s3 {
access_key_id => "..."
secret_access_key => "..."
region => "..."
bucket => "..."
prefix => "..."
temporary_directory => "/.../.../.../temp_files/"
codec => json_lines
additional_settings => {
force_path_style => true
follow_redirects => false
}
type => "s3"
}
}