Logstash ingesting gzip json file using http_poller

Elastic Stack Logstash
1

Hello.
I want to do the direct ingestion of the json.gzip file over http_poller.

input {
    http_poller {
        urls => { url_1 => "https://nvd.nist.gov/feeds/json/cve/1.0/nvdcve-1.0-2019.json.gz" }
        request_timeout => 30
        tags => ["cve_json"]
        codec => gzip_lines { charset => "ISO-8859-1"}
        validate_after_inactivity => 200
        schedule => { cron => "24 10 * * *" }

    }
}
filter {
    json {
        source => "message"
        target => "message"
    }
}


output {
    stdout { codec => rubydebug }
}

file nvdcve-1.0-2019.json.gz
nvdcve-1.0-2019.json.gz: gzip compressed data, from FAT filesystem (MS-DOS, OS/2, NT

Is there a way to ingest this like that not resorting to external script that will download, decompress the file and later logstash can read the json?

2

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.