Logstash | Azure blob input plugin error

[iniyan.g]

Hi

I'm trying to ingest "Azure App Gateway Performance Logs" into logstash using "azureblob" input plugin. When I run the following command, I see the version mismatch error.

Can someone tell me what is the exact issue here?

Command: sudo /usr/share/logstash/bin/./logstash -f /etc/logstash/conf.d/test-conf/Test-App-Gateway.conf --path.data /etc/logstash/data/test-app-gateway/

Output:
[ERROR] 2020-03-27 07:09:27.857 [[main]<azureblob] azureblob - Oh My, An error occurred. {:exception=>#<Azure::Core::Http::HTTPError:2318 @status_code: 409, @http_response: #<Azure::Core::Http::HttpResponse:0x23bd739f @http_response=#<Faraday::Response:0x69627c2d @on_complete_callbacks=, @env=#<Faraday::Env @method=:get @body="\xEF\xBB\xBF<?xml version=\"1.0\" encoding=\"utf-8\"?>FeatureVersionMismatchThe type of a blob in the container is unrecognized by this version.\nRequestId:e332bc71-701e-0051-1b06-04c23c000000\nTime:2020-03-27T07:09:27.8431393Z" @url=#<URI::HTTPS https://elkstacklocalstorage.blob.core.windows.net/insights-logs-applicationgatewayperformancelog?comp=list&restype=container&timeout=10> @request=#<Faraday::RequestOptions open_timeout=60> @request_headers={"User-Agent"=>"Azure-Core/0.1.15", "x-ms-date"=>"Fri, 27 Mar 2020 07:09:27 GMT", "x-ms-version"=>"2014-02-14", "DataServiceVersion"=>"1.0;NetFx", "MaxDataServiceVersion"=>"3.0;NetFx", "Content-Type"=>"application/atom+xml; charset=utf-8", "Content-Length"=>"0", "Authorization"=>"SharedKey elkstacklocalstorage:XXXXXXXXXXXX"} @ssl=#<Faraday::SSLOptions verify=true> @response=#<Faraday::Response:0x69627c2d ...> @response_headers={"content-length"=>"259", "content-type"=>"application/xml", "server"=>"Windows-Azure-Blob/1.0 Microsoft-HTTPAPI/2.0", "x-ms-request-id"=>"e332bc71-701e-0051-1b06-04c23c000000", "x-ms-version"=>"2014-02-14", "date"=>"Fri, 27 Mar 2020 07:09:27 GMT", "connection"=>"close"} @status=409 @reason_phrase="The type of a blob in the container is unrecognized by this version.">>, @uri=#<URI::HTTPS https://elkstacklocalstorage.blob.core.windows.net/insights-logs-applicationgatewayperformancelog?comp=list&restype=container&timeout=10>>, @uri: #<URI::HTTPS https://elkstacklocalstorage.blob.core.windows.net/insights-logs-applicationgatewayperformancelog?comp=list&restype=container&timeout=10>, @description: "The type of a blob in the container is unrecognized by this version.\nRequestId:e332bc71-701e-0051-1b06-04c23c000000\nTime:2020-03-27T07:09:27.8431393Z", @type: "FeatureVersionMismatch">}

Thanks,
Iniyan G

[iniyan.g]

Just wanted to update the version of azure blob input plugin.

elkadmin@ELKStack-Logstash:/usr/share/logstash/bin$ ./logstash-plugin list --verbose logstash-input-azureblob
OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
WARNING: An illegal reflective access operation has occurred
WARNING: Illegal reflective access by com.headius.backport9.modules.Modules to method sun.nio.ch.NativeThread.signal(long)
WARNING: Please consider reporting this to the maintainers of com.headius.backport9.modules.Modules
WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations
WARNING: All illegal access operations will be denied in a future release
logstash-input-azureblob (0.9.7)

[iniyan.g]

Problem Solved !

I tried to update the plugin from 0.9.7 to 0.9.12.