Hi -- I'm running filebeat 7.6.2 and am encountering an issue with the Azure Event Hub input plugin. I believe this was caused due to unclean shutdown. I'm seeing the following errors, and messages are not pulled in from the Event Hub:
RESPONSE Status: 409 The specified blob already exists. Full log:
Jul 20 22:21:24 <redacted> systemd[1]: Started Filebeat sends log files to Logstash or directly to Elasticsearch..
Jul 20 22:21:34 <redacted> filebeat[1622]: ______ __ __ __ __
Jul 20 22:21:34 <redacted> filebeat[1622]: / ____/ _____ ____ / /_/ / / /_ __/ /_ _____
Jul 20 22:21:34 <redacted> filebeat[1622]: / __/ | | / / _ \/ __ \/ __/ /_/ / / / / __ \/ ___/
Jul 20 22:21:34 <redacted> filebeat[1622]: / /___ | |/ / __/ / / / /_/ __ / /_/ / /_/ (__ )
Jul 20 22:21:34 <redacted> filebeat[1622]: /_____/ |___/\___/_/ /_/\__/_/ /_/\__,_/_.___/____/
Jul 20 22:21:34 <redacted> filebeat[1622]: => processing events, ctrl+c to exit
Jul 20 22:21:34 <redacted> /usr/share/filebeat/bin/filebeat[1622]: 2020/07/20 22:21:34 ==> REQUEST/RESPONSE (Try=1/7.254983ms, OpTime=7.337978ms) -- REQUEST ERROR
PUT https://<redacted>.blob.core.windows.net/filebeat-logevents/0?timeout=61
Authorization: REDACTED
Content-Length: [80]
If-None-Match: [*]
User-Agent: [Azure-Storage/0.7 (go1.13.8; linux)]
X-Ms-Blob-Cache-Control: []
X-Ms-Blob-Content-Disposition: []
X-Ms-Blob-Content-Encoding: []
X-Ms-Blob-Content-Language: []
X-Ms-Blob-Content-Type: []
X-Ms-Blob-Type: [BlockBlob]
X-Ms-Client-Request-Id: [60<redacted>e9b]
X-Ms-Version: [2018-11-09]
x-ms-date: [Mon, 20 Jul 2020 22:21:34 GMT]
--------------------------------------------------------------------------------
RESPONSE Status: 409 The specified blob already exists.
Content-Length: [220]
Content-Type: [application/xml]
Date: [Mon, 20 Jul 2020 22:21:42 GMT]
Server: [Windows-Azure-Blob/1.0 Microsoft-HTTPAPI/2.0]
X-Ms-Error-Code: [BlobAlreadyExists]
X-Ms-Request-Id: [53<redacted>000]
X-Ms-Version: [2018-11-09]
--------------------------------------------------------------------------------
ERROR:
-> github.com/elastic/beats/vendor/github.com/Azure/azure-storage-blob-go/azblob.newStorageError, /go/src/github.com/elastic/beats/vendor/github.com/Azure/azure-storage-blob-go/azblob/zc_storage_error.go:42
===== RESPONSE ERROR (ServiceCode=BlobAlreadyExists) =====
Description=The specified blob already exists.
RequestId:53<redacted>0000
Time:2020-07-20T22:21:43.1409467Z, Details:
Code: BlobAlreadyExists
PUT https://<redacted>.blob.core.windows.net/filebeat-logevents/0?timeout=61
Authorization: REDACTED
Content-Length: [80]
If-None-Match: [*]
User-Agent: [Azure-Storage/0.7 (go1.13.8; linux)]
X-Ms-Blob-Cache-Control: []
X-Ms-Blob-Content-Disposition: []
X-Ms-Blob-Content-Encoding: []
X-Ms-Blob-Content-Language: []
X-Ms-Blob-Content-Type: []
X-Ms-Blob-Type: [BlockBlob]
X-Ms-Client-Request-Id: [60<redacted>e9b]
X-Ms-Date: [Mon, 20 Jul 2020 22:21:34 GMT]
X-Ms-Version: [2018-11-09]
--------------------------------------------------------------------------------
RESPONSE Status: 409 The specified blob already exists.
Content-Length: [220]
Content-Type: [application/xml]
Date: [Mon, 20 Jul 2020 22:21:42 GMT]
Server: [Windows-Azure-Blob/1.0 Microsoft-HTTPAPI/2.0]
X-Ms-Error-Code: [BlobAlreadyExists]
X-Ms-Request-Id: [53<redacted>00]
X-Ms-Version: [2018-11-09]
goroutine 57 [running]:
github.com/elastic/beats/vendor/github.com/Azure/azure-storage-blob-go/azblob.stack(0xc0008637d0, 0xc00015af00, 0xc0008ce510)
/go/src/github.com/elastic/beats/vendor/github.com/Azure/azure-storage-blob-go/azblob/zc_policy_request_log.go:146 +0x9d
github.com/elastic/beats/vendor/github.com/Azure/azure-storage-blob-go/azblob.NewRequestLogPolicyFactory.func1.1(0x37512a0, 0xc0001c97a0, 0xc00015af00, 0x10, 0x2ec2420, 0x1, 0xc000753600)
<cropped due to length>
I've tried renaming my registry file, no luck. Any help is appreciated!