# Getting logs from azure blog storage and pushing to ES through Logstash?

**URL:** <https://discuss.elastic.co/t/getting-logs-from-azure-blog-storage-and-pushing-to-es-through-logstash/93393>\
**Category:** Logstash\
**Created:** [July 17, 2017, 12:46pm UTC](https://discuss.elastic.co/t/getting-logs-from-azure-blog-storage-and-pushing-to-es-through-logstash/93393 "2017-07-17T12:46:03Z")\
**Posts on this page:** 3\
**Page:** 1

<div class="post-metadata">

**Author:** ![Yaswanth](https://avatars.discourse-cdn.com/v4/letter/y/94ad74/32.png) [@Yaswanth](https://discuss.elastic.co/u/Yaswanth)\
**Post date:** [July 17, 2017, 12:46pm UTC](https://discuss.elastic.co/t/getting-logs-from-azure-blog-storage-and-pushing-to-es-through-logstash/93393/1 "2017-07-17T12:46:03Z")

</div>

Hi Team,

I am sending my txt file which is stored in azureblobstorage to ES directly with the help of logstash with this [plugin](https://github.com/Azure/azure-diagnostics-tools/tree/master/Logstash/logstash-input-azureblob).

My config is like this:

```
input
{
    azureblob
    {
        storage_account_name => "mystorageaccount"
        storage_access_key => "VGhpcyBpcyBhIGZha2Uga2V5Lg=="
        container => "mycontainer"
    }
}
output {
  elasticsearch { hosts => ["localhost:9200"] 
}
} 

```

I am getting error like this in logstash

```
Caught exception while locking {:exception=>#<Azure::Core::Http::HTTPError:15752 @status_code: 400, @http_response: #<Azure::Core::Http::HttpResponse:0x70b417e1 @http_response=#<Faraday::Response:0x5dbac6c4 @on_complete_callbacks=[], @env=#<Faraday::Env @method=:put @body="\xEF\xBB\xBF<?xml version=\"1.0\" encoding=\"utf-8\"?><Error><Code>BlobTypeNotSupported</Code><Message>Page blob is not supported for this account type.\nRequestId:a1be676a-0001-0050-3fb9-002df1000000\nTime:2017-07-19T18:06:18.1830830Z</Message></Error>" @url=#<URI::HTTPS:0x37eca579 URL:https://azureexplorerblob.blob.core.windows.net/eslogs/picaso.txt.lock> @request=#<Faraday::RequestOptions open_timeout=60> @request_headers={"User-Agent"=>"Azure-Core/0.1.7", "x-ms-date"=>"Wed, 19 Jul 2017 18:06:17 GMT", "x-ms-version"=>"2014-02-14", "DataServiceVersion"=>"1.0;NetFx", "MaxDataServiceVersion"=>"2.0;NetFx", "Content-Type"=>"application/atom+xml; charset=utf-8", "x-ms-blob-type"=>"PageBlob", "Content-Length"=>"0", "x-ms-blob-content-length"=>"512", "x-ms-sequence-number"=>"0", "Authorization"=>"SharedKey azureexplorerblob:FXkteDw28TnQ7LuQRdRy+DmmLxzQZtHrce9E2lthLoI="} @ssl=#<Faraday::SSLOptions verify=true> @response=#<Faraday::Response:0x5dbac6c4 ...> @response_headers={"content-length"=>"238", "content-type"=>"application/xml", "server"=>"Windows-Azure-Blob/1.0 Microsoft-HTTPAPI/2.0", "x-ms-request-id"=>"a1be676a-0001-0050-3fb9-002df1000000", "x-ms-version"=>"2014-02-14", "date"=>"Wed, 19 Jul 2017 18:06:17 GMT", "connection"=>"close"} @status=400>>, @uri=#<URI::HTTPS:0x37eca579 URL:https://azureexplorerblob.blob.core.windows.net/eslogs/picaso.txt.lock>>, @uri: #<URI::HTTPS:0x37eca579 URL:https://azureexplorerblob.blob.core.windows.net/eslogs/picaso.txt.lock>, @description: "Page blob is not supported for this account type.\nRequestId:a1be676a-0001-0050-3fb9-002df1000000\nTime:2017-07-19T18:06:18.1830830Z", @type: "BlobTypeNotSupported">, :level=>:error}

```

But when i changed the account type from blob to general storage when i executed the first time the i can see the output send to ES . When i did the same again it is not sending any output to ES and also didnt showing any error in logstash too(i.e.Even i kept stdout { codec =\> rubydebug } in output ).

How can i resolve this and send data to ES ?

Thanks

---

<div class="post-metadata">

**Author:** ![jsvd](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/jsvd/32/6203_2.png) [@jsvd](https://discuss.elastic.co/u/jsvd)\
**Post date:** [July 21, 2017, 4:08pm UTC](https://discuss.elastic.co/t/getting-logs-from-azure-blog-storage-and-pushing-to-es-through-logstash/93393/3 "2017-07-21T16:08:48Z")

</div>

I am not familiar with the azure blog storage, but the error is coming from the azure api and seems clear:

```auto
<Error><Code>BlobTypeNotSupported</Code><Message>Page blob is not supported for this account type.\nRequestId:a1be676a-0001-0050-3fb9-002df1000000

```

Googling for that error I see some hits like:

> **[Page Blob is not supported for this account type – Azure Resource Manager](https://opensource4admin.wordpress.com/page-blob-is-not-supported-for-this-account-type-azure-resource-manager/)**
>
> Today I faced a problem while transferring my customized vm images from Storage Accounts(Classic) to Storage Accounts (Resource Manger) . I was using CloudBerry Explorer for Azure Blob Storage tool…

  
[https://social.msdn.microsoft.com/Forums/en-US/e946458c-4cf5-4e1d-b842-860fc77ef1d9/azure-blob-storage-issue-with-cta-sp3-emc-cloud-tiering-appliance?forum=windowsazuredata](https://social.msdn.microsoft.com/Forums/en-US/e946458c-4cf5-4e1d-b842-860fc77ef1d9/azure-blob-storage-issue-with-cta-sp3-emc-cloud-tiering-appliance?forum=windowsazuredata)

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [August 18, 2017, 4:09pm UTC](https://discuss.elastic.co/t/getting-logs-from-azure-blog-storage-and-pushing-to-es-through-logstash/93393/4 "2017-08-18T16:09:00Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.