# How can i send the backup start time and end time to azure cloud storage table?

**URL:** https://discuss.elastic.co/t/how-can-i-send-the-backup-start-time-and-end-time-to-azure-cloud-storage-table/84883
**Category:** Elasticsearch
**Created:** [May 8, 2017, 6:44am UTC](https://discuss.elastic.co/t/how-can-i-send-the-backup-start-time-and-end-time-to-azure-cloud-storage-table/84883 "2017-05-08T06:44:05Z")
**Posts on this page:** 5
**Page:** 1

<div class="post-metadata">

### Author: ![Yaswanth](https://avatars.discourse-cdn.com/v4/letter/y/94ad74/32.png) [@Yaswanth](https://discuss.elastic.co/u/Yaswanth)
#### Post date: [May 8, 2017, 6:44am UTC](https://discuss.elastic.co/t/how-can-i-send-the-backup-start-time-and-end-time-to-azure-cloud-storage-table/84883/1 "2017-05-08T06:44:05Z")

</div>

Hi,

To do my backup and restore i am using curator 4.2.6 and sending the all the snapshots to azure blob storage account through azure cloud plugin 2.4.1 but what i need is

1. I need to send the snapshot start time and end time to azure table storage by this i can able to see whether the snapshot is success or not(i.e.if end time is there then it is success otherwise not)

Is this possible in Elasticsearch?

Thanks

---

<div class="post-metadata">

### Author: ![theuntergeek](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/theuntergeek/32/44961_2.png) [@theuntergeek](https://discuss.elastic.co/u/theuntergeek)
#### Post date: [May 8, 2017, 4:33pm UTC](https://discuss.elastic.co/t/how-can-i-send-the-backup-start-time-and-end-time-to-azure-cloud-storage-table/84883/2 "2017-05-08T16:33:28Z")

</div>

No, but it might be possible in Logstash.

As a simple, high-level example:

1. Make Curator log in JSON with `logformat => json` in the client YAML configuration file.
2. Read this file with Logstash
3. Capture _only_ the begin/end events by matching text with grok
4. Take the timestamps and send them to some other service which can put this into your cloud storage table.

For 4, you could write your own Logstash output plugin, if you have the time and resources. Otherwise, you can output to a file, or tcp, or the http\_output plugin, or something like that and get the output where it needs to go.

---

<div class="post-metadata">

### Author: ![Yaswanth](https://avatars.discourse-cdn.com/v4/letter/y/94ad74/32.png) [@Yaswanth](https://discuss.elastic.co/u/Yaswanth)
#### Post date: [May 8, 2017, 5:16pm UTC](https://discuss.elastic.co/t/how-can-i-send-the-backup-start-time-and-end-time-to-azure-cloud-storage-table/84883/3 "2017-05-08T17:16:30Z")

</div>

Thanks

> [@theuntergeek](#):
>
> Read this file with Logstash

To send the curator logs to logstash automatically i have to enable filebeats right?

> [@theuntergeek](#):
>
> you can output to a file,

Again to send this file to azure i have to do that manually everytime or is there any other way to do that automatically?

`My thought:`

Normally the Curator Snapshots Start time, End time is stored in Azure blob storage , Is it possible to copy the same to Azure table storage?

Correct me if i am wrong..

Thanks

---

<div class="post-metadata">

### Author: ![theuntergeek](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/theuntergeek/32/44961_2.png) [@theuntergeek](https://discuss.elastic.co/u/theuntergeek)
#### Post date: [May 8, 2017, 5:34pm UTC](https://discuss.elastic.co/t/how-can-i-send-the-backup-start-time-and-end-time-to-azure-cloud-storage-table/84883/4 "2017-05-08T17:34:48Z")

</div>

> [@Yaswanth](#):
>
> To send the curator logs to logstash automatically i have to enable filebeats right?

Filebeat is a great way to do that, yes. Be sure to indicate in the config that the data is already in JSON.

> [@Yaswanth](#):
>
> Again to send this file to azure i have to do that manually everytime or is there any other way to do that automatically?

I personally don't know _how_ to input data into an Azure cloud storage table. Logstash can write to a [file](https://www.elastic.co/guide/en/logstash/current/plugins-outputs-file.html). It can send data over plain [TCP](https://www.elastic.co/guide/en/logstash/current/plugins-outputs-tcp.html). It can send data via [http](https://www.elastic.co/guide/en/logstash/current/plugins-outputs-http.html). Logstash has [many other](https://www.elastic.co/guide/en/logstash/current/output-plugins.html) output formats. If there's a way you can find to use these to send to an Azure cloud storage table, then great. Otherwise, you'll have to find your own way to extend Logstash, or read from a file, or listen to TCP and get the information over there yourself.

> [@Yaswanth](#):
>
> Normally the Curator Snapshots Start time, End time is stored in Azure blob storage , Is it possible to copy the same to Azure table storage?

Are you referring to the metadata Elasticsearch writes out to the repository? Curator doesn't write that. Curator talks to Elasticsearch via API, and Elasticsearch does anything else. As with the other statements here, you'll have to figure out how to get that data "the last mile" into your storage table on your own.

---

<div class="post-metadata">

### Author: ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)
#### Post date: [June 5, 2017, 5:36pm UTC](https://discuss.elastic.co/t/how-can-i-send-the-backup-start-time-and-end-time-to-azure-cloud-storage-table/84883/5 "2017-06-05T17:36:09Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
