# Prevent logs data loss using Cloudflare integration powered by Elastic Agent

**URL:** https://discuss.elastic.co/t/prevent-logs-data-loss-using-cloudflare-integration-powered-by-elastic-agent/313562
**Category:** Elastic Agent
**Tags:** integrations
**Created:** [September 2, 2022, 3:13pm UTC](https://discuss.elastic.co/t/prevent-logs-data-loss-using-cloudflare-integration-powered-by-elastic-agent/313562 "2022-09-02T15:13:02Z")
**Posts on this page:** 9
**Page:** 1

<div class="post-metadata">

### Author: ![yago82](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/yago82/32/97755_2.png) [@yago82](https://discuss.elastic.co/u/yago82)
#### Post date: [September 2, 2022, 3:13pm UTC](https://discuss.elastic.co/t/prevent-logs-data-loss-using-cloudflare-integration-powered-by-elastic-agent/313562/1 "2022-09-02T15:13:02Z")

</div>

Using the CludFlare integration, in case of Elastic failure, will the logs that have been sent to elastic be lost?

Or there will be queues (or something similar) from which Elastic will restart once it is reset.

Or alternatively will it recover the lost data directly from CloudFlare?

Thank you.  
Regards.

---

<div class="post-metadata">

### Author: ![legoguy1000](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/legoguy1000/32/54301_2.png) [@legoguy1000](https://discuss.elastic.co/u/legoguy1000)
#### Post date: [September 6, 2022, 1:58am UTC](https://discuss.elastic.co/t/prevent-logs-data-loss-using-cloudflare-integration-powered-by-elastic-agent/313562/2 "2022-09-06T01:58:29Z")

</div>

What do u mean?? Can u provide context??

---

<div class="post-metadata">

### Author: ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)
#### Post date: [September 6, 2022, 2:13am UTC](https://discuss.elastic.co/t/prevent-logs-data-loss-using-cloudflare-integration-powered-by-elastic-agent/313562/3 "2022-09-06T02:13:12Z")

</div>

The underlying Beats themselves have internal tracking and queues to store data if they cannot contact Elasticsearch.

[How Filebeat works | Filebeat Reference [8.4] | Elastic](https://www.elastic.co/guide/en/beats/filebeat/current/how-filebeat-works.html) is one example of how that works.

---

<div class="post-metadata">

### Author: ![yago82](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/yago82/32/97755_2.png) [@yago82](https://discuss.elastic.co/u/yago82)
#### Post date: [September 6, 2022, 7:54am UTC](https://discuss.elastic.co/t/prevent-logs-data-loss-using-cloudflare-integration-powered-by-elastic-agent/313562/4 "2022-09-06T07:54:24Z")

</div>

Hi legoguy1000,

I have to push/pull Cloudflare logs to an Elastic Cloud.

So I thought to use the Cloudflare integration.  
So in case this solution worked, my doubts were about data loss.

Thank you.  
Regards  
Giacomo

---

<div class="post-metadata">

### Author: ![yago82](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/yago82/32/97755_2.png) [@yago82](https://discuss.elastic.co/u/yago82)
#### Post date: [September 6, 2022, 7:59am UTC](https://discuss.elastic.co/t/prevent-logs-data-loss-using-cloudflare-integration-powered-by-elastic-agent/313562/5 "2022-09-06T07:59:11Z")

</div>

Hi warkolm,

considering that the hypothetical architecture will be: Cloudflare \<--\> Elastic Agent (integration Cloudflare) \<--\> Elastic Cloud. Do you think it is possible and that your answer also applies to this architecture?

Thank you  
Regards

---

<div class="post-metadata">

### Author: ![legoguy1000](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/legoguy1000/32/54301_2.png) [@legoguy1000](https://discuss.elastic.co/u/legoguy1000)
#### Post date: [September 6, 2022, 8:29pm UTC](https://discuss.elastic.co/t/prevent-logs-data-loss-using-cloudflare-integration-powered-by-elastic-agent/313562/6 "2022-09-06T20:29:54Z")

</div>

So it's been found that the current integration using the logpull api can fall behind due to the extreme amount of data cloudflare produces. It may fall behind but shouldn't lose/drop data but I can't be 100%. The log push api long term should be more effective.

---

<div class="post-metadata">

### Author: ![yago82](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/yago82/32/97755_2.png) [@yago82](https://discuss.elastic.co/u/yago82)
#### Post date: [October 3, 2022, 7:19am UTC](https://discuss.elastic.co/t/prevent-logs-data-loss-using-cloudflare-integration-powered-by-elastic-agent/313562/7 "2022-10-03T07:19:46Z")

</div>

Hi, as actually the integration doesn't seem to work, but I can't get the evidence that it is due to the large number of logs. Do you know where to look for logs explaining the reason for the failure? Thank you.

---

<div class="post-metadata">

### Author: ![legoguy1000](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/legoguy1000/32/54301_2.png) [@legoguy1000](https://discuss.elastic.co/u/legoguy1000)
#### Post date: [October 3, 2022, 10:58am UTC](https://discuss.elastic.co/t/prevent-logs-data-loss-using-cloudflare-integration-powered-by-elastic-agent/313562/8 "2022-10-03T10:58:52Z")

</div>

In the fleet UI, go to the agent and look at the logs.

---

<div class="post-metadata">

### Author: ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)
#### Post date: [October 31, 2022, 10:59am UTC](https://discuss.elastic.co/t/prevent-logs-data-loss-using-cloudflare-integration-powered-by-elastic-agent/313562/9 "2022-10-31T10:59:12Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
