# Data ingest using curl

**URL:** <https://discuss.elastic.co/t/data-ingest-using-curl/237517>\
**Category:** Beats\
**Created:** [June 17, 2020, 5:22pm UTC](https://discuss.elastic.co/t/data-ingest-using-curl/237517 "2020-06-17T17:22:09Z")\
**Posts on this page:** 5\
**Page:** 1

<div class="post-metadata">

**Author:** ![vee](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/vee/32/55759_2.png) [@vee](https://discuss.elastic.co/u/vee)\
**Post date:** [June 17, 2020, 5:22pm UTC](https://discuss.elastic.co/t/data-ingest-using-curl/237517/1 "2020-06-17T17:22:09Z")

</div>

Is there a way to pull logs from an external system into Elastic through curl command? If so, what are the recommendations on it's architecture.

Here is what I have in mind:

Setup a shell script to run curl command -\> Dump data in to a local file -\> Filebeat -\> Logstash pipeline -\> ElasticSearch (v7.x)

Just wondering if there are other modules that we can leverage within logstash/beats. I couldn't find any but want to be sure.

Thanks!

---

<div class="post-metadata">

**Author:** ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)\
**Post date:** [June 17, 2020, 10:34pm UTC](https://discuss.elastic.co/t/data-ingest-using-curl/237517/2 "2020-06-17T22:34:07Z")

</div>

Metricbeat can call a HTTP endpoint - [https://www.elastic.co/guide/en/beats/metricbeat/current/metricbeat-module-http.html](https://www.elastic.co/guide/en/beats/metricbeat/current/metricbeat-module-http.html). That might do what you want.

---

<div class="post-metadata">

**Author:** ![vee](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/vee/32/55759_2.png) [@vee](https://discuss.elastic.co/u/vee)\
**Post date:** [June 18, 2020, 3:18pm UTC](https://discuss.elastic.co/t/data-ingest-using-curl/237517/3 "2020-06-18T15:18:13Z")

</div>

We are intending to pull the application logs from the remote end point, not necessarily system metrics. Can filebeat do the same instead so we can pull remote logs and ingest into elastic?

---

<div class="post-metadata">

**Author:** ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)\
**Post date:** [June 22, 2020, 10:38pm UTC](https://discuss.elastic.co/t/data-ingest-using-curl/237517/4 "2020-06-22T22:38:59Z")

</div>

No it cannot.

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [July 21, 2020, 12:39am UTC](https://discuss.elastic.co/t/data-ingest-using-curl/237517/5 "2020-07-21T00:39:00Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.