# Logstash http\_poller - fetching big files

**URL:** <https://discuss.elastic.co/t/logstash-http-poller-fetching-big-files/183052>\
**Category:** Logstash\
**Created:** [May 28, 2019, 9:57am UTC](https://discuss.elastic.co/t/logstash-http-poller-fetching-big-files/183052 "2019-05-28T09:57:42Z")\
**Posts on this page:** 2\
**Page:** 1

<div class="post-metadata">

**Author:** ![pastechecker](https://avatars.discourse-cdn.com/v4/letter/p/0ea827/32.png) [@pastechecker](https://discuss.elastic.co/u/pastechecker)\
**Post date:** [May 28, 2019, 9:57am UTC](https://discuss.elastic.co/t/logstash-http-poller-fetching-big-files/183052/1 "2019-05-28T09:57:42Z")

</div>

Hello.

I have 1GB json file that changes and it is on the remote server. I am able to do the fetch with the file size approx 500 MB, but not 1GB.

```
input {
 http_poller {
  urls => { 
        url1 => "https://externalserver:80/all.json"
  }
  request_timeout => 9000
  socket_timeout => 9000
  tags => ["urls"]
  codec => "json"
  validate_after_inactivity => 200
  schedule => { cron => "43 * * * *" }
 }
}

```

My machine is is very capable of handling any processing and hardware is top-notch.  
Does anyone knows what is the top limit for http\_poller for fetching files?

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [June 25, 2019, 9:57am UTC](https://discuss.elastic.co/t/logstash-http-poller-fetching-big-files/183052/2 "2019-06-25T09:57:56Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.