# Pagination Logic in input of HTTP Poller plugin
**URL:** https://discuss.elastic.co/t/pagination-logic-in-input-of-http-poller-plugin/127427
**Category:** Logstash
**Created:** [April 10, 2018, 6:59am UTC](https://discuss.elastic.co/t/pagination-logic-in-input-of-http-poller-plugin/127427 "2018-04-10T06:59:34Z")
**Posts on this page:** 5
**Page:** 1
### Author:  [@Amit\_Jaiswal](https://discuss.elastic.co/u/Amit_Jaiswal)
#### Post date: [April 10, 2018, 6:59am UTC](https://discuss.elastic.co/t/pagination-logic-in-input-of-http-poller-plugin/127427/1 "2018-04-10T06:59:35Z")
I have to bulk import data via LogStash as below:
Source: Restful Get APIs
Destination : ElasticSearch
My .conf file looks as below:
input {
http\_poller {
urls =\> {
test1 =\> {
method =\> get
url =\> "[https://someurl/movies?limit=100&offset=0](https://someurl/movies?limit=100&offset=0)"
headers =\> {
Accept =\> "application/json"
}
}
}
This fetches 100 records at a time.
But, i have more than 5000 records and need to apply pagination logic in input of http-poller.
Please help how can i apply pagination logic here.
Thanks.
---
### Author:  [@magnusbaeck](https://discuss.elastic.co/u/magnusbaeck)
#### Post date: [April 10, 2018, 7:27am UTC](https://discuss.elastic.co/t/pagination-logic-in-input-of-http-poller-plugin/127427/2 "2018-04-10T07:27:03Z")
The http\_poller has no support for paginated requests.
---
### Author:  [@Amit\_Jaiswal](https://discuss.elastic.co/u/Amit_Jaiswal)
#### Post date: [April 10, 2018, 10:44am UTC](https://discuss.elastic.co/t/pagination-logic-in-input-of-http-poller-plugin/127427/3 "2018-04-10T10:44:35Z")
Can you please provide any input on how to handle this scenario of pagination ?
---
### Author:  [@magnusbaeck](https://discuss.elastic.co/u/magnusbaeck)
#### Post date: [April 10, 2018, 11:14am UTC](https://discuss.elastic.co/t/pagination-logic-in-input-of-http-poller-plugin/127427/4 "2018-04-10T11:14:01Z")
I'd patch the http\_poller plugin or write a custom plugin. An external custom script (run via an exec input) would be another option.
---
### Author:  [@system](https://discuss.elastic.co/u/system)
#### Post date: [May 8, 2018, 11:14am UTC](https://discuss.elastic.co/t/pagination-logic-in-input-of-http-poller-plugin/127427/5 "2018-05-08T11:14:13Z")
This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.