Logstash configuration to load next pages automatically

[Iss]

I am new with ELK. I apologize for mistake

I have to configure logstash in order to import data from an external source using an oai-pmh API.
I try it using the following configuration.

input{
  http_poller{
	urls =>{
		test1=>{        
			method => get
			user => "theuserkey"
			password => "userpassword"
			url => "http://noozy.tv/oai?verb=ListRecords"
		}	
	}
	request_timeout => 60
	schedule => {"at" => "2022/05/03 10:00:00" }
codec => "json"	

  }
}

	filter {
    if !("splitted_ListRecordss" in [tags]) {
        json {
            source => "message"
        }
        split { 
            field => "ListRecords"
            add_tag => ["splitted_ListRecordss"]
        }
    }

    if ( "splitted_ListRecordss" in [tags] and [ListRecords][metas] ) {
        split {
            field => "[ListRecords][metas]"
        }
    }
}

output{
elasticsearch{
	hosts=> "localhost:9200"
	index=> "index1"
	codec => "json"
}

}

But I have two problems:
The first one: Results show that we have 3074 documents but only 20 have been imported in Elasticsearch. An url called resumptionurl is given to be executed to get the next 20 documents until all documents are imported (then the resumptionurl is not given). **I would like to configure logstash to execute the API url and get and execute the resumptionurl automatically **.

Thanks for help!

[Rios]

I think it's not supported.
Try with Filebeat with httpjson input and response.pagination .

HTTP JSON input | Filebeat Reference [8.2] | Elastic

[Iss]

Ok, Thank you! I will try I will try and get back .