That is not simple. outputs sometimes have a receive method that consumes a single event, and sometimes have a multi_receive method that consumes an array of events (a batch). The multi_receive method typically iterates over the array and processes the events one at a time. The http output is unusual in that it can process the entire array in one shot. However, it provides no flexibility on the request format that it sends over http.
That means you will have to do some work in the filter section, and the filter section does not see a batch, it sees individual events.
If you are OK with sending one event per request
{ records : [{json1}] }
{ records : [{json2}] }
{ records : [{json3}] }
etc., then modifying the format is not very hard.
Otherwise you are going to have to aggregate the events to create a batch. That can be done. There is an example of combining events with a limit on size here. You could change that to add a set number of events to an array, effectively re-creating the batch.
Which approach do you prefer?