# How to configure s3 input to scale?
**URL:** https://discuss.elastic.co/t/how-to-configure-s3-input-to-scale/209360
**Category:** Beats
**Tags:** filebeat
**Created:** [November 25, 2019, 6:40pm UTC](https://discuss.elastic.co/t/how-to-configure-s3-input-to-scale/209360 "2019-11-25T18:40:36Z")
**Posts on this page:** 4
**Page:** 1
### Author:  [@Ronin](https://discuss.elastic.co/u/Ronin)
#### Post date: [November 25, 2019, 6:40pm UTC](https://discuss.elastic.co/t/how-to-configure-s3-input-to-scale/209360/1 "2019-11-25T18:40:36Z")
We have 3 filebeat instances running with a s3/sqs input. From what I can tell each instance will only pull 10 sqs messages at one time. We are not bottlenecked on cpu or ram, so what do I need to configure for it to process more simultaneously?
My elastic output is:
```auto
output.elasticsearch:
compression_level: 5
worker: 30
bulk_max_size: 500
```
---
### Author:  [@kvch](https://discuss.elastic.co/u/kvch)
#### Post date: [November 26, 2019, 12:21pm UTC](https://discuss.elastic.co/t/how-to-configure-s3-input-to-scale/209360/2 "2019-11-26T12:21:38Z")
You can scale Filebeat horizontally by starting multiple instances of them. See more: [https://www.elastic.co/guide/en/beats/filebeat/master/filebeat-input-s3.html#\_parallel\_processing](https://www.elastic.co/guide/en/beats/filebeat/master/filebeat-input-s3.html#_parallel_processing)
---
### Author:  [@Kaiyan\_Sheng](https://discuss.elastic.co/u/Kaiyan_Sheng)
#### Post date: [November 26, 2019, 2:45pm UTC](https://discuss.elastic.co/t/how-to-configure-s3-input-to-scale/209360/3 "2019-11-26T14:45:40Z")
Hi @Ronin the limit of 10 is because the AWS API call we are making `ReceiveMessage` to SQS. There is a parameter in this API limiting the maximum number of messages to return and the default is 10 in Filebeat S3 input.
In AWS API, this value is default to 1 and max to 10 so we can't go higher than 10 is my understanding:
`The maximum number of messages to return. Amazon SQS never returns more messages than this value (however, fewer messages might be returned). Valid values: 1 to 10. Default: 1.`
Please see [https://docs.aws.amazon.com/AWSSimpleQueueService/latest/APIReference/API\_ReceiveMessage.html](https://docs.aws.amazon.com/AWSSimpleQueueService/latest/APIReference/API_ReceiveMessage.html) for more info. Thanks!
---
### Author:  [@system](https://discuss.elastic.co/u/system)
#### Post date: [December 24, 2019, 2:45pm UTC](https://discuss.elastic.co/t/how-to-configure-s3-input-to-scale/209360/4 "2019-12-24T14:45:55Z")
This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.