Unfortunately customization like this on Elastic Agent is still pretty bad and you will need to create a custom template for each dataset in each one of your integrations.
Go into Stack Management > Index Management > Component templates and search for custom, you will see multiple @custom templates like these ones:
You will need to edit each one of them and add the number_of_replicas settings.