upsert operation and refresh set to 3s

Elastic Stack Elasticsearch
1

i'm doing upsert like this

public async Task AddOrUpdate(Car car, CancellationToken cancellationToken)
{
await _client.IndexAsync(user, i => i
.Index(latestIndexName)
.Id(car.Id),
cancellationToken);
}

and i set refresh interval to be 3s , and i DisableIdInference
now any event that came before the refresh is done for the same car id will create a duplicate of it instead of update
Steps to reproduce:
1.set refresh to 3s
2.disableIdinference
3.call this method for the same car multiple times within 3s interval

Expected behavior
A clear and concise description of what you expected to happen.
i'm not sure how this should be handled , setting refresh manually just after indexasync will make the service more slow.