Self Hosted , app search is very slow

HI,
My index count is 6000 documents and using the python client.
Even a blank query with no filter/query and fetching just ID takes 200-350 ms.

Any ideas on how to improve this? Optimum expected query time is <100ms.

I have tried. docker deployment as well as direct linux executable.

Please provide help with if caching/ or change some config to provide more resources can speed up the process.