Hi
How to get elasticsearch to receive orders up to 100,000
Because when I search elasticsearch I get the following error
dial tcp ...:9200 connct : cannot assign requested
Hello,
You need to provide a lot more of context, it is not clear what you want to do and what is your issue.
Where is this log from? Please share the entire log and also explains what you are trying to do.
I'm trying to transfer data from index to pointer
Another so that I move the data to the new index and at the same time I search the new index and compare whether the data I want to enter has been entered into the new index or not if it is not entered he enters it but if it is there he avoids entering it again
So that there is no duplication in the data
When I do this operation, it reaches a certain limit, it is 10000, if it exceeds this, it repeats the said mistake driving
I think the problem is that it requires changing the default numbers and making it a larger number
That is, I change the elasticsearch settings to accept a larger number of requests
How to change it to accept a larger number of applications?
Sorry, but it is still a little confusing.
You are trying to copy data from one index to another index? Is this in the same cluster?
How are you doing it? Are you using any tool? Any custom code?
The easiest way to do that is using reindex.
If you are doing queries on an index, the results are limited to 10000 events and you would need to paginate the results as described in the documentation.
You could also increase the value of the setting index.max_result_window in elasticsearch.yml and restart the nodes, but this is not recommended as it will increase the memory usage, the more efficient way is to paginate the results.
Well, it's just that I want to look for more than 10,000 data at a time, it doesn't matter the resources.
For example, index.max_result_window to change the number of results that are displayed
I want the equivalent number to change the number of doc being searched for
More clarification
Now if we do the search, it will return us only 10,000 in the results, but with the numbers you mentioned, I can make this number larger
My problem is similar to this problem, I want you to elasticsearch receive 100,000 requests and return the result.
yes
But this is not the problem it was only for the purpose of clarification
Okay, I'll experiment.
Thank you for asking I am fine and you
Yes use but it does not show any mistake other than the one mentioned above any builder I do not protest except to increase the number of requests
Elasticsearch search within all the data. If there's more hits than 10000, it will tell you that there's more than 10000 results.
If there's less hits, it will tell you the exact number.
If you want in all cases the exact number of hits, just add
track_total_hits: true
In your query.
I want to send 100,000 requests per second for example
For example a question
How many requests can elasticsearch withstand per second?
I want it to be 100000
There is no single answer to this, it depends on too many factors, like the type of the request, the amount of data, the hardware specs etc.
The only way to find out is by testing.
You are going quickly from retrieving very large result sets to handling very large number of requests per second. It would probably help if you could describe your use case and requirements in more detail as that may allow users here to give better answers, guidance and feedback.