I am using elastic search to index fairly very high amount of logs nearly 20000 per second. I used Elastic search 2.2 and used the java client API for the purpose of indexing into the elastic search. We also regularly retrieve large data from the elastic search. We noticed that the JVM tends to hung often is it normal. Or could you suggest any optimizations to be done to improve the performance
Why does it hand? Do you see evidence of long or frequent GC in the logs? What is the specification of the cluster?
We also tried to enable logging in elastic search but was unsuccessful in making it to work. I specified the path.logs in the yaml file but still the ES does not print out any logs
How do you do that? Are you playing by any chance with
size option and not using the scroll API?
We use scroll api to retrieve information with size set to a maximum of 5000 logs
This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.