Nothing in-depth about this, but we managed to get roughly 20k indexes /
sec with 12 simultaneous threads (java code) on 1 node, running on a 16GB
RAM, quad core, 1x 240GB SSD machine.
Disclaimer: The information contained in this message and attachments is
intended solely for the attention and use of the named addressee and may be
confidential. If you are not the intended recipient, you are reminded that
the information remains the property of the sender. You must not use,
disclose, distribute, copy, print or rely on this e-mail. If you have
received this message in error, please contact the sender immediately and
irrevocably delete this message and any copies.
2012/9/21 Clinton Gormley firstname.lastname@example.org
In my testing(a perl script bulk index nginx access log using http
protocol ), the count / time ~ 5000 rps when I fork four porcesses.
But the CPU Util increase to 300%+.
And after I add the second node using default config, the index rps
decrease to 2500! Now I am feeling uncertain about this...
You don't provide any information about whether you are running these
two nodes on different servers, or on the same machine where you're
running the indexing script, or if the servers have different
configurations etc etc.