yup. I can see an insertion request going into ES (but not the
response. now that I think of it), but running my query shows no
record is available for that item.
all of our records are virtually the same size (about 1kb), and the
most insertions we'd be seeing is 10-20 per second. occasionally that
might go up to 50.
how often does refresh happen by default, and how long does it take?
I'm wondering if 10 shards is not enough for the size of our index.
On Jan 18, 4:13 pm, Shay Banon kim...@gmail.com wrote:
Does this happen with search request, where you see the old data? By
default, elasticsearch will refresh an index to see newly indexed docs (or
deletes) every seconds. Can you use the index stats API to see if there was
a bump in how long it took to refresh (there is refresh stats there).On Wed, Jan 18, 2012 at 8:15 AM, Oren Mazor oren.ma...@gmail.com wrote:
Hi all,
We've deployed elasticsearch in our production and we're incredibly
happy with search performance. However, we're seeing occasional issues
where ES seems to return an older version of a record. In some cases
it can take up to half an hour before the proper (latest) version of a
record shows up. We have two nodes with 10 shards each with one
replica, and the index is about 30m records and 25gb in size, so it's
not the smallestThis is pretty hard to reproduce, so its relatively hard to test. But
I'd love to hear ideas.thanks!
