Cannot see data inserted into elasticsearch via mongo in real-time


(coys) #1

Hi, I'm using rwilly's river plugin for mongodb which works on oplogs.
I'm using elasticsearch for performing full text-search. I'm having an
issue where only the data I insert into mongodb for the first half an
hour or so, or first few inserts can be seen real-time on elastic-
search. Subsequent data can only be seen when I restart the elastic-
search process, though the data is present in mongo. Can someone
please tell me why this could be happening? Thanks!


(Shay Banon) #2

I am not familiar with the mongodb river, but from what I see, its in very
early alpha stage, so it might make sense to do the integration yourself.

On Fri, Jun 1, 2012 at 5:29 PM, coys gautam719@gmail.com wrote:

Hi, I'm using rwilly's river plugin for mongodb which works on oplogs.
I'm using elasticsearch for performing full text-search. I'm having an
issue where only the data I insert into mongodb for the first half an
hour or so, or first few inserts can be seen real-time on elastic-
search. Subsequent data can only be seen when I restart the elastic-
search process, though the data is present in mongo. Can someone
please tell me why this could be happening? Thanks!


(xavier martin) #3

Hi,

I've made a patch that appear to fix this issue.
pull request


(coys) #4

Sorry, I only read the posts now. Thanks a lot!!

On Jun 14, 12:14 am, xavier martin xav.mar...@gmail.com wrote:

Hi,

I've made a patch that appear to fix this issue.
pull requesthttps://github.com/richardwilly98/elasticsearch-river-mongodb/pull/20


(system) #5