I've setup logstash to query data from a MySQL db and it is working fine up to a point. The last run file contains the correct index and i see in the log that the query is being run:
The issue is that in the elastic index the data does not seem to be inserted. Once I restart the logstash service though the data does get pushed through.
I would appreciate any help in trying to debug this issue. Is there anything I can do to get some more logging info?
One thing that I am thinking of is due to the fact that this query sometime takes a while to run or some other query takes some time that the queries are "cancelling" each other?? Again not sure but hoping that might give someone something to help me with.