We are looking out replacement for our existing SPHINX cluster for search, we are evaluating SOLR & Elasticsearch. We need real time index and fast response for selects. For our POC we are using 2 cent OS (64 bit) boxes with 24GB RAM, 16 & 8 core processors respectively, documents (216 fields) around 2.4 million with index size 30GB approx.
Elasticsearch version: 5.6.0 & 6.1.1
elasticsearch.yml file has the following configurations
Refresh interval: Default, Insert / Update - with ?refresh=true, replication factor 1
While giving load test (Jmeter + PHP) I am giving 1 Insert request, 2 update requests and a select request
Problem I am facing is the insert/updates are not getting reflected in search even after the 1 sec refresh interval.
The moment I stopped giving the load, all the Insert / updates are getting reflected within 1 or 2 seconds
To narrow down the problem, from the jemeter test case I disabled select component, the updates are getting reflected immediately
I googled for my issue, but nobody talked about this, looks like I am missing some configuration parameter.
Can somebody please point out the gaps?