So a bit of prerequisites:
- ES version: 1.6.0
- On AWS cluster, 16 d2.2xlarge
- Configured like so
Using the Java transport client we are indexing sensor data that happened in the day.
The documents have 45 json field (couple of which are arrays of other objects with a depth of 1)
We are indexing at a rate of 60-70kps
The index will have between 2.5-3B documents by the end of a day.
Now for the problem:
Sometimes we need to index to two days at the same time. As soon as we start indexing to two index with a cardinality greater than 2.5B, all indexing comes to a halt. Reducing down to a few hundred with spikes in the 50k range. Obviously this is no good for us.
Any help would be appreciated.