I'm new to elasticsearch and currently have ES 6.2 build with their official docker image running via Symfony's FOSElasticaBundle. The search side works fine, but I'm having really issues with some documents disappearing/not populating. I have around 528,383 documents to index, if I run the fos:elastica:populate command (which runs the bulk api I believe) most of the documents seem to be indexed but there seems to be quite a few that don't. If I delete some of the records from my DB so there's only 400,000 document then everything seems to work fine and the documents that weren't indexed now are. It seems like it could be a memory or garbage collection issue or something? Unless I need to change logging level, there isn't any errors in the logs, apart from gc.log.0.current (output below). I'm not sure what info is need to make this easier to debug and the char limit is stopping me from adding all my index stats/settings here so anything specific you need, let me know.
part of gc.log.0.current:
Desired survivor size 17432576 bytes, new threshold 6 (max 6)
- age 1: 9987120 bytes, 9987120 total
- age 2: 454352 bytes, 10441472 total
- age 3: 1792 bytes, 10443264 total
- age 4: 1280 bytes, 10444544 total
- age 5: 864 bytes, 10445408 total
- age 6: 928 bytes, 10446336 total
: 274221K->10735K(306688K), 0.0129793 secs] 494215K->230730K(2063104K), 0.0195985 secs] [Times: user=0.04 sys=0.00, real=0.02 secs]
2018-06-04T21:54:08.582+0000: 5856.701: Total time for which application threads were stopped: 0.0205432 seconds, Stopping threads took: 0.0001741 seconds
2018-06-04T21:54:48.568+0000: 5896.687: [GC (Allocation Failure) 2018-06-04T21:54:48.574+0000: 5896.693: [ParNew
Desired survivor size 17432576 bytes, new threshold 6 (max 6)
- age 1: 6158680 bytes, 6158680 total
- age 2: 2408 bytes, 6161088 total
- age 3: 1024 bytes, 6162112 total
- age 4: 832 bytes, 6162944 total
- age 5: 1280 bytes, 6164224 total
- age 6: 864 bytes, 6165088 total
: 283375K->11196K(306688K), 0.0067858 secs] 503370K->231192K(2063104K), 0.0130027 secs] [Times: user=0.01 sys=0.01, real=0.01 secs]