Reindex failing with SearchContextMissingException: No search context found for id (batch size = 1)

Hello :slight_smile:

I am trying to reindex about 3mil documents (~50gb) trough an ingestion pipeline.

POST _reindex?&wait_for_completion=false
  "source": {
    "size": 1, 
    "index": "src"
  "dest": {
    "index": "dst"
    "pipeline": "reindex_pipeline"

As you can see, I already tried lower batch sizes (even down to one)
but as the pipeline is doing some heavy computations, it seems at least one document is causing a scroll context to become invalid.

Is there any other way (besides lowering batch size) to fight this? all shards failed
Caused by: org.elasticsearch.transport.RemoteTransportException: [node name][][indices:data/read/search[phase/query+fetch/scroll]]
Caused by: No search context found for id [...]

(Single Node running ES6.7)

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.