Delete All and multiple bulk puts

Elastic Stack Elasticsearch
1

Hi All,

New user here and I've come across my first issue which the documentation doesn't seem to cater for.

I have a need to index about 35,000 small records which I intend to do through /indexName/_bulk. At first I threw the lot at the URL using the PUT (so delete what's there before write) but realised the buffer filled up too quickly. I then broke the records down into groups of 200 and wrote sequentially, but of course the PUT's are overwriting one another (resolved the buffer though).

My next attempt was to do one PUT and then a PATCH but the PATCH is coming over as unsupported.

I'm probably just unaware of the best method and standing by to learn what it is!

Thanks,

Andrew

2

Welcome to our community! :smiley:

Elasticsearch doesn't support patch, so I am not sure what your expectations there are.
However, you should aim for a few thousand per bulk, <5K really. And you should run one request at a time.

3

I've solved it -

  1. delete index
  2. recreate index
  3. run sequenced PUT's but keep track of the index and add the length for each PUT
4

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.