Potential Clash of Auto-Generated IDs

Elastic Stack Elasticsearch
1

I am going to be processing a couple million records of the same type into separate indexes for now and will be allowing ES to auto assign the ID of the records. My question is, if I do that and then later decide to merge them all into one index is there any possibility that some records will fail to merge into the new index because of a clash with an auto generated ID in another index? Any info would be appreciated. Thanks.

Kevin

2

There is a possibility, though I'd imagine it'd be pretty small.

From Indexing a Document | Elasticsearch: The Definitive Guide [2.x] | Elastic;

Autogenerated IDs are 20 character long, URL-safe, Base64-encoded GUID strings. These GUIDs are generated from a modified FlakeID scheme which allows multiple nodes to be generating unique IDs in parallel with essentially zero chance of collision.

3

@warkolm thank you very much for the info, exactly what I was looking for!

Kevin

4

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.