Potential Clash of Auto-Generated IDs


(Kevin M.) #1

I am going to be processing a couple million records of the same type into separate indexes for now and will be allowing ES to auto assign the ID of the records. My question is, if I do that and then later decide to merge them all into one index is there any possibility that some records will fail to merge into the new index because of a clash with an auto generated ID in another index? Any info would be appreciated. Thanks.

Kevin


(Mark Walkom) #2

There is a possibility, though I'd imagine it'd be pretty small.

From https://www.elastic.co/guide/en/elasticsearch/guide/current/index-doc.html#_autogenerating_ids;

Autogenerated IDs are 20 character long, URL-safe, Base64-encoded GUID strings. These GUIDs are generated from a modified FlakeID scheme which allows multiple nodes to be generating unique IDs in parallel with essentially zero chance of collision.


(Kevin M.) #3

@warkolm thank you very much for the info, exactly what I was looking for!

Kevin


(system) #4

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.