Implications of using serial ids for documents

Elastic Stack Elasticsearch
1

I'm planning on linking documents I write to ES to records in my relational database by simply taking the record id and writing it to the document id. This means the IDs for my documents will be serial (ie. 1,2,3,4,5) instead of random.

Any idea if this could cause long term performance issues? Perhaps having non random but serial document ids will cause documents to not be randomly distributed through the storage engine making reads more expensive.

2

@terell
If ids are serial I think distribution should not be an issue. But providing _id (serial or not) will degrade ingestion speed as number of documents in the index grow.

3

Awesome. I'm guessing that the id field does not override the underlying _id field?

4

@terell

A meta-field _id is the document id. ES will ensure it's unique in an index. If you ingest two documents with same _id, the later one will overwrite previous one.

A field with a name "id" is an ordinary field. ES will allow any number of duplicates.

5

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.