Use a timestamp to version documents in an index ingested with 'org.elasticsearch.hadoop.hive.EsStorageHandler'

Elastic Stack Elasticsearch
1

Hi Everyone,

I'm looking to update/version a series of documents based on a timestamp within them. For this process, it seems like the best of doing so would be to use external versioning with the index API - datetime.ticks as the version number.

One of my main issues in doing this is that I can't find good documentation on the connector: org.elasticsearch.hadoop.hive.EsStorageHandler

Also, I want to use the datetime within the object to version.

We currently use ES 5.0. Is there a way to implement this functionality pulling data from HIVE?

Thanks for the help!
Matt Henricks

2

Has anyone had experience with external versioning before in the HIVE environment? A simple example would be great

3

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.