Hi does transfom update documents? I have a continuous transform running on and index which continuously has new documents injested and existing documents updated. Each Document has a field which is called "doc.lastUpdated" which is a date field that specifies when the document was last modified.
When setting up a transform I provide a date field "Select the date field that can be used to identify new documents". Should this field be the date a Document is created "doc.timeStamp" or the date a Document is last updated "doc.lastUpdated" ?
I saw this in the documentation but I wasnt clear on this setting.
"Changed entities will only be identified if their time field has also been updated and falls within the range of the action to check for changes. This has been designed in principle for, and is suited to, the use case where new data is given a timestamp for the time of ingest."