I created a transform on ELK and it is up and HEALTHY but till now there's still no documents in the destination index for a data view. It's been about 6 hours. Is that supposed to be normal? or if not how can I check if there is a problem?
What does the transform's stats show? checkpoint should progress incrementally beyond 0 each time the transform searches the source index and writes to the destination index. trigger_count increasing each time the transform is scheduled, regardless of whether there is data to process or not. search* stats are how many documents it is finding, and documents* is how many documents are being written.
or under the Details and Stats tabs on the Stack Management -> Transforms page in Kibana
There's also the _preview API to check what the search results would be from the source index, which would help verify if the transform is finding data and just not writing it for some reason:
What are you using to determine the health of the transform, is it Kibana? There should be a "reason" on the health tab for why it is degraded, and there is a messages tab when the transform auditor logs events, both may help explain what is going on? If nothing stands out there, maybe check the ES logs for WARN/ERROR from the transform id?
Apache, Apache Lucene, Apache Hadoop, Hadoop, HDFS and the yellow elephant
logo are trademarks of the
Apache Software Foundation
in the United States and/or other countries.