Pre-processing Couchbase documents

[jscubida (J C)]

Hello. What is the best way to transform a document coming from the Couchbase plugin? If using ingest node is the answer, how would one achieve this?

Specifically, we would like to transform a timestamp from a double (1487159155.4979) to a long (1487159155) before indexing occurs for the purpose of conforming to Elasticsearch's date datatype. The documentation for ingest node describes exactly what we're looking for, but we haven't been able to figure out how to use it in conjunction with the Couchbase Transport Plugin for Elasticsearch. We were thinking about using the script processor but are also considering the date processor.

Thanks ahead of time!

[dnault (David Nault)]

Hi J C,

Version 3.0.0 of the Couchbase plugin lets you specify a couchbase.pipeline config property. Documents will be sent to the named pipeline for ingestion. Give it a shot and let us know how it works for you.

Thanks,
David

[jscubida (J C)]

Hi David,

Thanks so much for this! I just tried it out. It's exactly what we're looking for and works exactly as expected.

Thanks!
J.C.