Setting the Document ID

I am looking to set the document id while ingesting data though filebeats.
How would I achieve this?

I think you would need to set the ID either in Logstash or in an ingest pipeline.

I'm looking to use the Filebeat>ES route and miss out on Logstash

Then you will probably need to use an ingest pipeline.

Do you know how to, or can you point me in the right direction regarding doing this in a pipeline.

I had a look at the fields available in the ingest processor context, and it seems the _id field might not be exposed (although It is exposed when you reindex). This might mean you will need to use Logstash.

Let's see if someone more familiar with Painless internals can comment on this.

It seems it should be possible to do it in a pipeline.

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.