Setting the Document ID

(Garry Robertson) #1

I am looking to set the document id while ingesting data though filebeats.
How would I achieve this?

(Christian Dahlqvist) #2

I think you would need to set the ID either in Logstash or in an ingest pipeline.

(Garry Robertson) #3

I'm looking to use the Filebeat>ES route and miss out on Logstash

(Christian Dahlqvist) #4

Then you will probably need to use an ingest pipeline.

(Garry Robertson) #5

Do you know how to, or can you point me in the right direction regarding doing this in a pipeline.

(Christian Dahlqvist) #6

I had a look at the fields available in the ingest processor context, and it seems the _id field might not be exposed (although It is exposed when you reindex). This might mean you will need to use Logstash.

Let's see if someone more familiar with Painless internals can comment on this.

(Christian Dahlqvist) #7

It seems it should be possible to do it in a pipeline.

(system) #8

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.