Logstash Bulk Indexing

(Panda) #1

Hello Community,

I am new to Logstash and I was looking through the Logstash documentation for support of Bulk Indexing in elasticsearch output plugin. I got one config "bulk_path" related to this. But I am unable to understand the working of bulk indexing via elastic search output plugin. Also what configurations are needed to be done for implementing it.
It would be great help if anyone could provide a sample bulk indexing pipeline configuration of Logstash.

Any help would be appreciated.

(Christian Dahlqvist) #2

The elasticsearch output plugin uses bulk requests by default, so no additional configuration is required.

(Panda) #3

Then what does the configuration 'bulk_path' do ?

(Christian Dahlqvist) #4

Not sure when it would be used as I have never used it myself.

(Panda) #5

Ok. And can we tweak the batch size of bulk request. ? Which is 20mb by default (as per documentation) .

(Christian Dahlqvist) #6

The bulk size is typically limited by the pipeline.batch.size parameter as well by the batch size described in the docs. Not sure the latter one can be tuned, but you should not generally use batches larger than 20mb anyway.

(Panda) #7

Thank you for your support . :slight_smile:

(system) #8

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.