Which file/script of ES Rally is responsible for pulling real time data from elastic.co site?

Elastic Stack Elasticsearch
1

Hi All,

Need one help !!
I am exploring ES Rally scripts to understand data flow from elastic.co->ES Rally-> ES.

Does any body know, Which file/script of ES Rally is responsible for pulling real time data from elastic.co site to feed ES ?

Purpose is to explore, if ES Rally output can work with some other indexing/searching tool also

Any response will be appreciated.

2

Hi Vikash,
In the standard tracks, Rally does not pull real-time data from anywhere. Rally load generators index documents retrieved from a local JSON "corpus", whose location is configured in the track JSON file (usually fetched from S3 bucket).

Details on Rally track corpus configuration can be found here: https://esrally.readthedocs.io/en/stable/adding_tracks.html