What are the strengths of 'Rally' compared to 'JMeter' or 'nGrinder'?

Elastic Stack Elasticsearch
1

What are the strengths of 'Rally' compared to 'JMeter' or 'nGrinder'?

I have used 'Rally' before, but have not used 'Apache JMeter' or 'nGrinder'.

Are there any relative advantages and disadvantages

HAVE A GOOD DAY :slight_smile:

2

Hello,

Thank you for your interest in Rally. I've never really used JMeter or nGrinder, but the benefits of Rally is that it's really tailored towards Elasticsearch.

Put it simply, it applies the advice from Seven Tips for Better Elasticsearch Benchmarks | Elastic Blog. Here's a non exhaustive list of benefits that Rally provides:

  • System setup: Rally knows how to install and start Elasticsearch itself (being for a revision or for a released version) with easy ways to configure settings such as the heap.
  • Warm up: You can tell Rally to ignore initial iterations to avoid skewing results.
  • Workload: Rally offers many tracks modeling various use cases with useful initial settings. It uses an official Elasticsearch client, which is more realistic than just sending raw HTTP requests. It allows using advanced features from the API easily. You can also create your own tracks, modeling your data and workload more accurately. You can tune the number of clients or the size of bulk index calls easily. It measures latency/service time/throughput very carefully.
  • Bugs: We use Rally extensively at Elastic and with the interface Rally provides it's more difficult to run into bugs, while making mistakes using a generic tool is easier
  • Accidental bottlenecks: Despite being written in Python, Rally is carefully optimized where it matters. For example, in various places we do not parse the JSON output of Elasticsearch.
  • Use a Structured process: Using the Rally commands to install/run Elasticsearch and having your workload stored in version control makes it much easier to have a repeatable process.
  • Statistics: Rally provides many metrics related to your benchmarks. Some of them are reported at the end of each run. You can also get additional insights using telemetry devices.
2 Likes
3

i just checked your reply, Thank you for letting me know that :slight_smile: