Rally version (get with esrally --version
):
esrally 1.0.0
Invoked command:
esrally race --pipeline=benchmark-only --target-hosts="/root/.rally/benchmarks/tracks/billions-rally-tracks/jssz_benchmark_scene_1/target_host.json" --offline --track=jssz_benchmark_scene_1 --track-repository=billions-rally-tracks --track-params="/root/.rally/benchmarks/tracks/billions-rally-tracks/jssz_benchmark_scene_1/params/params.json"
Configuration file (located in ~/track.json
)):
{% set index_count = 3 %}
{% import "rally.helpers" as rally with context %}
{
"version": 2,
"description": "max throughput with {{index_count}} index",
"indices": [
{% set comma = joiner() %}
{% for item in range(index_count) %}
{{ comma() }}
{
"name": "billions-jssz.benchmark.scene1-{{item}}",
"body": "settings/mapping.json",
"types": [
{
"name": "logs",
"documents": "{{index_source_file | default('documents.json')}}",
"document-count": {{ index_document_count | default(1) }},
"uncompressed-bytes": {{ index_uncompressed_bytes | default(1) }}
}
]
}
{% endfor %}
],
"challenges": [
{{ rally.collect(parts="challenges/just_bulk.json") }}
]
}
Configuration file (located in ~/challenges/just_bulk.json
)):
{
"name": "just_bulk",
"description": "just bulk",
"default": true,
"schedule": [
{
"operation": {
"operation-type": "delete-index"
}
},
{
"operation": {
"operation-type": "create-index"
}
},
{
"warmup-time-period": 0,
"operation": {
"operation-type": "bulk",
"bulk-size": {{ bulk_size | default(20000) }}
},
"clients": {{ clients | default(97) }}
}
]
}
Configuration file (located in ~/params/params.json
)):
{
"number_of_shards": 1,
"number_of_replicas": 0,
"refresh_interval": "30s",
"sync_interval": "60s",
"durability": "async",
"source_enabled": true,
"index_source_file": "documents.json",
"index_document_count": 4500000,
"index_uncompressed_bytes": 13051575427,
"bulk_size": 20000,
"clients": 97
}
And i also try:
{
xxx
"bulk_size": 20000,
"clients": 10
}
After run the race, the summary report
is:
************************************************************************
****** Use this pipeline only if you are aware of the tradeoffs. ******
*************************** Watch your step! ***************************
************************************************************************
[INFO] Racing on track [jssz_benchmark_scene_1], challenge [just_bulk] and car ['external'] with version [5.4.3].
[WARNING] merges_total_time is 1520597 ms indicating that the cluster is not in a defined clean state. Recorded index time metrics may be misleading.
[WARNING] indexing_total_time is 58637 ms indicating that the cluster is not in a defined clean state. Recorded index time metrics may be misleading.
[WARNING] refresh_total_time is 160000 ms indicating that the cluster is not in a defined clean state. Recorded index time metrics may be misleading.
[WARNING] flush_total_time is 41 ms indicating that the cluster is not in a defined clean state. Recorded index time metrics may be misleading.
Running delete-index [100% done]
Running create-index [100% done]
Running bulk [100% done]
------------------------------------------------------
_______ __ _____
/ ____(_)___ ____ _/ / / ___/_________ ________
/ /_ / / __ \/ __ `/ / \__ \/ ___/ __ \/ ___/ _ \
/ __/ / / / / / /_/ / / ___/ / /__/ /_/ / / / __/
/_/ /_/_/ /_/\__,_/_/ /____/\___/\____/_/ \___/
------------------------------------------------------
| Lap | Metric | Task | Value | Unit |
|------:|-------------------------------:|-------:|------------:|-------:|
| All | Total indexing time | | 0.9775 | min |
| All | Min indexing time per shard | | 0 | min |
| All | Median indexing time per shard | | 0.000783333 | min |
| All | Max indexing time per shard | | 0.6527 | min |
| All | Total merge time | | 25.3433 | min |
| All | Min merge time per shard | | 0 | min |
| All | Median merge time per shard | | 0 | min |
| All | Max merge time per shard | | 19.7772 | min |
| All | Total refresh time | | 2.6671 | min |
| All | Min refresh time per shard | | 0 | min |
| All | Median refresh time per shard | | 0.00095 | min |
| All | Max refresh time per shard | | 1.73317 | min |
| All | Total flush time | | 0.000683333 | min |
| All | Min flush time per shard | | 0 | min |
| All | Median flush time per shard | | 0 | min |
| All | Max flush time per shard | | 0.0005 | min |
| All | Total Young Gen GC | | 0 | s |
| All | Total Old Gen GC | | 0 | s |
| All | Store size | | 0.042077 | GB |
| All | Translog size | | 0.0629594 | GB |
| All | Heap used for segments | | 0.213631 | MB |
| All | Heap used for doc values | | 0.0656433 | MB |
| All | Heap used for terms | | 0.115535 | MB |
| All | Heap used for norms | | 0.00115967 | MB |
| All | Heap used for points | | 0.0222368 | MB |
| All | Heap used for stored fields | | 0.00905609 | MB |
| All | Segment count | | 16 | |
| All | error rate | bulk | 0 | % |
[WARNING] No throughput metrics available for [bulk]. Likely cause: The benchmark ended already during warmup.
After running, the summary report has no throughput, and there is no data inserted into ES.
Is there anything wrong with my configuration?