# Not able to download track **URL:** \ **Category:** Elasticsearch\ **Tags:** rally\ **Created:** [May 26, 2022, 12:39pm UTC](https://discuss.elastic.co/t/not-able-to-download-track/305712 "2022-05-26T12:39:50Z")\ **Posts on this page:** 12\ **Page:** 1
**Author:** ![amitsa](https://avatars.discourse-cdn.com/v4/letter/a/dbc845/32.png) [@amitsa](https://discuss.elastic.co/u/amitsa)\ **Post date:** [May 26, 2022, 12:39pm UTC](https://discuss.elastic.co/t/not-able-to-download-track/305712/1 "2022-05-26T12:39:50Z")
Hi i am using below script to download track [https://raw.githubusercontent.com/elastic/rally-tracks/master/download.sh](https://raw.githubusercontent.com/elastic/rally-tracks/master/download.sh) i am able to download tracks on ubuntu 20.04 ```auto Cloning into '/home/user/.rally/benchmarks/tracks/default'... remote: Enumerating objects: 6780, done. remote: Counting objects: 100% (1341/1341), done. remote: Compressing objects: 100% (154/154), done. remote: Total 6780 (delta 1275), reused 1191 (delta 1182), pack-reused 5439 Receiving objects: 100% (6780/6780), 1.71 MiB | 1.72 MiB/s, done. Resolving deltas: 100% (4602/4602), done. % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 100 252M 100 252M 0 0 10.4M 0 0:00:24 0:00:24 --:--:-- 22.0M % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 100 20985 100 20985 0 0 14452 0 0:00:01 0:00:01 --:--:-- 14452 Created data for geonames in rally-track-data-geonames.tar. Next steps: 1. Copy it to the user home directory on the target machine(s). 2. Extract with tar -xf rally-track-data-geonames.tar (will be extracted to ~/.rally/benchmarks). ``` but when i try to download on CentOS Stream release 8 i am not getting any error but no data is downloaded ```auto /home/user/.rally/benchmarks/tracks/default cloning repo Cloning into '/home/sfdev/.rally/benchmarks/tracks/default'... remote: Enumerating objects: 6780, done. remote: Counting objects: 100% (1341/1341), done. remote: Compressing objects: 100% (154/154), done. remote: Total 6780 (delta 1275), reused 1191 (delta 1182), pack-reused 5439 Receiving objects: 100% (6780/6780), 1.71 MiB | 3.74 MiB/s, done. Resolving deltas: 100% (4602/4602), done. Created data for geonames in rally-track-data-geonames.tar. Next steps: 1. Copy it to the user home directory on the target machine(s). 2. Extract with tar -xf rally-track-data-geonames.tar (will be extracted to ~/.rally/benchmarks). ``` ---
**Author:** ![json](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/json/32/4125_2.png) [@json](https://discuss.elastic.co/u/json)\ **Post date:** [May 26, 2022, 2:13pm UTC](https://discuss.elastic.co/t/not-able-to-download-track/305712/2 "2022-05-26T14:13:47Z")
Hi Amit, Yours is the output we would expect if track data was already resident in the target. Can you check if it is there? ```nohighlight $ ls -l ~/.rally/benchmarks/data/geonames total 259024 -rwxrwxrwx 1 1024 100 20985 May 26 10:04 documents-2-1k.json.bz2 -rwxrwxrwx 1 1024 100 265208777 May 26 10:04 documents-2.json.bz2 ``` If track data is not present in the target, then we'll need to find out why. Could you send the complete output of `download.sh` executed with `bash -x` , including the command? ```nohighlight $ bash -x download.sh geonames ``` Thank you, Jason ---
**Author:** ![amitsa](https://avatars.discourse-cdn.com/v4/letter/a/dbc845/32.png) [@amitsa](https://discuss.elastic.co/u/amitsa)\ **Post date:** [May 27, 2022, 5:08am UTC](https://discuss.elastic.co/t/not-able-to-download-track/305712/3 "2022-05-27T05:08:43Z")
> [@json](#): > > `bash -x download.sh geonames` Hi the result with bash -x ```auto + set -e + set -u + set -o pipefail + readonly ROOT=.rally/benchmarks + ROOT=.rally/benchmarks + readonly URL=http://benchmarks.elasticsearch.org.s3.amazonaws.com/corpora + URL=http://benchmarks.elasticsearch.org.s3.amazonaws.com/corpora + SOURCE=download.sh + '[' -h download.sh ']' +++ dirname download.sh ++ cd -P . ++ pwd + readonly CURR_DIR=/home/sfdev/akumars4/applications.benchmarking.benchmark.platform-hero-features/workload/ESRally + CURR_DIR=/home/sfdev/akumars4/applications.benchmarking.benchmark.platform-hero-features/workload/ESRally + '[' 1 '!=' 1 ']' + readonly TRACK=geonames + TRACK=geonames + TARGETS=() + readonly REPO_TARGET=.rally/benchmarks/tracks/default + REPO_TARGET=.rally/benchmarks/tracks/default + TARGETS[${#TARGETS[*]}]=.rally/benchmarks/tracks/default + '[' '!' -d /home/sfdev/.rally/benchmarks/tracks/default ']' + git clone https://github.com/elastic/rally-tracks.git /home/sfdev/.rally/benchmarks/tracks/default Cloning into '/home/sfdev/.rally/benchmarks/tracks/default'... remote: Enumerating objects: 6780, done. remote: Counting objects: 100% (1341/1341), done. remote: Compressing objects: 100% (154/154), done. remote: Total 6780 (delta 1275), reused 1191 (delta 1182), pack-reused 5439 Receiving objects: 100% (6780/6780), 1.71 MiB | 4.19 MiB/s, done. Resolving deltas: 100% (4602/4602), done. + '[' '!' -d /home/sfdev/.rally/benchmarks/tracks/default/geonames ']' ++ cat /home/sfdev/.rally/benchmarks/tracks/default/geonames/files.txt + readonly 'FILES=documents-2.json.bz2 documents-2-1k.json.bz2' + FILES='documents-2.json.bz2 documents-2-1k.json.bz2' + for f in ${FILES} + TARGET_ROOT=.rally/benchmarks/data/geonames + TARGET_PATH=.rally/benchmarks/data/geonames/documents-2.json.bz2 + mkdir -p /home/sfdev/.rally/benchmarks/data/geonames + TARGETS[${#TARGETS[*]}]=.rally/benchmarks/data/geonames/documents-2.json.bz2 + '[' '!' -f /home/sfdev/.rally/benchmarks/data/geonames/documents-2.json.bz2 ']' + curl -o /home/sfdev/.rally/benchmarks/data/geonames/documents-2.json.bz2 http://benchmarks.elasticsearch.org.s3.amazonaws.com/corpora/geonames/documents-2.json.bz2 % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 + for f in ${FILES} + TARGET_ROOT=.rally/benchmarks/data/geonames + TARGET_PATH=.rally/benchmarks/data/geonames/documents-2-1k.json.bz2 + mkdir -p /home/sfdev/.rally/benchmarks/data/geonames + TARGETS[${#TARGETS[*]}]=.rally/benchmarks/data/geonames/documents-2-1k.json.bz2 + '[' '!' -f /home/sfdev/.rally/benchmarks/data/geonames/documents-2-1k.json.bz2 ']' + curl -o /home/sfdev/.rally/benchmarks/data/geonames/documents-2-1k.json.bz2 http://benchmarks.elasticsearch.org.s3.amazonaws.com/corpora/geonames/documents-2-1k.json.bz2 % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 + readonly ARCHIVE=rally-track-data-geonames.tar + ARCHIVE=rally-track-data-geonames.tar + tar -C /home/sfdev --exclude=rally-track-data-geonames.tar -cf rally-track-data-geonames.tar .rally/benchmarks/tracks/default .rally/benchmarks/data/geonames/documents-2.json.bz2 .rally/benchmarks/data/geonames/documents-2-1k.json.bz2 + echo 'Created data for geonames in rally-track-data-geonames.tar. Next steps:' Created data for geonames in rally-track-data-geonames.tar. Next steps: + echo '' + echo '1. Copy it to the user home directory on the target machine(s).' 1. Copy it to the user home directory on the target machine(s). + echo '2. Extract with tar -xf rally-track-data-geonames.tar (will be extracted to ~/.rally/benchmarks).' 2. Extract with tar -xf rally-track-data-geonames.tar (will be extracted to ~/.rally/benchmarks). ``` the path have the documents with 0 size ```auto $ ls -l ~/.rally/benchmarks/data/geonames total 0 -rw-rw-r-- 1 sfdev sfdev 0 May 26 21:06 documents-2-1k.json.bz2 -rw-rw-r-- 1 sfdev sfdev 0 May 26 21:06 documents-2.json.bz2 ``` ---
**Author:** ![amitsa](https://avatars.discourse-cdn.com/v4/letter/a/dbc845/32.png) [@amitsa](https://discuss.elastic.co/u/amitsa)\ **Post date:** [May 27, 2022, 8:53am UTC](https://discuss.elastic.co/t/not-able-to-download-track/305712/4 "2022-05-27T08:53:43Z")
Hi i figured out the issue. It was with the settings on my vm. Thankyou for the response. ---
**Author:** ![json](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/json/32/4125_2.png) [@json](https://discuss.elastic.co/u/json)\ **Post date:** [May 27, 2022, 3:41pm UTC](https://discuss.elastic.co/t/not-able-to-download-track/305712/5 "2022-05-27T15:41:03Z")
Hi Amit, you're welcome! ---
**Author:** ![amitsa](https://avatars.discourse-cdn.com/v4/letter/a/dbc845/32.png) [@amitsa](https://discuss.elastic.co/u/amitsa)\ **Post date:** [June 23, 2022, 10:37am UTC](https://discuss.elastic.co/t/not-able-to-download-track/305712/6 "2022-06-23T10:37:31Z")
Hi @json , I still se this issue some times on machines. i saw a stack overflow post which solves the problem. > The -L options solves the problem as mentioned in below blog. i think this need to be added in the download script. ---
**Author:** ![Quentin\_Pradet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/quentin_pradet/32/94192_2.png) [@Quentin\_Pradet](https://discuss.elastic.co/u/Quentin_Pradet)\ **Post date:** [June 23, 2022, 10:46am UTC](https://discuss.elastic.co/t/not-able-to-download-track/305712/7 "2022-06-23T10:46:59Z")
Can you please share what URL requires a redirect? ---
**Author:** ![amitsa](https://avatars.discourse-cdn.com/v4/letter/a/dbc845/32.png) [@amitsa](https://discuss.elastic.co/u/amitsa)\ **Post date:** [June 23, 2022, 11:32am UTC](https://discuss.elastic.co/t/not-able-to-download-track/305712/8 "2022-06-23T11:32:07Z")
# Per the script curl -o /home/user/.rally/benchmarks/data/geopoint/documents.json.bz2 [http://benchmarks.elasticsearch.org.s3.amazonaws.com/corpora/geopoint/documents.json.bz2](http://benchmarks.elasticsearch.org.s3.amazonaws.com/corpora/geopoint/documents.json.bz2) # Below worked curl -L -o /home/user/.rally/benchmarks/data/geopoint/documents.json.bz2 [http://benchmarks.elasticsearch.org.s3.amazonaws.com/corpora/geopoint/documents.json.bz2](http://benchmarks.elasticsearch.org.s3.amazonaws.com/corpora/geopoint/documents.json.bz2) as i have shared it above as well ```auto + curl -o /home/sfdev/.rally/benchmarks/data/geonames/documents-2-1k.json.bz2 http://benchmarks.elasticsearch.org.s3.amazonaws.com/corpora/geonames/documents-2-1k.json.bz2 % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 ``` ---
**Author:** ![Quentin\_Pradet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/quentin_pradet/32/94192_2.png) [@Quentin\_Pradet](https://discuss.elastic.co/u/Quentin_Pradet)\ **Post date:** [June 23, 2022, 11:36am UTC](https://discuss.elastic.co/t/not-able-to-download-track/305712/9 "2022-06-23T11:36:55Z")
Can you please share the output of `curl -I http://benchmarks.elasticsearch.org.s3.amazonaws.com/corpora/geopoint/documents.json.bz2`? I don't see a redirect here, so I don't understand why `-L` would help. ---
**Author:** ![Quentin\_Pradet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/quentin_pradet/32/94192_2.png) [@Quentin\_Pradet](https://discuss.elastic.co/u/Quentin_Pradet)\ **Post date:** [June 23, 2022, 12:44pm UTC](https://discuss.elastic.co/t/not-able-to-download-track/305712/10 "2022-06-23T12:44:43Z")
Anyway, @dliappis added `-L` in [https://github.com/elastic/rally-tracks/pull/274](https://github.com/elastic/rally-tracks/pull/274) and used a more suitable URL. Indeed, the one in the previous version of the download.sh script should not be used anymore. Please use this new version and tell us if anything goes wrong. ---
**Author:** ![amitsa](https://avatars.discourse-cdn.com/v4/letter/a/dbc845/32.png) [@amitsa](https://discuss.elastic.co/u/amitsa)\ **Post date:** [June 23, 2022, 1:15pm UTC](https://discuss.elastic.co/t/not-able-to-download-track/305712/11 "2022-06-23T13:15:59Z")
Thankyou @Quentin_Pradet and @dliappis for quick response. why don't we use wget instead. it also seems working fine. without any issue. ---
**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\ **Post date:** [July 21, 2022, 1:16pm UTC](https://discuss.elastic.co/t/not-able-to-download-track/305712/12 "2022-07-21T13:16:27Z")
This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.