Elasticsearch refuses to run

Just rm -rf the directory you extracted.

Also, ideally, you should setup the repo, not just download the RPM. That way you are setup to allow easy upgrades as well.