There is no documentation for "Hadoop as repository"

Elastic Stack Elasticsearch
1

Hi Team,

I am searching for documentation for "'Hadoop' as repository for Elasticsearch".
I am searching in preface page, i.e.,

http://www.elasticsearch.org/guide/en/elasticsearch/hadoop/current/configuration.html#_mapping

here i got the link for " repository-hdfs"

but this showing message like documentation was removed.

where can i get the documentation for making "Hadoop as Repository" for my Elasticsearch cluster.

cheers!
sahitya

2

If you follow the github link that will take you to the actual docs, namely here:
https://www.elastic.co/guide/en/elasticsearch/plugins/master/repository-hdfs.html

3

Thanks for the reply,

When I am getting repository-hdfs file , there getting FileNotFound error. which means, in that specific location that package is not available.

Please find the below output for the commad,

bin/plugin install repository-hdfs --verbose
-> Installing repository-hdfs...
Trying https://download.elastic.co/elasticsearch/release/org/elasticsearch/plugin/repository-hdfs/2.2.1/repository-hdfs-2.2.1.zip ...

ERROR: failed to download out of all possible locations..., use --verbose to get detailed information

Please suggest me that How can I achieve this problem.

cheers!
sah

4

Hello Sathitya,

If you got some trouble about finding the right version on an avalaible website, you should visit : lasticsearch/elasticsearch-repository-hdfs/ and pick the right elastic-repository-hdfs plugin version.

You should download the hadoop2.zip if you don't have Hadoop 2.X install on your machine.

You download the file zip then you can use the follow command :
/path/elasticsearch/bin/plugin install file:///path_where_you_put_the_zip_file.

I hope it will help you.
Tom.

5

Hi,
Thanks for the information.
I need some information on configure hdfs repository with kerebos which i am not able to do.
i read from the posts that its still in progress as :
Kerberos authentication for the HDFS Repository Snapshot plugin does not function correctly in 5.x at the moment. There is currently an effort to re-add this functionality so that it may function well with the internal security manager.
Can you please help me when can i get this functionality added or any other method for using this plugin.

Divya