Elasticsearch 5.1.1 与 repository hdfs 集成启动出错


(张宇鹏) #1

已经下载好了 repository hdfs ,但配置 elasticsearch.yml 出错,不能识别 hdfs 属性。

[2016-12-21T04:49:58,120][WARN ][o.e.b.ElasticsearchUncaughtExceptionHandler] [node-1] uncaught exception in thread [main]
org.elasticsearch.bootstrap.StartupException: java.lang.IllegalArgumentException: unknown setting [repositories.hdfs.path] please check that any required plugins are inst alled, or check the breaking changes documentation for removed settings
at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:125) ~[elasticsearch-5.1.1.jar:5.1.1]
at org.elasticsearch.bootstrap.Elasticsearch.execute(Elasticsearch.java:112) ~[elasticsearch-5.1.1.jar:5.1.1]
at org.elasticsearch.cli.SettingCommand.execute(SettingCommand.java:54) ~[elasticsearch-5.1.1.jar:5.1.1]
at org.elasticsearch.cli.Command.mainWithoutErrorHandling(Command.java:96) ~[elasticsearch-5.1.1.jar:5.1.1]
at org.elasticsearch.cli.Command.main(Command.java:62) ~[elasticsearch-5.1.1.jar:5.1.1]
at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:89) ~[elasticsearch-5.1.1.jar:5.1.1]
at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:82) ~[elasticsearch-5.1.1.jar:5.1.1]
Caused by: java.lang.IllegalArgumentException: unknown setting [repositories.hdfs.path] please check that any required plugins are installed, or check the breaking change s documentation for removed settings

下面是我的 elasticsearch.yml 配置内容
repositories:
hdfs:
uri: "hdfs://es-master:9000/" # optional - Hadoop file-system URI
path: "some/path" # required - path with the file-system where data is stored/loaded

load_defaults: "true" # optional - whether to load the default Hadoop configuration (default) or not

conf_location: "/home/yuppy/hadoop-2.6.5/etc/hadoop/core-site.xml,/home/yuppy/hadoop-2.6.5/etc/hadoop/hdfs-site.xml" # optional - Hadoop configuration XML to be loaded (use commas for multi values)

conf. : "" # optional - 'inlined' key=value added to the Hadoop configuration

concurrent_streams: 5 # optional - the number of concurrent streams (defaults to 5)

compress: "false" # optional - whether to compress the metadata or not (default)

chunk_size: "10mb" # optional - chunk size (disabled by default)


(Medcl) #2

不知道有没有注意 yml 文件的格式,另外还能通过 restful 的方式来进行配置:
PUT _snapshot/my_hdfs_repository
{
"type": "hdfs",
"settings": {
"uri": "hdfs://namenode:8020/",
"path": "elasticsearch/respositories/my_hdfs_repository",
"conf.dfs.client.read.shortcircuit": "true"
}
}


(system) #3

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.