Hi,
I am using the webhdfs plugin of Logstash to send files to HDFS host system which uses the Kerberos authentication. After the config I see errors while the Logstash startup.
Any suggestions about this issue?
Webhdfs conf
webhdfs {
host => "ylpd1665.kmdc.att.com" # (required)
port => 50070 # (optional, default: 50070)
standby_host => "ylpd1667.kmdc.att.com"
standby_port => 50070
user => "user"
path => "tmp/events-%{[@timestamp]}.log"
compression => "none"
codec => "json"
use_kerberos_auth => true
kerberos_keytab => "/home/user/user.keytab"
}
Error
[2019-08-08T07:56:18,590][ERROR][logstash.outputs.webhdfs ] Webhdfs check request failed. (namenode: ylpd1667.kmdc.att.com:50070, Exception: gss_init_sec_context did not return GSS_S_COMPLETE: Unspecified GSS failure. Minor code may provide more information
No Kerberos credentials available (default cache: FILE:/tmp/krb5cc_220590)
)
[2019-08-08T07:56:18,592][WARN ][logstash.outputs.webhdfs ] Could not connect to standby namenode ylpd1667.kmdc.att.com. Error: gss_init_sec_context did not return GSS_S_COMPLETE: Unspecified GSS failure. Minor code may provide more information
No Kerberos credentials available (default cache: FILE:/tmp/krb5cc_220590)
. Trying main webhdfs namenode.
[2019-08-08T07:56:18,613][ERROR][logstash.outputs.webhdfs ] Webhdfs check request failed. (namenode: ylpd1665.kmdc.att.com:50070, Exception: gss_init_sec_context did not return GSS_S_COMPLETE: Unspecified GSS failure. Minor code may provide more information
No Kerberos credentials available (default cache: FILE:/tmp/krb5cc_220590)
)
[2019-08-08T07:56:18,615][ERROR][logstash.outputs.webhdfs ] Could not connect to ylpd1665.kmdc.att.com:50070. Error: gss_init_sec_context did not return GSS_S_COMPLETE: Unspecified GSS failure. Minor code may provide more information
No Kerberos credentials available (default cache: FILE:/tmp/krb5cc_220590)