Logstash plugin authenticate WebHDFS with Knox

Does someone know if logstash plugin support authentication with Knox ?

I'm running logstash-6.3.1 (not ELK distribution) locally on windows trying to push data to hdfs (on remote server) with webhdfs and authenticate with Knox, but logstash fails to start - unable to connect.
Logstash config contains:
Output ( webhdfs(host=>"knoxcluster.com:123/.../webhdfs/v1" ...

At the same time the curl request on windows gitbash to remote server works fine
curl -iku user:password -X GET 'https:knoxcluster.com:123/.../webhdfs/v1/?op=gethomedirectory'

I looked at the source https://github.com/logstash-plugins/logstash-output-hdfs/blob/master/lib/logstash/outputs/webhdfs.rb and it seems that the code is not designed to handle the Knox authentication.

Any help will be appreciated

1 Like

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.