I am trying to set up a log forwarder from SLURM to elasticsearch using this guide https://slurm.schedmd.com/elasticsearch.html I have already run into a few snags.
My Elasticsearch is encrypted using the xpack certificate and I found that the SLURM forwarder I am using cannot allow for an https connection. So I found this workaround: https://bugs.schedmd.com/show_bug.cgi?id=4083 that uses an anonymous user on elasticsearch to receive and index the data. https://www.elastic.co/guide/en/elasticsearch/reference/7.6/anonymous-access.html
However, my SLURM forwarder is giving me the following error:
[2020-07-01T10:17:32.622] jobcomp/elasticsearch: Could not connect to: http://126.96.36.199:9200/slurm/jobcomp , reason: Server returned nothing (no headers, no data)
I have attempted to trace the network connection through the elastic stack, but have only been able to confirm that the API port is receiving traffic from the SLURM forwarder, but I don't know what it is doing with it.
Any advice would be appreciated.