OK found the issue, I used to use marvel.enabled on my cluster nodes with previous elasticsearch version, which would disable marvel reporting/creating data in the instance itself.
Setting this disabled marvel from reporting data and so was not working. .. Phew.. talk about self inflicted wounds.