Found the Issue, the issue is with version of the Transport Client library, i was using 5.0.0 Transport java driver for 5.4.0 ES , however when i changed it to 5.3.2 as mentioned here Option "client.transport.sniff" not working with v5.4.0 Transport Client
Everything works fine , don't see the issue anymore.
Thanks
Sam