Okey I solved it, gonna leave this here for others
Did some more digging in github repos. I found this issue :
which lead me to this other one with a workaround :
Because I am just testing this I disabled verification in the action-store.yml file found (in my windows machine) here
C:\Program Files\Elastic\Agent\data\elastic-agent-1da173\:
outputs:
default:
api_key: 1Pje5..................
hosts:
- https://192.168.20.155:9200
type: elasticsearch
ssl.verification_mode: none