Replacing on-prem fleet server means to uninstall and then to install again, because Fleet Server is also an agent with special config. It shouldn't be necessary to re-enroll the normal agents.
Docs:
1 Like