Is it possible to disable or remove log4j-core-2.17.1.jar from Logstash?

What concerns? I don't think there is any active security issues regarding log4j, the RCE issues that affected log4j a couple of months ago where fixed in 2.17.1 as explained here.

You can't disable log4j totally in Logstash as it is needed.