Heya! Welcome to the community :). Does this post by another user trying to do the same thing help? It has a filebeat sample config.
There is also the Azure support in filebeat, but it's in beta and it also seems to require pushing your logs into Azure's event hubs first. I'm not sure that's very relevant to App Service but mentioning just in case it helps you.