You'll probably need to due some tuning if you are on the defaults. In particular switch away from using pcap to af_packet. See https://www.elastic.co/guide/en/beats/packetbeat/6.2/configuration-interfaces.html
There was some good discussion in this ticket and the linked and the ticket it links to: Performance of Packetbeat?