Its a natural reaction.
I had similar a few weeks ago, kids being noisy outside my house so the mrs asked them to move away as our kids are trying to sleep as soon as she came in I heard them shouting abuse at her so I went out there and told them to **** off, they starting coming up to me saying “what you gonna do” and all that usual crap.
I just told them Im a grown man Im not going to hit a little kid (they were about 15) they kept trying to antagonise me and told me to go inside if I wasnt going to fight them, I (probably stupidly) wouldnt back down and just held my ground and forced them to leave.
I was so wound up I was shaking for hours