Sorry to hear your in that situation (all too common unfortunately).
Ive seen this in the past, and in one case the line manager was asked to leave, as it was quickly recognised his effect on morale was negative and the staff turnover increased. But in another case, they did nothing, and in turn this guy worked his way up the ladder.
I don’t think you need “life advice”, you just have a difficult situation that needs some kind of resolution. It would be a shame if you left because of one person, so you could decide to make a complaint to HR, and if they respond negatively (i.e. do nothing), then you may as well leave. If he is cutting your annual leave, then the company could be liable.
You sounds like a great co-worker to have so I’m sure other companies would snap you up – and you may well be a lot more valued in your current company than you realise, so they may respond positively to a complaint.