I just wouldn't go. Don't make a big fuss. Simply don't turn up. You probably won't be missed.
I've been at this place almost 13 years now. I've not been to a single social event in the past 10. Hate them with a passion. The company pays me to do my job. If they want to pay me to piss about, I'll go and piss about doing something useful. Personally I'd rather sit at my desk and work than have to interact with a bunch of people I don't especially like, eating crap half cooked food. At least that way, I might be able to leave at a normal time.
Fortunately one of our directors is equally antisocial, so by now, its reasonably well accepted that we don't get involved. I do my job well, and put in more than my fair share of hours, so there's no ground for complaints.
…and "team building". If you have to indulge in bullshit activities to get people to work together, then you're employing the wrong people. Simple professionalism should suffice. If you pay your employees to work together and they can't or won't, then getting them to play a game of tug of war isn't going to solve that.
<<grump>>