I ‘think’ I broke mine, but where most poeple have 4 bones in the wrists I only have 2, so my break could be technically not the same thing.
Anyway, I had a protective cast put on my break (to give the swelling time to go down perhaps) before going back a week or two later for an Xray, which was when I found I’d broken it and it got put in a cast, and eventually healed fine.
You might actually find you can drive okay with the protective loose fitting cast they put on it, if that’s what they do for you rather than giving you an Xray and putting a proper cast on straight away.
In the grand scheme of things a healthy and usable wrist is more important than a holiday.