I think if you like it on holiday, you will like it here. I had a Whistler holiday and decided to come out here to live. I had the advantage of no ties there and affordable rent here. Those days are gone. Rent is sky high now, local craigslist is a good source of info.
There are some very nice places east of Vancouver proper that have top notch mountains too. and like another poster said, having the option to go riding whenever you want is worth the hassle of moving, that is how i rationalized my move here.
luckily a local bakery make mince pies that are amazing too. there are a lot of nice things about living here, fly tipping is virtually non existent, most people pick up dog shit and litter and hardly anyone smokes.
With hindsight, if i had been to lots of uk mountain towns , i may well have ended up living there still. it rains a lot here but summer is usually warm and dry.