Can be brutally addictive if you get the bug properly. I know people who've given up work / partners etc to move to the coast to surf regularly.
I took it up in my late 20s and am now lucky enough to live in the SW with any number of breaks within an hour or so drive. I get in pretty regularly but nowhere near as often as I'd like to due to work and family commitments.
I don't think the skiing analogy mentioned above really works for surfing - to get to a good standard you need to put in a hell of a lot of water time, be prepared to travel - a week or two a year really won't cut it, and you have to be prepared on occasion to have a lot of really frustrating sessions due to the vagaries of weather, tides and your own ability (or lack of it).
I'd still class myself as an enthusiastic intermediate even after all these years and still spend some sessions foundering in the soup but still love it.
The good sessions you'll have will really stay with you forever. My best memories include surfing with seals on a solo winter session off Sennen Cove, riding Famara in Lanzarote in beautifully shaped overhead clean waves in January in a shortie, catching an absolute freight train of a wave and riding it for what seemed like ages during a dawn session at Rhosilli after a big storm...biting off more than I could chew off Lacanau... the surreal experience of riding my longboard for a full mile upriver just outside Gloucester on the Severn Bore. All priceless memories which made all the freezing changes in windblown carparks, washing machine hold-downs, ice-cream headaches and crap days in sub 1ft slop worthwhile.
Enjoy, but as the saying goes, be careful...it could change everything