I don't think your are necessarily being a wuss brant!
Recovery time rather depends on how much separation you get between the ends of the bone, amongst other things.
Did mine last year and was back on the road after 8 weeks, but 12 weeks before I could ride (tentatively) off road.
The break is still very obvious to look at, and pointy / lumpy 9 months later, which means it gets sore easily with ruksac straps etc, but I've no problems with movement or riding now.
p.s. an xray at 8 weeks (when I first started riding the road bike) still showed a massive gap between the two ends of my break (although some low density cartilagy/spongy bone stuff will have been in there apparently)!