My recent experience of the excellent medical profession is that the advice they give is good and based on solid medical science, but, having said that they simply can feel what you feel! My tip is to get off any pain killers as soon as you can bear it, and then start very very carefully using your limbs and muscles. The sooner you use it, the quicker you get it back in my experience. If you sit around, without any activity and a low metabolic rate, no wonder it takes your body ages to heal!
I can sympathise, I broke my collar bone 7 weeks ago & my x-ray showed it hasn’t healed as it was an awkward place it broke in. Definitely get some sunshine, vitamin D helps absorb calcium so should speed up your recovery 🙂