I did it a few years back. Jumped from IT into working with young people. Enjoyed it (though tiring at times) and eventually became a project manager.
Disadvantage was that the contracts only lasted as long as funding, so there was a big lack of job security. When my last contract was due to finish, the job market was really dry, so I went back into IT, but as a project manager rather than a techie, which I had been before. I enjoy it more than I thought I would do, and the job security is a bonus after a few years of precarious employment. OH and I are trying to save to buy a house, so at this stage of my life, the security is important to me.
I say go for it if it really interests you – you’ll regret it if you don’t. If you have a transferable skill like I did you can always return to something “safer” if you want to later on.