I’ve done several over the years, and each one had some problems, but nothing major, and always come out of them financially better off. I had no background in the building trade, I worked in a bank during the first few, which helped with mortgage etc, but doubt it would be of any benefit now. Try plotfinder.com for a local plot, or just keep checking the local agents. Depending on affordability, also consider something with an wreck on, and knock down and start again. Always worth it in the long run, project managing yourself will be trying and frustrating, but give you a much better home in the end, and so long as you don’t get silly with finishes, will make a few £££ along the way.
I’m looking now for the perfect last one to give me the house I want, and be mortgage free.