Bear in mind a bike designed for derailleur use may have fairly flexy chainstays. Enough flex under pressure and the chain comes off, and your voice rises a couple of octaves.
It’s not a fault, the derailleurs keep the chain in place, and flexy chainstays give a more comfortable ride.
These days there are plenty low cost single speed frames around, and by the time you do a proper conversion you will have spent almost enough to buy one.
The best tensioners are the eccentric type that fit the BB but these are expensive. If you have flexy chainstays the pushup tensioners may be a better option (eg the DMR STS), and used with a guide at the front will protect you against chain drop.