Psychic heating. But sometimes you haven’t a choice. An oil fit can be very very expensive, I’d only consider it as something for a keeper of a house, or as a calculated attempt to add value for sale (but you probably won’t, I don’t think anyone has ever asked about the storage heating despite selling two houses with it in).
I replaced a couple with my Dad (who is a sparky) and the newer ones were more effective and marginally cheaper to run. Biggest benefit was they didn’t look like some one was using them for kicking practice as the previous owners clearly had.
Sharkbait has it right though – get all the energy efficiency stuff done with insulation you can, and they can work well enough.
The second place we had also had an open fire in the sitting room, and to be honest this warmed the house through better, though I’ve no idea of the comaprative cost – we just kept the storage heaters on tick over aiming for around 15C.