Can't emphasise more the worth of buying a good running tiny powerless but good handling car to learn in. Dont buy something too old, you wan't decent brakes and lifespan and that didn't often come cheaply 15 years ago 🙂
Something like a 1.9TD pug 306 might be a smidge higher on insurance but 40-45 mpg and bike room? £250-750 quid, plenty left for insurance. Insure TPFT, no point in paying a grand a year to protect a car worth less, but be aware that some companies will charge less for fully comp, I've not figured out why yet but maybe because you're obviously more worried about your vehicle if you insure it against your stupidity.
MY first car was a 1.1 litre peugeot 205. Other than creature comforts I'd buy another, uber simple to fix/run, 35-40 mpg, 2 bikes and camping gear in it, handled far better than its price suggests and only cost £500 back then, but first insurance was 900.