Cleats should come with the pedals, go for M520s, pretty bomb proof. You can go tarty later if you like it.
Plastic cage is the pedal version of a placebo IMO.
Shoes. Not you don’t. If you want those just get the flats ones and ride flats. Get MT43s, they will give you better grip for those all important lifesaving dabs of desperation*.
*hardly ever happens, don’t worry about it will be fine.
[‘scuse the tone, sounds like you’re having an impulsive day, thought i’d join in ;) ]