While I agree to an extent, “20 quid for the lot” might be pushing it a bit. 🙂
Albums are the way to go.
My picks for starters are
Essential Johnny Cash (the Sony one)
American Recordings (the first in the series)
Highwayman. Might be a group, but it’s still essential, I reckon.