Nah, riding with a loose headset isn’t acceptable, you’re just goosing your bike.
Stem, spacer’s and top cap off, either soft faced mallet or wooden block and hammer, bang down on top of steerer to drop it out (there’s probably a wedge/retainer type ring holding onto the steerer, you might.need a bit of force). Once the fork is out you’ll be able to get at the bearings and figure out what sort they are (caged or cartridge) and just how knackered they are now.
My advice is to replace the bearings irrespective of what you find, clunking about in them will not have improved things…
Alternatively (probably the wiser choice from the sound of things) go to a shop and pay someone who knows what they’re doing…