I managed to do that with one of my PCs. Fortunately a new power supply was all I needed.
It’s hard to know quite what has happened, but it might be worth checking that the new power supply in turned on (some have on/off switches) and that the supply is properly connected to the motherboard (when you press the power button on the PC case it’s picked up by the motherboard which then signals the power supply to power up). There should be a small bank of pins on the motherboard which various bits of kit (such as the power supply, harddrive light and power button) connect to.
It the motherboard is dead you’ll need to fit the harddrive into another machine to see what’s one it, it may well be ok.