What has expense got to do with anything?
Well, it tends to feed into cost-effectiveness. If you aren’t racing, why would you chase negligible performance benefits at escalating cost? Most recreational riders have a budget.
Let us assume that you are correct that disc brakes could be brought in on the same weight, but let us also assume (as you do) that they would be more expensive.
Therefore, as a recreational rider, for a given budget, I can have a bike with adequate brakes and a very very light frame, or a bike with brakes that are more powerful than is strictly required at the cost of a heavier frame. And, to cap it all, my bike won’t be race legal. I know which I am going to go for. Your answer may be different.
I don’t care, when road racers have tiny little disc brakes I shall have one with tiny little disc brakes, just as I have a mountain bike with disc brakes these days. But I can understand why it isn’t a priority for designers and manufacturers, or, indeed, almost anyone except you.
🙂