IME most car noise is actually tyre noise, of which electric cars make just as much as any other. The only time they are really quiet is at less than say 5mph – however that’s a) not a dangerous speed, people often don’t see you but you are manoeuvring and looking out for peds anyway and a quick beep of the horn sorts it out and b) many petrol cars make hardly any noise at those speeds anyway, and it’s easily drowned out by city noise.
The only times I’ve been surprised by cars at low speeds they were big petrol cars.
As a Prius driver the ONLY time people haven’t noticed me is when I am in a car park or something doing 2-3mph. However that happens in my 2.0 TDI Passat too, unbelievably, just not as often.