The larger manufacturers (at least in my limited experience) seem to have size charts that match reasonably well with reality. I’ve had one frame from a smaller wannabe-boutique brand that was all over the place but the likes of Giant/Spesh/Trek seem pretty consistent.
You can adjust the fit of a bike – seatpost height, stem length, bars, even the cranks if you have to. So even if it’s not right immediately, if you’re in the right ball park you can get it where you want it.
One thing to think about is toe overlap. As you make the frame smaller, the front wheel comes closer. Maybe think about a bike with shorter cranks (170 or less) ?