Right, I follow your logic, but that’s not how it works. Active 3D glasses rapidly occlude each eye in turn (ie, one eye is clear and the other is blacked out) in sync with the TV displaying the relevant image for that eye. Any extra processing for upscaling would be a load on the TV’s CPU, not the glasses.
With the TV running it’s irrelevant where you’re looking, there’s no two-way conversation. All the pairing is doing is the TV going “leftrightleftrightleftright…” to the glasses. You could stop watching and go for a slash and, so long as you were in range at least, the glasses would continue to shutter in and out.
Does that help?