You just have to watch that there is enough clearance between the 36t and your chain stay to avoid bad chain suckage. Put a 36t on in place of the 32t with a light, thin bash in place of the 44 then you can re-use your existing crank bolts. Adjust the outer stop on the front dérailleur so you don't overshoot the 36. Shorten the chain, you don't need it so long now.
Why do riders fear using their 22t ring? When I approach a steep or long climb, I go straight to 22t and spin-up. The chainline is better for the lower gears and pedalling is smooth. And if you try to down shift to the 22t mid-climb, bad things can happen. Why do riders like pushing the 32t/36t?