A) check that the buzzer you have will vary it’s output level with a varrying input voltage (not all do, and it is unlikely to be linear). the easiest way to do this is using a varriable output powersupply.
b) using the rated voltage and current, work out the power consumption of your buzzer. Chances are, unless it is very small it will not be possible to drive it directly with a potentiometer (as the power drop across the pot will be too much) If this is the case you will need to use an additional transistor to drive the buzzer, with the Potentiometer just supplying the base current to the transistor. A NPN transistor set up in this way is called an “emitter follower”, google it for the simple circuit required.