(I am not a proper singlespeeder)
For trying it out (if you get properly into it you'll end up with a ss frame etc anyway), you can use just the existing middle ring as you suggest
I'd leave the outer ring on to stop chain jumping off (and maybe keep your front mech fitted but "locked" to stop chain jumping off to the left) and wouldn't bother taking off the inner one ("proper" unramped rings jump much less but you don't have to use them)
You'll prob need a tensioner unless you're really lucky with your frame (might need a half-link from somewhere too)
Existing chain will be fine once shortened
Get a wide-based ss cog or you'll find it will chew its way into your freehub (depends a bit on what freehub of course)