Not being funny but it doesn't happen any more on either of mine than it did with 3 rings so I doubt it's adjusted right. Unless you have a lot of chain growth in your suspension design or something but the hemlock has a fair bit and it doesn't seem to mind. Did you shorten the chain to suit the double? Good tension will help keep it on.
What side is it going off? A bashring will completely stop it going off the top, or a I guess a chain device of some sort but I've never had any need. If it's going off the bottom, remember there's nothing different between a double and triple there.