I did this once and it failed miserably. One could be taking a dump or shower and the user in the other bathroom would nearly pass out from the smells/moisture.
Those swinging flaps are not air tight to say the least.
The reason I had to do this was because the customer refused to go out the roof twice. It was highly likely though that both bathrooms would be in use due to the amount of people in the home *5*.