This was a constant argument in my household with single player games like Zelda. We eventually had to figure out new rules for taking turns.