Adora left because she went back into the whispering woods because of the sword where she saw what the Horde was doing. I think for Glimmer, she would have left once she got into battle.

She would of left earlier bc shes very stubborn and proud. She would've snuck into battle and then realized what was happening. Also, she's a princess so as soon as she realized princesses weren't evil, bye-bye