It's during your turn, not the other player.
So while you are conquering you can replace a lone active race token of an opponent you could attack (usually adjacent) with a new sorcerer from the box. You can only do this to each other player once during your conquering phase. Next turn, you could do it to each of them again.
Aaaahhh...thanks for the answer
Looking forward to play it again tonight