I would say yes. At the point you add a fifth juggler, by the rules of the game you no longer have a tower - so removing the tile gives you a new tower.
I haven't had that exact scenario, but (in a similar vein) a good tactic seems to be to use the pyro to destroy a tile in the tower (down to 3 tiles) and then move another tile back on top (hence creating a 'new' tower).
Happy to someone to disagree but certainly makes sense to me.
I did something similar. I had a tower of chameleons, then played a seer and noticed I had two jugglers. I "broke" my tower by juggling one of the chameleons away, then played the second juggler to move it right back. I figured this earned me the benefit of another tower. Hope that was right.