Maybe the balance will be off by a bit. But really, this is not Descent 2.0... it can't break that much!
You'd be surprised. seemingly small changes can have drastic effects on how things turn out.
I guess it comes down to whether your group's overlord wants to play a competitive game where they have a reasonable chance of winning, or if they don't care and just want to have fun while providing fun to the players too. I'm in the latter category, so I don't mind experimenting a bit.