Are you only coordinating and talking when the timer is counting down? If not, that is what you are missing. If yes, then reduce the time on the timer.
The rules seem to suggest but not clearly state this.
In other words we should roll our dice and then IMMEDIATELY start the timer and flip up customers. Then the dice-use decisions are more rushed and tense.