St. Louis Park
The rules seemed a bit vague on the subject of cards that are not dealt to players in the initial setup. When we played, we left them out of the game. I checked this with John Bohrer and he told me every card is used. I suppose it makes sense, particularly with lower player counts, but it wasn't obvious from the rules and when playing with five players, so I thought I'd mention it here as well.
Quoting mr. Bohrer: "No cards are unused (or left over), no matter how many players are in the game."
Hmm, we played it like you.