Of course I've been up all night! Not because of caffeine, it was insomnia. I couldn't stop thinking about coffee.
Ha! Nevermind, I found the answer in one of the examples: you don't get the bonus when taking a card of value 5 or 7.
There are several rules in the examples, makes for a tricky rulebook.