Sure. I usually play it with 3 or 4. I find it easier to withhold a card from the other players because you have more cards in your hand that can be used as decoys so they never see all your cards. And not until very late in the game do you have to start passing around all the cards from your hand
I second this.