Unless you’ve the character who gives you a coin when you have nothing to take. I forget the name.
To answer the OP: I don't believe you're forced to take a card. The rules aren't as explicit on this as they might be; they say you "will be able to take 1-3 cards" and then talk about what the other players do after you take a card or cards.
They don't clearly specify that taking a card is optional. But they do say you must draw one card but can stop any time after that. So obviously, if you stop when there are no cards you can take, you won't take any! So my interpretation is that taking a card is optional.