[...] or even the Gollum card in this situation [...] and in the latter case you will be saved the die roll since you didn't play it as a Triple Wild.
From the expanded rules:
This is a triple Joker symbol card, if the Joker symbols are used for any reason (such as moving on an Activity line or paying for an Event cost) then the die must be rolled by the person who played the card. If the card is discarded (without the Joker symbols being used) then the die is not rolled.
In you're scenario, you're using a joker symbol, so you have to roll the die.