You are correct. This was addressed specifically in the FAQ:
(1.05) Removing Progress Tokens from Quests
When a card effect removes progress tokens from a
quest or quest card, the effect applies specifically to the
quest card, and never to the active location.