But at the same time i do not flip the goblin to the passive side since i did not land on the portal. Is this correct?
What about when i continue my movement next turn? I still don't need to pay?
Correct. You never pay for Aggressive Goblins on the Map Card on which you begin or end your turn. And your starting or ending Region on the Map Card doesn't affect this.