From the learn to play rules page 9:
Forge Tokens: Some units require the player to
spend a forge token to purchase them. This is
displayed on the faction sheet below the unit’s
Alternatively, a player may spend a forge token
when purchasing a unit to reduce its command
level requirement by one.
Keyword: when purchasing a unit. Says nothing about upgrades, so it doesn't affect upgrades.