New South Wales
It depends on the modules in use. Module 2 includes the rule:
504 Rules - Module 2 wrote:
If the player does not have enough residents
to buy in Phase 3 C or enough settlements
to settle a tile in Phase 3 D/3 E/3 G in his storage, he may take back the missing
pieces from the game map without substitution and place them directly back on the map.
If he takes back 1 settlement, he must take back all residents on the same tile.
I think this is the only module that allows it, although there might be another, it's been a while since I've brushed up.