Looks like the rulebook could use a clarification on this point! In the absence of a rule clearly referring to this situation, your reading is quite reasonable.
The rule I've been using is this:
If you no longer have any settlements of a given terrain type, return the industry card you have for that terrain as it is no longer meaningful.
Once we're done testing the alternate taxes rules, I'll change the rulebook to include this.