Yes. Immediate benefits given by buildings (Neighborhood, Residence, Universities & Mines that have a token placed on them) are permanent. Otherwise, you'll have to be moving back on Residence track, or on points track or returning Spyrium, etc!
Thanks, for some reason I was thinking you'd lose those. Would have changed some plays I've made, but good to have it clarified.