Spoiler (click to reveal)
No, this just means that the enemies can reach the library. There are some locations with the "passageway" trait. You have to use the action from Mr. Peabody and then move from the other location to the library. Depending on the setup there can be (IIRC) 1-4 locations with the passageway trait in play.