It appears I have the edition of the rules that tells you to only score for walls once (at the end of the game). You are meant to score for walls during all three rounds.
Check out this thread:
We played our first few games only scoring the walls at the end, but have since gone to every round. I prefer the every round version of the game.