No. There may only be one Building of each type in a territory. So I could have a Keep, but you couldn't; and in that same territory, you could have a Hall, but I couldn't, etc.Found it on page 6:
"One Territory may
only have one Building of each type."
It say territory and not player, my mistake.