"Destroy one of a rival's urban buildings. Your civilization produces resources equal to one half the buildings cost, round up."
I seem to remember reading something that said that the victim gets to select the damage, but I can't find it anywhere. Obviously, it makes a difference! Potentially a large one.
I believe it's the aggressor that chooses which urban building will be destroyed.