The rules are quite clear on this point:
Page V wrote:
Each action requires using a group of 1 to 3 dice of the same color, and those dice come from one or more of the city square’s 5 districts.
In addition, the Events say this: "the type of dice you must use to combat the event"
And the cheat sheet reiterates it under Pilgrimage as you indicated.