If I have no enemies with Archery keyword, do I still need to add the archery value given by Pinned Down?
YES SURE. Card represent the archery fire from ruined houses or behind the wall.
Use your imagination! It can be very painful in the end of the game when you control 7-8 locations already.