From page 5:
Small cohort is always 3 cards from the same faction on hand. The player may draw 1 additional card. (In some rare cases a player can hold two small cohorts, two factions x 3 cards each. In this case the player draws 1 x each cohort = 2 additional cards.)
If you were limited to your own faction, the 'rare case' described wouldn't happen.