Quote from the rules:
There is no penalty if a Consular Army falls below five
CUs due to attrition, battle or retreat; and if it does, it may not
drop off or leave behind CUs until it again contains more than
So: No penalty for your consular army, you can still move, attack, ....