First you calculate how much to take from each other player. This is irrespective of how much money they have on hand. Then you collect money from each player. If they don't have enough, you just collect as much as you can, and don't receive the rest.
This means your second result (A 5, B 2, and C 3) is the correct one.