BGG says this is a 2-4 player game. How would that work? 2 of each starter set?
Sure. You don't "need" to make everyone play with starter sets either. Each starter set is enough for a single player. From there you can play with as many players as you want really.
Rules reference below has Multiplayer rules in it. Though there will be many un-supported types as well.