I tried exactly that and it seemed okay, but I'm not saying you should rush to buy it based on that. Minor addition to that is that your final score is the score of the smaller scoring character you have. Break ties with the bigger score.
Thanks. I would buy the game either was but it is nice knowing that it is at least possible to play that way. Is this a variant listed in the rule book or one that you tried on your own?