Are you sure that you have collected 15 fortune? Or did you mix up fortune (gold) with glory (blue)?
5-7 turns is really too fast.
We had the same experience. One secret delivery card with a good dice roll and two medium adventures and the game was over (also around 6-7 turns). I was not so lucky and was KO'ed three times and ended up with only three fortune :-D