I don't mind that. Without intending to wind you up, I do wonder why something so trivial bothers you that much?
It's like saying "No offense, but you're a douche." If you're not intending to wind him up or make him uncomfortable, why would you ask a question like that. Do you expect a reasonable answer, or a delve into psychoanalysis? Ugh.
Also, "It's just a game". Those comments...