This isn't a unique problem, but it seems a bit rare in the boardgame world. I'm getting into the habit of protecting all of my specialty dice. Just give them a protective coat every now and then. In my case, once a year is probably adequate.
Can you still see the designs on each face through a condom? I bet they don't roll very well either....