Uuurrh! I let him in, uuuhh, was that not cool? Arrrarrh...
Yes, Gem collector can collect/absorb from areas that need climb or other movement abilities they just cannot move themselves into those spaces unless them have the requisite talents.
Same with Medea.
Gem collector does not allow absorbing from the surroundings, only claiming.