See the definition of settlement on page 1:
All fields that are connected by
building pieces of the same colour
make up a Settlement of that colour.
The rules say nothing about 2 different colored settlements not being able to touch, so there seems no reason to think they couldn't touch.