how do you remove the color coded plastic door mirror trims?

[Lazyoaf]

I reckon Ill break em trying to force them off, Ive got a used one to replace my faulty one and need to swap the color coded outer plastic parts over, anyone know where to wave the magic wand to do this please?

Thanks

pretty certain mine is just stuck on and there is a way of doing it, but between my poor patience and clumsy fingers its gonna break