It should work as you expected.
Maybe, it creates a new skin, but it shouldn't.
You can test that, when you switch to fullscreen and look for the upper right buttons in the Skin Editor for switching skins or groups.

Another thought: maybe, you chose polygons that are at the backside of the chosen 'uv-side'.