I found an interesting technique for edge preserving upsampling which takes the depth and the normals into account before and after downsampling.