I was having the same issue with the newest 7.7 build of 3DGS. Turns out I had some shaded surfaces in my mostly "flat" surface level. As soon as I changed those to flat, the compiler was able to get to, through and past the "tessellating surfaces" stage no problem. I'm guessing that the shaded surfaces I did have were too large.