Ok, I calculated a 3d texcoord in the vs:
OutCoord = PosWorld - float3(53, 103, 30);

Output it in the ps:
return texCUBEproj(NormalizationCubeMapSampler, float4(InCoord,1));

This is what I get when I use bmap_to_cubemap on the cubemap: Image

I assume that is needed, but just incase, here is what I get without bmap_to_cubemap: Image