Why not make the sphere passable at that moment

Try changing : set(my,PASSABLE);

into set(terrain,PASSABLE);