its a combination of vertexbased outlining, edge detection based on the unlighted colors and some objectnormals based krickelkrackel


some more shots of this can be found here