So the effect system is your problem, not the fixed function effect itself.

Just use the my pointer in your material event, it's as easy as that.