It's possible, but it might take alot of code.
Basically, you'd have to put the texture on a flat model. Then, using the target vector to see where the ball hit the image, convert the vec to texture coords (not as hard as it sounds), and then get that pixel from the image and check!
Or, you could simply using a circular range for the collision, and check if distance from model center to target vec is less than X...