I dont think that the mouse detects if a button is transparent or not. At least this does not work with TGA and A7, the full button image area is always detected.

When you want to detect only transparent parts, you need to read the button image and find the pixel at the mouse position. If that is transparent the button function can just return and do nothing.