Buttons outside the panel area won't react on the mouse. The panel area is defined either by the size of the panel background bitmap, or by the size_x/y parameters. If the panel only consists of a single button and has no background bitmap, always place it at the 0,0 position
