A cheap method is to "slice" up the button into several
parts (lets say 6), and create 6 buttons, that
do the same function.

Its not perfectly round, but closer to a circle, and
you dont need a seperate function to calculate a distance,
-> so you can use the standard buttons.

you can then further blend in a panel-image, to simulate
the "highlighting" of the button, when clicking it.