Save a difference vector = panel pos - mouse_pos on left mouse clicks, set panel to (new) mouse_pos + difference vector. This could either be saved in panel skills or in a helper struct which you access via some panel ID.
"Falls das Resultat nicht einfach nur dermassen gut aussieht, sollten Sie nochmal von vorn anfangen..." - Manual