Alright! I got an idea for the hotkey problem!
I happen to know a nice programmable input emulator which supports microphone input!
What about the only button pressing on the keyboard is ctrl(strg für die deutschen)?
The rest would be easy. You literally tell blender what to do! Like you press ctrl and say "scale" and it scales.
You press ctrl and say "move" and it moves?

I think I'm going to work on that today. As soon as I'm finished I'll post it here in the forum!

greetings
KDuke