with wmv you should be on the safe side. it's free to use on windows.

i think most licenses are only meant for the creators of hardware/software codecs (but you should check this for the codec you want to use! with some it's different.). if you don't ship your game with your own video decoder but use microsoft's directshow filters to play videos, then you shouldn't have to pay anything.