They do, there are different flavours!
True Type Fonts are actually quite the amazing things, in reality they are byte code that is executed by a VM. And yes, that is turing complete.

However, the biggest advantage they have over bitmap fonts, aside being scalable, is that they contain information for kerning, ascender, descender and leading. Basically all the information needed to do proper typesetting of the text.