all hardware based binary floating point types have those representation errors.
you could write your own math functions (based on strings of digits) with algorithms similar to what you have learned in elementary school.
http://docs.python.org/library/decimal.htmlor maybe something like the python decimal module could be interfaced from lite-c.
what do you need this for?