Usually an email confirmation stating that you paid is evidence enough.
And if not, it gives you a good place to start tracking down the problem.

But yeah, if you buy with paypal, there are plenty of ways of tracking down what did or did not happen so that is no worry to concern yourself with.