Please keep the dimension in mind we are talking about here. When you get 400 - 512 frames per seconds that means that render a single frame took between 0.4 and 0.51 ms.! That is very very constant.
Always learn from history, to be sure you make the same mistakes again...