Before doing all of this,I tested something... :

Removed all the blocks to keep only the models. I used a simple "walk through" movement and its still getting fps drops when I look where all the models are. So the models are still the problem I think... Maybe it's my computer? For a hundred low poly models, how many RAM should I have, and what should be my other specs?

Thanks again.