woohoo. me thinks me got it. added ignore_models.
trace_mode = ignore_me + ignore_you + ignore_passents + ignore_passable + ignore_sprites + ignore_models+ scan_texture + USE_POLYGON;
Haven't had problems since and gained 5 - 10 fps

I hope this can help anyone using this script!