I have fast updates currently only for players which are controlled by clients.

All other entites are controlled by the server and those are updated with a task scheduler. If I need a fast update there, I'll ahve a problem. Thanks for reminding me on this

thsi separation makes only sense with my setup I guess, so it probably has quite some flaws. I'll find out once I tested around more.