Zorro supports GPU training via R.

Your setup needs to be correct. Either you failed to get your GPU to work, or you created a bottleneck. But it is impossible to identify the culprit with what little context you have provided.