The net that learns need to be the nets
thats processing the bots behaviour (or it could not learn).
So you only need one net after all.

But you could train a bot, and then save the properties of the net
for Bots in the published game.

rtsmaker.com