Apparently if you start an offline custom games with bots with your forge map, then hop back into forge, the bots are still there. You can fly around as a monitor and everything. All of the bots will just shoot at you.
Also any changes you make to the map won’t automatically save. You are then prompted to save as a new map as well.
I guess its technically being considered as an offline session.
In order to fix it, you have to restart the game entirely.