Game becomes unstable after inactivity

Whenever my controller disconnects from inactivity and I come back, campaign missions can’t load, and multiplayer games crash towards late game.

Anyone else have this problem?