Kicked from game due to Lobby Service

So every so many games I play I get kicked from games with the same message “Unable to connect to Halo 5:Guardians lobby service”. I have hard reset my xbox, I have called my internet provider and had them open up the proper ports, my nat type is open. The problem is not with the internet because I never get kicked from party chat and never get kicked from other games. I am baffled and annoyed by this situation it makes the game unplayable. Any advice would be helpful or if Halo support could be at least more user friendly.