Game thinks I'm in party after game fails to load

When a matchmade game starts to load but fails to start, when we get kicked back out, the game thinks I’m in a party with everyone in that game session. I can’t try to play another playlist because it thinks the party is too big. Fix this.