Uneven teams after voting screen

There are uneven teams after the voting screen although there are 8 players in the lobby. In the beginning it locks the teams even but then when the game starts one player is on the other team causing uneven teams.