Mute not functioning

I am having problems muting the players in matchmaking. I will click the mutual all function, but most of the time it doesn’t work. It just plays through my t.v… I don’t always use the headset because I have a lot of background noise that would intrude on the conversation. Please fix this.