Xbox one x graphics mode glitch

Is anybody else having an issue with the performance/quality setting on Xbox one x? I have it set to performance mode, but every time a match starts the frame rate is really bad until I switch to quality, and switch it back to performance mode.