Only if that system produces results that reflect the actual skill of the population.
If we assume that the skill is a normal distribution (and it should be) then the system is fine as long as the results reflect said curve.
And open ended is fine. All normal curves are open ended. But only 0.13% should “escape” the curve (as defined by 3x standard deviations from the mean).
I don’t think the current system is doing this.
We have players 2400+. That is heading towards Onyx-20. Way too open ended in terms of a skill rank.
It doesn’t reflect for or against them.
And that’s the problem. At some point the number stops telling me much except that they have a lot of time on their hands.
Honestly, if I see a player at 1700 and try to compare them to a player at 2100 - I have no context to how they actually hold up. It’s safe to deduce they are both very good players. But my main thought is that the 2100 player just better at stacking their team.
But more so grinding wins against lesser teams.
That’s how an “open” system works.
If you want to rank and sort the best players consistently - you essentially have to constrain them to the spread of the population curve. The system has to be “closed” to achieve this.
You have to remove the “noise” from the data. The games where the match-making service couldn’t produce. And more so when we know teams are trying to manipulate their squads to take advantage of the system.
I would recalibrate the MMR’s on a, let’s say, weekly basis. Let match-making do it’s thing but only collect data from matches where the spread of skills are meaningful. The grind is to earn and keep your percentile. eg. top 30%, 25%, 20%, 15%, 10%, 5%, 2.5%, 1%., and 0.1%
You could have themed names for each, eg. Champion for 0.1%, or even get all nostalgic with military ranks. To add to the grind you could tie the ranks into streaks… eg. a five star General has been top 1% for five successive weeks.
Or you could have a minimum number of weeks in a certain bracket to qualify for season awards.
Have permanent leader slash honour boards on waypoint for everyone who has achieved a certain % for ‘x’ number of weeks in a row.
And now that you are re-calibrating the curve it is easier to compare the MMR’s between different playlists. You could have awards for reaching minimum % ranks in multiple lists.