SM 2024 R3 - Math & Neighbours (5th - 11th Apr) Score Discuss
Riad's April Contest 2024 (13th - 21st April) has started Discuss
Posting a reply to: Re: Rassi Silai Race - 22nd Feb to 14th March
HTML: Yes
Anonymous: No
Disable HTML

Cancel


You are replying to:

IHNN




Posts: 21
20
Country : United States

IHNN posted @ 2022-03-14 9:27 PM

Thanks for a great contest with great puzzles. This time, I looked a bit more into the scoring system. First, I could not find any description how it works.
If we start at the "Leaderboards" page, there is a column "B" in the table with my personal points.
If I look at the "Statistics" page, there are various values I don't understand. I can't find the values in the "50th player" and "100th player" column anywhere else, especially not in the detailed ranking of the corresponding puzzle. (Also the marking HH:MM for these columns is probably wrong.).

Scoring is pretty simple - the "A" column is 101 - your rank (1st = 100 point, and 1 less until 100th gets 1 point). The "B" column is a flat reward for solving the puzzle at all, scaled based on difficulty with that difficulty calculated from the top results. The exact mechanism isn't important, but it rewards persevering to solve a harder puzzle over just being fast on the easy ones and giving up on the hard ones.
The "50th and 100th player columns are correct with HH:MM as that's how long the puzzle was available until 50 and 100 people solved them. Personally, I think the fact that most of the the 50th player times are in the multiple hours means that the early bird stuff is a bit of a miss, but some people clearly like trying to be in the first few and it barely harms anything to be there so whatever.


With that sum being 1600, it's save to assume that the main contributor to the ranking (beside solving all puzzles) are the "Type A" points. The contest started with 350 puzzlers and as expected, there is a slow decline. There were a stable 200-250 successful solvers per puzzle. Of these, up to 60% got nothing. That's just not a good idea in my opinion. Of course it doesn't matter if you can constantly get Top100 results, but a lot of people (even experienced puzzlers) can not. So for all but the maybe 50 people who can constantly get Top100 results, the ranking correlates very badly with the performance.

I do agree that the scoring staying at 100-1 points for 1st to 100th doesn't really work with the scale, as it didn't for Tapa Train either. But while Tapa Train had no idea of the expected level of participation, Rassi Silai Race should have known and I think should have adjusted slightly. I think the best proposed solution was to award 100-51 points for 1st to 50th, but then both 51st and 52nd would get 50 points, 53rd and 54th would get 49 points, and so on - extending the "tail" of the scoring.