SM 2024 R2 - Odd Even & Hybrids (8th - 14th Mar) Score Discuss
PR 2024 R3 - Evergreens & MII (29th Mar - 4th Apr) starts in 1 hours 34 minutes Discuss
Twist - LMI April'11 Puzzle Test on 9th/10th64 posts • Page 2 of 3 • 1 2 3
Feedback about "points reduction" scoring system
How do you feel about the new "points reduction" scoring system?
(Please post specific and additional feedback in forum)
OptionResults
Like It : It can be used in future tests after minor adjustments.13 Votes - [76.47%]
Don't like : It is too complicated and should not be used in future3 Votes - [17.65%]
Don't care : I'm here just to solve puzzles1 Votes - [5.88%]
View Results

@ 2011-04-09 1:26 PM (#3962 - in reply to #3939) (#3962) Top

anurag



Posts: 136
10020
Country : India

anurag posted @ 2011-04-09 1:26 PM

thats a nice clarification.before looking at this post,i was surprised about the reduction as i thought it was calculated on the total score.This logic i think should be posted on the contest page too,to ensure no one is in doubt.
@ 2011-04-09 1:38 PM (#3963 - in reply to #3962) (#3963) Top

debmohanty




1000500100100100202020
Country : India

debmohanty posted @ 2011-04-09 1:38 PM

anurag - 2011-04-09 1:26 PM

thats a nice clarification.before looking at this post,i was surprised about the reduction as i thought it was calculated on the total score.This logic i think should be posted on the contest page too,to ensure no one is in doubt.


We've experimented with many bonus systems, not all of them are flawless - but we'll never have a bonus system where players need calculators (more than pencil and eraser) before submitting a puzzle.
@ 2011-04-09 1:46 PM (#3964 - in reply to #3963) (#3964) Top

anurag



Posts: 136
10020
Country : India

anurag posted @ 2011-04-09 1:46 PM

that sounded funny.i didnt say the contestants would start calculating.in fact i liked this penalty(bonus)system:) Good and simple one.
To make it better,why not increase the number of intervals and make it 6 ,of 5 mins each.That can probably sharpen the evaluation.
@ 2011-04-09 1:54 PM (#3965 - in reply to #3964) (#3965) Top

debmohanty




1000500100100100202020
Country : India

debmohanty posted @ 2011-04-09 1:54 PM

anurag - 2011-04-09 1:46 PM

that sounded funny.i didnt say the contestants would start calculating.in fact i liked this penalty(bonus)system:) Good and simple one.
To make it better,why not increase the number of intervals and make it 6 ,of 5 mins each.That can probably sharpen the evaluation.


Changing the interval to 5 minutes is an option. But it might become too stressful for players in last 30 minutes.
As the poll options indicate, we definitely can make adjustments to this system in future.

@ 2011-04-09 2:17 PM (#3966 - in reply to #3965) (#3966) Top

rakesh_rai




Posts: 774
500100100202020
Country : India

rakesh_rai posted @ 2011-04-09 2:17 PM

Nice twists. I liked L&M&I, Lights and Hitori Sum the most.
@ 2011-04-09 2:36 PM (#3967 - in reply to #3910) (#3967) Top

anurag



Posts: 136
10020
Country : India

anurag posted @ 2011-04-09 2:36 PM

a question off the topic..I want to know if the preliminary online is all we need to give(as it used to be every year) ,or the regional rounds are required too?
@ 2011-04-09 5:25 PM (#3968 - in reply to #3910) (#3968) Top

anurag



Posts: 136
10020
Country : India

anurag posted @ 2011-04-09 5:25 PM

Odd skyscraper: Some evens inside look like valid skyscrapers .The 2,4 in the third row can be valid and satsify the outside '3' at the same time.Is that a problem with the example? or will that hold for the test puzzle too?

Edited by anurag 2011-04-09 5:30 PM
@ 2011-04-09 6:10 PM (#3969 - in reply to #3968) (#3969) Top

debmohanty




1000500100100100202020
Country : India

debmohanty posted @ 2011-04-09 6:10 PM

anurag - 2011-04-09 5:25 PM

Odd skyscraper: Some evens inside look like valid skyscrapers .The 2,4 in the third row can be valid and satsify the outside '3' at the same time.Is that a problem with the example? or will that hold for the test puzzle too?

I think the rule and the example match perfectly.
@ 2011-04-10 10:40 AM (#3970 - in reply to #3910) (#3970) Top

kiwijam



Posts: 181
10020202020
Country : New Zealand

kiwijam posted @ 2011-04-10 10:40 AM

I don't understand why people like the reducing points. It's quirky and fun, but does it make the contest better?
As a middle-of-the-field solver, it doesn't change my strategy at all - I've always started with the puzzles that get me the fastest points, and leave the hard/slow ones for last. I assumed most people did this (unless they're intending to just do all the puzzles!).
If we scored this test normally, then wouldn't the rankings be almost exactly the same order anyway? e.g. we're all penalized a similar percentage of our total score in the end, except the fastest solvers who get an increased lead now.
@ 2011-04-10 10:41 AM (#3971 - in reply to #3910) (#3971) Top

kiwijam



Posts: 181
10020202020
Country : New Zealand

kiwijam posted @ 2011-04-10 10:41 AM

And on a different topic, the puzzles were great and I enjoyed the test. Thanks Deb!
@ 2011-04-10 11:16 AM (#3972 - in reply to #3970) (#3972) Top

MellowMelon



100
Country : United States

MellowMelon posted @ 2011-04-10 11:16 AM

My own reason for liking it is that I think it's a much better tiebreaker than simple time bonus systems for sorting out the top of the rankings. For instance, awhile ago there was a test in which motris finished ahead of uvo by a single second. There might have been a clearer victor with a scoring system like this.
@ 2011-04-10 11:54 AM (#3973 - in reply to #3910) (#3973) Top

motris



Posts: 199
10020202020
Country : United States

motris posted @ 2011-04-10 11:54 AM

Speaking as someone who normally tries to solve all puzzles and doesn't prioritize order, with the occasional consequences, on this test I certainly prioritized order much more. If anything, the slight change I might imagine solvers taking is shifting earlier to "clean-up" solving time versus going after big fish. With 15 minutes left to 90 minutes, you are less likely to start a 60 pointer versus smaller puzzles.

One of the goals of the delayed scoring I think is to run shorter tests for longer times without necessarily compromising the results at the top. FLIP is a great example of this type of test. While this test has a lot of easy puzzles, it probably is still too long of a test to showcase the best benefits of this type of system, which would be a 40-60 minute for uvo test that gets run for 2 hours (or more) instead.

To build off Melon's comment, I'm not sure this system can ever better separate the virtual tie between Ulrich and myself when we are 1 second apart and completely correct, but diminished scoring can help when a solver stops solving (with something like an error) but is at 23/24 very early, versus 24/24 after much more time. The clearest example was unfortunate for me but on Broken Pieces where I was done first (several minutes ahead of others, 45 minutes before end of the test) but with an entry error that I never caught. I ended up 12th, but some (hopefully not just me) would say my rate of solving was fast enough that my small mistake equaling no time-bonus was not a big enough mistake to cost the amount of points it did. Broken Pieces was an easy test with about 2x the amount of time needed, and is maybe even a better test than FLIP to showcase where this scoring could improve rankings.

Edited by motris 2011-04-10 12:18 PM
@ 2011-04-10 2:17 PM (#3974 - in reply to #3973) (#3974) Top

rakesh_rai




Posts: 774
500100100202020
Country : India

rakesh_rai posted @ 2011-04-10 2:17 PM

kiwijam - 2011-04-10 10:40 AM

...If we scored this test normally, then wouldn't the rankings be almost exactly the same order anyway? e.g. we're all penalized a similar percentage of our total score in the end, except the fastest solvers who get an increased lead now.
I think 80-90% of rankings would not change much, whatever system you use. So, that may not be the best reason for not liking a particular system.

If the basic assumption for this system is that "top solvers should be able to finish the test within the first time slab (90 minutes, here)" then I do not understand how this system will help better define the rankings at the top (as they all are expected to finish within 90 minutes and rank according to their finish times anyway).

On the other hand, this system will further tend to increase the difference between top solvers and others. Top solvers will get (699 PLUS bonus) but others will be penalized and they may get about 70-90% of their score based on when and what they submitted. Compared to previous systems, there is no change in top solvers' score but others' scores is lesser. If this is what is desired, then, yes, this system indeed serves its purpose. But I am not sure that is what is desired.

Maybe, it can work better in easier tests.
@ 2011-04-10 9:13 PM (#3975 - in reply to #3910) (#3975) Top

tamz29



Posts: 225
10010020
Country : Thailand

tamz29 posted @ 2011-04-10 9:13 PM

Excellent puzzles. excellent presentation.
Once again I fell victim to the answer format - miscounted arrows, miscounted cells... not a good feeling.
Asides that, the new time format does raise some debates.
It's interesting, but I hate how prioritizing solving order suddenly becomes crucial.
What if this system is used on a test where the puzzles are all roughly the same level?
Then this would ultimately test solving speed as opposed to how well you plan your solving order.

@ 2011-04-11 1:28 AM (#3978 - in reply to #3910) (#3978) Top

Janix



Posts: 2

Country : United Kingdom

Janix posted @ 2011-04-11 1:28 AM

Hi anyone

I am on holiday in Poland and have must managed to get a computer at 9:50pm on the Sunday evening, but I cannot find a start test on the TWIST page. Please can somebody put the password into this forum so that I can access the questions. I will email people in the UK my results at midnight. Thank you.

Ken
@ 2011-04-11 2:03 AM (#3979 - in reply to #3978) (#3979) Top

Fred76




Posts: 337
10010010020
Country : Switzerland

Fred76 posted @ 2011-04-11 2:03 AM

Janix - 2011-04-11 1:28 AM

Hi anyone

I am on holiday in Poland and have must managed to get a computer at 9:50pm on the Sunday evening, but I cannot find a start test on the TWIST page. Please can somebody put the password into this forum so that I can access the questions. I will email people in the UK my results at midnight. Thank you.

Ken


I think Deb is not here just now. I answer:

"I cannot find a start test on the TWIST page"

On the twist page, you must login before start. When you are logged, you'll see a big "start" button.

Fred
@ 2011-04-11 2:14 AM (#3980 - in reply to #3978) (#3980) Top

Nikola



Posts: 103
100
Country : Serbia

Nikola posted @ 2011-04-11 2:14 AM

Very nice and fun test! Bravo, Deb!

Regarding the previous discussion, I think it's time to stop experimenting with bonus systems and try to establish criteria that would apply to all future tests. For such single and one-time events, the first view, of course, should be the score, and then the solving time. I think it's very enough.

Nikola
@ 2011-04-11 2:17 AM (#3981 - in reply to #3910) (#3981) Top

Janix



Posts: 2

Country : United Kingdom

Janix posted @ 2011-04-11 2:17 AM

Arrgh

I am working on a very old laptop and I have just discovered a very small button half way down a blank page and I have started.

Thanks Fred
@ 2011-04-11 5:24 AM (#3982 - in reply to #3970) (#3982) Top

debmohanty




1000500100100100202020
Country : India

debmohanty posted @ 2011-04-11 5:24 AM

kiwijam - 2011-04-10 10:40 AM

I don't understand why people like the reducing points. It's quirky and fun, but does it make the contest better?
As a middle-of-the-field solver, it doesn't change my strategy at all - I've always started with the puzzles that get me the fastest points, and leave the hard/slow ones for last. I assumed most people did this (unless they're intending to just do all the puzzles!).
If we scored this test normally, then wouldn't the rankings be almost exactly the same order anyway? e.g. we're all penalized a similar percentage of our total score in the end, except the fastest solvers who get an increased lead now.


Now that the contest is almost over, I can explain what was intended using some numbers.
I've always believed and encouraged that LMI contests should run longer than the time top solvers take to solve all puzzles. This make sure that top solvers solve all puzzles and other get more time solve puzzles.

In this test, I was thinking at least 2-3 players can solve 24 puzzles in 90 minutes, and may be few more players in 120 minutes, and some more players should solve 22 or 23 puzzles in 120 minutes. If I'm running a test 33% longer than what a top solver can finish in, we need to give enough time bonus for top solvers. But I decided to not give any time bonus, instead reduce the point value of puzzles.

Rohan, Palmer and Thomas were one of the first few guys to participate, and looking at their results, I thought the timing is correct.
But that was not to be, 90 minutes was ill-timed, and if the point-reduction-system was not successful, it is because of wrong chosen Test.
As few of you have noted, a FLIP or a Broken Pieces kind of test will show its true value.

Without summarily accepting or rejecting it, I think we can give it a try again when we can plan a proper Test.

@ 2011-04-11 5:37 AM (#3983 - in reply to #3910) (#3983) Top

debmohanty




1000500100100100202020
Country : India

debmohanty posted @ 2011-04-11 5:37 AM

Congratulations to Thomas, Ulrich and Hideaki for topping in Twist.
Thomas solved all 24 puzzles in an incredible 86 minutes. Ulrich is the other one to solve all 24.

Among Indian results, Rohan is in top 10. That is an incredible performance IMO. Hope to see him get better.

Thank you everyone for participating.
@ 2011-04-11 6:03 AM (#3984 - in reply to #3974) (#3984) Top

debmohanty




1000500100100100202020
Country : India

debmohanty posted @ 2011-04-11 6:03 AM

I'm not completely surprised that all the discussion is around the point structure :-)

rakesh_rai - 2011-04-10 2:17 PM

On the other hand, this system will further tend to increase the difference between top solvers and others. Top solvers will get (699 PLUS bonus) but others will be penalized and they may get about 70-90% of their score based on when and what they submitted. Compared to previous systems, there is no change in top solvers' score but others' scores is lesser. If this is what is desired, then, yes, this system indeed serves its purpose. But I am not sure that is what is desired.


I'm not exactly sure if that is true.

If I ran this test for 120 minutes flat, motris would have got 869. This thing is one could argue for symbolic time bonus of 1 point per minute saved, but I always felt time bonus should be appropriately computed. Otherwise, it simply undervalues the exceptional performances by top solvers.

If the test was for 90 minutes, motris would lose 15 points to be at 719, but others would lose all the points they got for last 30 minutes.



Ok, agreed that the table above can't be exact since players' strategy could be different if the test ran for 120 minutes flat or for 90 minutes.
But I feel it provides very approximate information.
@ 2011-04-11 6:32 AM (#3985 - in reply to #3910) (#3985) Top

debmohanty




1000500100100100202020
Country : India

debmohanty posted @ 2011-04-11 6:32 AM

@ 2011-04-11 6:38 AM (#3986 - in reply to #3984) (#3986) Top

ronald



Posts: 9

Country : United Kingdom

ronald posted @ 2011-04-11 6:38 AM

I liked the bonus system - I especially appreciate the motivation - allowing the average competitors to have enough time to make a good attempt at more of the puzzles.

I think it worked nicely here. (and, it helped, that the puzzles were all excellent)

Thanks :)
Ronald
@ 2011-04-11 8:55 AM (#3987 - in reply to #3986) (#3987) Top

rakesh_rai




Posts: 774
500100100202020
Country : India

rakesh_rai posted @ 2011-04-11 8:55 AM

I would be interested in the approach for missing breakpoints (the bigger one) ... if someone can point a couple of starting steps, that'd be great.

Edited by rakesh_rai 2011-04-11 8:55 AM
@ 2011-04-11 9:03 AM (#3988 - in reply to #3987) (#3988) Top

debmohanty




1000500100100100202020
Country : India

debmohanty posted @ 2011-04-11 9:03 AM

rakesh_rai - 2011-04-11 8:55 AM

I would be interested in the approach for missing breakpoints (the bigger one) ... if someone can point a couple of starting steps, that'd be great.

You can identify two missing circles (one in Column 1 and one in Row 1) without drawing a single line.
Did you get there?
Twist - LMI April'11 Puzzle Test on 9th/10th64 posts • Page 2 of 3 • 1 2 3
Jump to forum :
Search this forum
Printer friendly version