SM 2024 R2 - Odd Even & Hybrids (8th - 14th Mar) Score Discuss
PR 2024 R3 - Evergreens & MII (29th Mar - 4th Apr) has started Discuss
Twist - LMI April'11 Puzzle Test on 9th/10th64 posts • Page 2 of 3 • 1 2 3
Feedback about "points reduction" scoring system
How do you feel about the new "points reduction" scoring system?
(Please post specific and additional feedback in forum)
OptionResults
Like It : It can be used in future tests after minor adjustments.13 Votes - [76.47%]
Don't like : It is too complicated and should not be used in future3 Votes - [17.65%]
Don't care : I'm here just to solve puzzles1 Votes - [5.88%]
View Results

@ 2011-04-09 5:25 PM (#3968 - in reply to #3910) (#3968) Top

anurag



Posts: 136
10020
Country : India

anurag posted @ 2011-04-09 5:25 PM

Odd skyscraper: Some evens inside look like valid skyscrapers .The 2,4 in the third row can be valid and satsify the outside '3' at the same time.Is that a problem with the example? or will that hold for the test puzzle too?

Edited by anurag 2011-04-09 5:30 PM
@ 2011-04-09 6:10 PM (#3969 - in reply to #3968) (#3969) Top

debmohanty




1000500100100100202020
Country : India

debmohanty posted @ 2011-04-09 6:10 PM

anurag - 2011-04-09 5:25 PM

Odd skyscraper: Some evens inside look like valid skyscrapers .The 2,4 in the third row can be valid and satsify the outside '3' at the same time.Is that a problem with the example? or will that hold for the test puzzle too?

I think the rule and the example match perfectly.
@ 2011-04-10 10:40 AM (#3970 - in reply to #3910) (#3970) Top

kiwijam



Posts: 181
10020202020
Country : New Zealand

kiwijam posted @ 2011-04-10 10:40 AM

I don't understand why people like the reducing points. It's quirky and fun, but does it make the contest better?
As a middle-of-the-field solver, it doesn't change my strategy at all - I've always started with the puzzles that get me the fastest points, and leave the hard/slow ones for last. I assumed most people did this (unless they're intending to just do all the puzzles!).
If we scored this test normally, then wouldn't the rankings be almost exactly the same order anyway? e.g. we're all penalized a similar percentage of our total score in the end, except the fastest solvers who get an increased lead now.
@ 2011-04-10 10:41 AM (#3971 - in reply to #3910) (#3971) Top

kiwijam



Posts: 181
10020202020
Country : New Zealand

kiwijam posted @ 2011-04-10 10:41 AM

And on a different topic, the puzzles were great and I enjoyed the test. Thanks Deb!
@ 2011-04-10 11:16 AM (#3972 - in reply to #3970) (#3972) Top

MellowMelon



100
Country : United States

MellowMelon posted @ 2011-04-10 11:16 AM

My own reason for liking it is that I think it's a much better tiebreaker than simple time bonus systems for sorting out the top of the rankings. For instance, awhile ago there was a test in which motris finished ahead of uvo by a single second. There might have been a clearer victor with a scoring system like this.
@ 2011-04-10 11:54 AM (#3973 - in reply to #3910) (#3973) Top

motris



Posts: 199
10020202020
Country : United States

motris posted @ 2011-04-10 11:54 AM

Speaking as someone who normally tries to solve all puzzles and doesn't prioritize order, with the occasional consequences, on this test I certainly prioritized order much more. If anything, the slight change I might imagine solvers taking is shifting earlier to "clean-up" solving time versus going after big fish. With 15 minutes left to 90 minutes, you are less likely to start a 60 pointer versus smaller puzzles.

One of the goals of the delayed scoring I think is to run shorter tests for longer times without necessarily compromising the results at the top. FLIP is a great example of this type of test. While this test has a lot of easy puzzles, it probably is still too long of a test to showcase the best benefits of this type of system, which would be a 40-60 minute for uvo test that gets run for 2 hours (or more) instead.

To build off Melon's comment, I'm not sure this system can ever better separate the virtual tie between Ulrich and myself when we are 1 second apart and completely correct, but diminished scoring can help when a solver stops solving (with something like an error) but is at 23/24 very early, versus 24/24 after much more time. The clearest example was unfortunate for me but on Broken Pieces where I was done first (several minutes ahead of others, 45 minutes before end of the test) but with an entry error that I never caught. I ended up 12th, but some (hopefully not just me) would say my rate of solving was fast enough that my small mistake equaling no time-bonus was not a big enough mistake to cost the amount of points it did. Broken Pieces was an easy test with about 2x the amount of time needed, and is maybe even a better test than FLIP to showcase where this scoring could improve rankings.

Edited by motris 2011-04-10 12:18 PM
@ 2011-04-10 2:17 PM (#3974 - in reply to #3973) (#3974) Top

rakesh_rai




Posts: 774
500100100202020
Country : India

rakesh_rai posted @ 2011-04-10 2:17 PM

kiwijam - 2011-04-10 10:40 AM

...If we scored this test normally, then wouldn't the rankings be almost exactly the same order anyway? e.g. we're all penalized a similar percentage of our total score in the end, except the fastest solvers who get an increased lead now.
I think 80-90% of rankings would not change much, whatever system you use. So, that may not be the best reason for not liking a particular system.

If the basic assumption for this system is that "top solvers should be able to finish the test within the first time slab (90 minutes, here)" then I do not understand how this system will help better define the rankings at the top (as they all are expected to finish within 90 minutes and rank according to their finish times anyway).

On the other hand, this system will further tend to increase the difference between top solvers and others. Top solvers will get (699 PLUS bonus) but others will be penalized and they may get about 70-90% of their score based on when and what they submitted. Compared to previous systems, there is no change in top solvers' score but others' scores is lesser. If this is what is desired, then, yes, this system indeed serves its purpose. But I am not sure that is what is desired.

Maybe, it can work better in easier tests.
@ 2011-04-10 9:13 PM (#3975 - in reply to #3910) (#3975) Top

tamz29



Posts: 225
10010020
Country : Thailand

tamz29 posted @ 2011-04-10 9:13 PM

Excellent puzzles. excellent presentation.
Once again I fell victim to the answer format - miscounted arrows, miscounted cells... not a good feeling.
Asides that, the new time format does raise some debates.
It's interesting, but I hate how prioritizing solving order suddenly becomes crucial.
What if this system is used on a test where the puzzles are all roughly the same level?
Then this would ultimately test solving speed as opposed to how well you plan your solving order.

@ 2011-04-11 1:28 AM (#3978 - in reply to #3910) (#3978) Top

Janix



Posts: 2

Country : United Kingdom

Janix posted @ 2011-04-11 1:28 AM

Hi anyone

I am on holiday in Poland and have must managed to get a computer at 9:50pm on the Sunday evening, but I cannot find a start test on the TWIST page. Please can somebody put the password into this forum so that I can access the questions. I will email people in the UK my results at midnight. Thank you.

Ken
@ 2011-04-11 2:03 AM (#3979 - in reply to #3978) (#3979) Top

Fred76




Posts: 337
10010010020
Country : Switzerland

Fred76 posted @ 2011-04-11 2:03 AM

Janix - 2011-04-11 1:28 AM

Hi anyone

I am on holiday in Poland and have must managed to get a computer at 9:50pm on the Sunday evening, but I cannot find a start test on the TWIST page. Please can somebody put the password into this forum so that I can access the questions. I will email people in the UK my results at midnight. Thank you.

Ken


I think Deb is not here just now. I answer:

"I cannot find a start test on the TWIST page"

On the twist page, you must login before start. When you are logged, you'll see a big "start" button.

Fred
@ 2011-04-11 2:14 AM (#3980 - in reply to #3978) (#3980) Top

Nikola



Posts: 103
100
Country : Serbia

Nikola posted @ 2011-04-11 2:14 AM

Very nice and fun test! Bravo, Deb!

Regarding the previous discussion, I think it's time to stop experimenting with bonus systems and try to establish criteria that would apply to all future tests. For such single and one-time events, the first view, of course, should be the score, and then the solving time. I think it's very enough.

Nikola
@ 2011-04-11 2:17 AM (#3981 - in reply to #3910) (#3981) Top

Janix



Posts: 2

Country : United Kingdom

Janix posted @ 2011-04-11 2:17 AM

Arrgh

I am working on a very old laptop and I have just discovered a very small button half way down a blank page and I have started.

Thanks Fred
@ 2011-04-11 5:24 AM (#3982 - in reply to #3970) (#3982) Top

debmohanty




1000500100100100202020
Country : India

debmohanty posted @ 2011-04-11 5:24 AM

kiwijam - 2011-04-10 10:40 AM

I don't understand why people like the reducing points. It's quirky and fun, but does it make the contest better?
As a middle-of-the-field solver, it doesn't change my strategy at all - I've always started with the puzzles that get me the fastest points, and leave the hard/slow ones for last. I assumed most people did this (unless they're intending to just do all the puzzles!).
If we scored this test normally, then wouldn't the rankings be almost exactly the same order anyway? e.g. we're all penalized a similar percentage of our total score in the end, except the fastest solvers who get an increased lead now.


Now that the contest is almost over, I can explain what was intended using some numbers.
I've always believed and encouraged that LMI contests should run longer than the time top solvers take to solve all puzzles. This make sure that top solvers solve all puzzles and other get more time solve puzzles.

In this test, I was thinking at least 2-3 players can solve 24 puzzles in 90 minutes, and may be few more players in 120 minutes, and some more players should solve 22 or 23 puzzles in 120 minutes. If I'm running a test 33% longer than what a top solver can finish in, we need to give enough time bonus for top solvers. But I decided to not give any time bonus, instead reduce the point value of puzzles.

Rohan, Palmer and Thomas were one of the first few guys to participate, and looking at their results, I thought the timing is correct.
But that was not to be, 90 minutes was ill-timed, and if the point-reduction-system was not successful, it is because of wrong chosen Test.
As few of you have noted, a FLIP or a Broken Pieces kind of test will show its true value.

Without summarily accepting or rejecting it, I think we can give it a try again when we can plan a proper Test.

@ 2011-04-11 5:37 AM (#3983 - in reply to #3910) (#3983) Top

debmohanty




1000500100100100202020
Country : India

debmohanty posted @ 2011-04-11 5:37 AM

Congratulations to Thomas, Ulrich and Hideaki for topping in Twist.
Thomas solved all 24 puzzles in an incredible 86 minutes. Ulrich is the other one to solve all 24.

Among Indian results, Rohan is in top 10. That is an incredible performance IMO. Hope to see him get better.

Thank you everyone for participating.
@ 2011-04-11 6:03 AM (#3984 - in reply to #3974) (#3984) Top

debmohanty




1000500100100100202020
Country : India

debmohanty posted @ 2011-04-11 6:03 AM

I'm not completely surprised that all the discussion is around the point structure :-)

rakesh_rai - 2011-04-10 2:17 PM

On the other hand, this system will further tend to increase the difference between top solvers and others. Top solvers will get (699 PLUS bonus) but others will be penalized and they may get about 70-90% of their score based on when and what they submitted. Compared to previous systems, there is no change in top solvers' score but others' scores is lesser. If this is what is desired, then, yes, this system indeed serves its purpose. But I am not sure that is what is desired.


I'm not exactly sure if that is true.

If I ran this test for 120 minutes flat, motris would have got 869. This thing is one could argue for symbolic time bonus of 1 point per minute saved, but I always felt time bonus should be appropriately computed. Otherwise, it simply undervalues the exceptional performances by top solvers.

If the test was for 90 minutes, motris would lose 15 points to be at 719, but others would lose all the points they got for last 30 minutes.



Ok, agreed that the table above can't be exact since players' strategy could be different if the test ran for 120 minutes flat or for 90 minutes.
But I feel it provides very approximate information.
@ 2011-04-11 6:32 AM (#3985 - in reply to #3910) (#3985) Top

debmohanty




1000500100100100202020
Country : India

debmohanty posted @ 2011-04-11 6:32 AM

@ 2011-04-11 6:38 AM (#3986 - in reply to #3984) (#3986) Top

ronald



Posts: 9

Country : United Kingdom

ronald posted @ 2011-04-11 6:38 AM

I liked the bonus system - I especially appreciate the motivation - allowing the average competitors to have enough time to make a good attempt at more of the puzzles.

I think it worked nicely here. (and, it helped, that the puzzles were all excellent)

Thanks :)
Ronald
@ 2011-04-11 8:55 AM (#3987 - in reply to #3986) (#3987) Top

rakesh_rai




Posts: 774
500100100202020
Country : India

rakesh_rai posted @ 2011-04-11 8:55 AM

I would be interested in the approach for missing breakpoints (the bigger one) ... if someone can point a couple of starting steps, that'd be great.

Edited by rakesh_rai 2011-04-11 8:55 AM
@ 2011-04-11 9:03 AM (#3988 - in reply to #3987) (#3988) Top

debmohanty




1000500100100100202020
Country : India

debmohanty posted @ 2011-04-11 9:03 AM

rakesh_rai - 2011-04-11 8:55 AM

I would be interested in the approach for missing breakpoints (the bigger one) ... if someone can point a couple of starting steps, that'd be great.

You can identify two missing circles (one in Column 1 and one in Row 1) without drawing a single line.
Did you get there?
@ 2011-04-11 9:17 AM (#3989 - in reply to #3988) (#3989) Top

rakesh_rai




Posts: 774
500100100202020
Country : India

rakesh_rai posted @ 2011-04-11 9:17 AM

I am very poor at such puzzles....I could get one missing circle for column 1, hopefully its correct...for row 1, still not sure. Here's where I have got to, so far. (I don't want to look at the solution before solving it completely)

@ 2011-04-11 9:54 AM (#3990 - in reply to #3989) (#3990) Top

debmohanty




1000500100100100202020
Country : India

debmohanty posted @ 2011-04-11 9:54 AM

rakesh_rai - 2011-04-11 9:17 AM

I am very poor at such puzzles....I could get one missing circle for column 1, hopefully its correct...for row 1, still not sure. Here's where I have got to, so far. (I don't want to look at the solution before solving it completely)

Given that it was solved by only 6 players correctly, I don't think you need to feel that you are poor at it.
The thing with Missing Breakpoints is that it uses 2 properties of standard ESB puzzle heavily. If you don't use it, the puzzle will turn out to be a trial&error.

Property 1 - About Corners
In a valid ESB puzzle, exactly 2 (out of 4) corners will have circles. More ever, these 2 circles will be opposite to each other.
So, using this property, you immediately put a circle at R10C1.

Property 2 - About adjacent circles.
Check the image below. If there are 2 adjacent circles, 2 of the 4 combinations are ruled out.


From this property, we can deduce that in the border rows or columns, 2 circles can not be adjacent to each other.

Applying this property, you can put a circle at R1C6 without drawing any line.

Using these 2 circles, you can proceed for upto this point



@ 2011-04-11 11:06 AM (#3991 - in reply to #3990) (#3991) Top

MellowMelon



100
Country : United States

MellowMelon posted @ 2011-04-11 11:06 AM

Both of those properties are part of a more general topological one that I found indispensable in my own solve (which goofed the end with two breakpoints in one row). In this particular puzzle, the breakpoints are placed such that if a square has a breakpoint turn where the majority of the square is outside the loop (any square on the edge has this property), then the turn must go up-right or down-left. Similarly, if the majority of the square is inside the loop, then the breakpoint turn must go up-left or down-right. This applies in reverse to turns which have no breakpoint.
@ 2011-04-11 11:19 AM (#3992 - in reply to #3910) (#3992) Top

debmohanty




1000500100100100202020
Country : India

debmohanty posted @ 2011-04-11 11:19 AM

Finally about Twists :

The EverGreens series at LMI were very popular, and Rakesh/Rohan wondered if we should do an EG3 at LMI. I was independently working on Twist, and I thought it might be a good idea to have Twist instead of EG3.

I decided to stuck to EverGreens format i.e. lot of easy puzzles and some hard puzzles.

Applying the twists were not easy, because I wanted a simple rule change to each puzzle. So all kind of Hybrids were ruled out. I'm personally happy with the kind of puzzles I chose. Even if the rule change is minor, the solving approach changes drastically in some puzzles (e.g. LightUp, Hitori). While in some other puzzles, one just needs to solve like the standard puzzle with the additional rule in mind (e.g. Fence/Minesweeper). But some puzzles resulted in completely different puzzles (e.g. ESB/Sudoku - unfortunately those two types turned out to be hardest ones). The rule changes to Masyu and Arrows are something I was not comfortable with (especially Arrows because it became too error prone).

Despite the debatable points-reduction system, I hope that everyone found some puzzles enjoyable.

And finally, thanks to Branko once more for pretesting all puzzles. I used his timings as a guidance in determining the points, but the timing structure of 90+10+10+10 was set by me, which could have been improved.

Considering that lot of puzzles turned out to be very different from the standard types, we'll probably should have EG3 sometime soon :-)
@ 2011-04-11 11:23 AM (#3993 - in reply to #3978) (#3993) Top

debmohanty




1000500100100100202020
Country : India

debmohanty posted @ 2011-04-11 11:23 AM

Janix - 2011-04-11 1:28 AM

Hi anyone

I am on holiday in Poland and have must managed to get a computer at 9:50pm on the Sunday evening, but I cannot find a start test on the TWIST page. Please can somebody put the password into this forum so that I can access the questions. I will email people in the UK my results at midnight. Thank you.

Ken

Ken, I'm glad that things worked out fine at the end.
Posting the password on forum is definitely not advisable while the test in running. If someone wants to compete the test unofficially, they should request for password in email.
@ 2011-04-11 11:32 AM (#3994 - in reply to #3975) (#3994) Top

debmohanty




1000500100100100202020
Country : India

debmohanty posted @ 2011-04-11 11:32 AM

tamz29 - 2011-04-10 9:13 PM

Excellent puzzles. excellent presentation.
Once again I fell victim to the answer format - miscounted arrows, miscounted cells... not a good feeling.

About answer format - I was very much impressed by the answer format used in TVC. Most of the answer keys were driven by that (all loop puzzles, minesweeper)
In EG2, the answer keys I chose were really difficult, but I'm certain that the answer keys in Twist were relatively easier.

There seems to be lot of wrong answers in No 3 in Minesweeper (Top), but I feel they are because of wrong solves rather than bad answer key. Same about Fence.

The answer key for Arrows were probably more difficult, but I didn't know of a better answer key. I personally know 2 players got it wrong after solving the puzzle correctly.

The answer key for LightUp was little bad - because in the top puzzle it didn't require to solve the puzzle fully.
Twist - LMI April'11 Puzzle Test on 9th/10th64 posts • Page 2 of 3 • 1 2 3
Jump to forum :
Search this forum
Printer friendly version