SM 2024 R2 - Odd Even & Hybrids (8th - 14th Mar) Score Discuss
PR 2024 R3 - Evergreens & MII (29th Mar - 4th Apr) has started Discuss
2011 Double Decathlon — LMI October Puzzle Test — 15th and 16th October62 posts • Page 1 of 3 • 1 2 3
What is your opinion of Instant Grading compared to other grading systems used here at LMI?
Please provide your specific feedback / suggestion about the grading system and/or the penalty system in the forum.
OptionResults
Instant Grading is a good system. Please use it again on other tests, with no changes.30 Votes - [76.92%]
Instant Grading is an okay system. Consider using it again, possibly with some changes or different penalty values.7 Votes - [17.95%]
Instant Grading is a bad system. Return to the more traditional format on future tests.2 Votes - [5.13%]
View Results

@ 2011-10-09 1:21 AM (#5776 - in reply to #5775) (#5776) Top

motris



Posts: 199
10020202020
Country : United States

motris posted @ 2011-10-09 1:21 AM

swaroop2011 - 2011-10-08 12:14 PM

can anybody explain me CAVE - CLASSIC
I am not able to understand this puzzle ..
I mean i understood the rules but how to start?


I wrote about Cave/Corral puzzles for the USPC and gave strategy tips here. This puzzle is from the same post, and the advice there will help to solve it.

swaroop2011 - 2011-10-08 12:14 PM
and GAPPED NUMBER FILL
I didnt understood what to do in this puzzle..
basically how to start.


You might notice that all the numbers given in this puzzle are increasing (later digits are always strictly equal to or larger), which is a trick to get started because it means the upper-left of the puzzle must have mostly small digits and the lower-right must have mostly large digits. Also, notice that the long 10 digit numbers are in three of four cases only 5 digits long. This means there must be a lot of gaps in their entries. Consider the intersection of all of these entries to get started.

swaroop2011 - 2011-10-08 12:14 PM
AND in BIG TENT PARTY
is it possible that adjacent cell shared by tent touch diagonally with adjacent cell shared by other tent..


Tents cannot touch each other, even diagonally.


I'll also say generally that almost all of the examples are closer to the HARD level than the EASY level, but you should expect this to be a fairly tough test.

Edited by motris 2011-10-09 1:25 AM
@ 2011-10-09 9:33 AM (#5777 - in reply to #5775) (#5777) Top

debmohanty




1000500100100100202020
Country : India

debmohanty posted @ 2011-10-09 9:33 AM

I had shared the Cave post in LMI forum earlier. Basically anyone who has not solved much of this type earlier, motris' post is a MUST.
@ 2011-10-11 2:57 AM (#5780 - in reply to #5749) (#5780) Top

kiwijam



Posts: 181
10020202020
Country : New Zealand

kiwijam posted @ 2011-10-11 2:57 AM

I just completed the practise test with entering multiple wrong answers for different puzzles, but only got a single -4 penalty at the end. I should have had more penalties.
Can you review my submission history (if it is saved) to check if there is a bug in this process?
Possible reasons I can think of might be from clicking the Submit All button rather than submitting one at a time, or from closing the page and logging in again later.
@ 2011-10-11 3:00 AM (#5781 - in reply to #5749) (#5781) Top

kiwijam



Posts: 181
10020202020
Country : New Zealand

kiwijam posted @ 2011-10-11 3:00 AM

Or does a bad submission in the wrong format (e.g. entering 3 digits when 6 digits are expected) not count as a -4 penalty?
@ 2011-10-11 3:04 AM (#5782 - in reply to #5780) (#5782) Top

motris



Posts: 199
10020202020
Country : United States

motris posted @ 2011-10-11 3:04 AM

kiwijam - 2011-10-10 1:57 PM

I just completed the practise test with entering multiple wrong answers for different puzzles, but only got a single -4 penalty at the end. I should have had more penalties.
Can you review my submission history (if it is saved) to check if there is a bug in this process?
Possible reasons I can think of might be from clicking the Submit All button rather than submitting one at a time, or from closing the page and logging in again later.


You probably ran into a feature, not a bug. It is hard to shut off the Submit All system for solvers, but there are strings we would never ever consider a wrong answer, for example "HI MOM" for the sudoku puzzle. If you manage to submit an answer based on Submit All that could not have otherwise been entered, it does not count against you. We expect the only answers that will fit this category is a solver typing the Easy in the Hard space, and only then when not using the individual submission button.

The only wrong submission I'm seeing from you was a test of axcaahbbec on tents that became axcaahbbeb. This does look like an answer to the tents, and was incorrect and became correct.

@ 2011-10-11 3:48 AM (#5783 - in reply to #5749) (#5783) Top

kiwijam



Posts: 181
10020202020
Country : New Zealand

kiwijam posted @ 2011-10-11 3:48 AM

Thanks for clearing that up, yes I did enter some other "HI MOM" answers to see what would happen. I assume all the Easy puzzles have different answer-key lengths to their Hard partners.
@ 2011-10-11 3:57 AM (#5784 - in reply to #5783) (#5784) Top

motris



Posts: 199
10020202020
Country : United States

motris posted @ 2011-10-11 3:57 AM

kiwijam - 2011-10-10 2:48 PM
Thanks for clearing that up, yes I did enter some other "HI MOM" answers to see what would happen. I assume all the Easy puzzles have different answer-key lengths to their Hard partners.


Yes, within each puzzle type the keys are unique lengths. I'm not trying to get people negative scores after all! So common mistakes like typing the four number easy answer in the five number hard answer box will be met with no clickable button, or an X after Submit All for "wrong format", but not -4 points. Only answers that could be marked correct will be graded and earn credit or penalties.

There are still a few puzzle types with similar names (the two Loops, for example), where it might be possible to submit an answer in the wrong spot and be marked wrong. We will consider removing penalties in cases where it is clear that this was a result of such an error, but are hopeful that the formatting of the test and solution page will minimize this kind of mistake that does happen at a low rate on these tests.
@ 2011-10-13 10:50 AM (#5786 - in reply to #5749) (#5786) Top

motris



Posts: 199
10020202020
Country : United States

motris posted @ 2011-10-13 10:50 AM

In response to helpful comments from play-testers, the graphical presentation of Almost Simple Loop will change from the original format in the instructions. Instead of black squares with white numbers and arrows, which can be harder to cross out when solving, the clues will now be in gray squares with black numbers and arrows as in the attached image. The word "black" in the puzzle instructions has also been replaced with the word "gray" to account for this presentation change.

A revised instruction booklet with new images for Almost Simple Loop and some other typographical fixes is now posted.



(AlmostSimpleLoop.png)



Attachments
----------------
Attachments AlmostSimpleLoop.png (2KB - 4 downloads)
@ 2011-10-13 11:54 AM (#5787 - in reply to #5749) (#5787) Top

debmohanty




1000500100100100202020
Country : India

debmohanty posted @ 2011-10-13 11:54 AM

@ 2011-10-14 9:46 PM (#5788 - in reply to #5749) (#5788) Top

motris



Posts: 199
10020202020
Country : United States

motris posted @ 2011-10-14 9:46 PM

Password protected booklet uploaded. It has 10 pages, one page per puzzle type with the easy (20 point) and hard (50 point) puzzles on the same page. There is no cover page.

REMINDER: This test marks the debut of INSTANT GRADING, a new system of grading; if you have not yet practiced using this system, please go to this practice page before the contest using the instruction booklet answers for submission.

Edited by motris 2011-10-14 9:46 PM
@ 2011-10-15 3:44 AM (#5789 - in reply to #5749) (#5789) Top

ColinMacLeod



Posts: 3

Country : United States

ColinMacLeod posted @ 2011-10-15 3:44 AM

The end date for the contest displays as October 16/17, 2012 instead of 2011.

2011 Double Decathlon ends at 10/16/2012 5:00:01 PM local time | 10/17/2012 12:00:01 AM GMT
@ 2011-10-15 5:20 AM (#5790 - in reply to #5749) (#5790) Top

debmohanty




1000500100100100202020
Country : India

debmohanty posted @ 2011-10-15 5:20 AM

changed to 2011.
@ 2011-10-15 8:18 AM (#5791 - in reply to #5749) (#5791) Top

figonometry



Posts: 30
20
Country : Canada

figonometry posted @ 2011-10-15 8:18 AM

I LOVE the instant scoring. Thanks!
@ 2011-10-15 8:21 AM (#5792 - in reply to #5791) (#5792) Top

motris



Posts: 199
10020202020
Country : United States

motris posted @ 2011-10-15 8:21 AM

figonometry - 2011-10-14 7:18 PM

I LOVE the instant scoring. Thanks!


Looks like it worked out for you exactly as intended (recovering points you might not otherwise have earned). We'll most likely run a poll right after the contest to gauge people's responses to the system. It obviously is not the easiest system to use for all puzzle tests, but seems to be an interesting compromise that online solving can allow.

EDIT: Actually, we've added the poll at the top of this thread now.

Edited by motris 2011-10-15 12:30 PM
@ 2011-10-15 2:33 PM (#5793 - in reply to #5749) (#5793) Top

neerajmehrotra



Posts: 328
10010010020
Country : India

neerajmehrotra posted @ 2011-10-15 2:33 PM

Wonderful...............thanks Thomas for such a nice puzzle test....ofcourse it was much beyond my capacity....
@ 2011-10-15 10:06 PM (#5794 - in reply to #5749) (#5794) Top

mucha



Posts: 13

Country : Poland

mucha posted @ 2011-10-15 10:06 PM

Wow, either I'm out of shape or this test was really hard. Very nice puzzles, the ones I managed to crack at least. Also, really like instant scoring!
@ 2011-10-16 12:32 AM (#5795 - in reply to #5749) (#5795) Top

dave8mcrae



Posts: 2

Country : United States

dave8mcrae posted @ 2011-10-16 12:32 AM

So, I used the individual submit buttons, which kept updating a score on the left. But there was also something there that said "1 Correct, 0 Wrong" (or something like that). That figure didn't update. What was that supposed to tell me?
@ 2011-10-16 1:18 AM (#5796 - in reply to #5795) (#5796) Top

motris



Posts: 199
10020202020
Country : United States

motris posted @ 2011-10-16 1:18 AM

dave8mcrae - 2011-10-15 11:32 AM

So, I used the individual submit buttons, which kept updating a score on the left. But there was also something there that said "1 Correct, 0 Wrong" (or something like that). That figure didn't update. What was that supposed to tell me?


That figure was telling you what was true of your most recent submission. It will only ever have more information like "3 correct, 1 Wrong" if you submitted more at a time using "submit all". This does seem like it could be slightly confusing so we can review the report for those doing individual submit if we use this system again.

Edited by motris 2011-10-16 1:18 AM
@ 2011-10-16 5:01 AM (#5797 - in reply to #5749) (#5797) Top

forcolin




Posts: 171
100202020
Country : ITALY

forcolin posted @ 2011-10-16 5:01 AM

All contests on LMI are of good quality, but this one is well above the norm. Excellent stuff, I liked particularly the hard Loop the loop and battleship sudoku.
Also, the instant grading saved me a lot of points, two copying/typing errors and a genuine solving error which I could rectify. The negative effect is that probably I did not pay much attention when typing because I knew there was a second chance.....
stefano
@ 2011-10-16 8:20 AM (#5798 - in reply to #5749) (#5798) Top

yureklis



Posts: 183
10020202020
Country : Turkey

yureklis posted @ 2011-10-16 8:20 AM

First of all I solved all IB puzzles for preparation :) Normally I don't, but this time I tried to push myself to understand puzzle rules/competition rules before the contest. Also I should say that IB puzzle are really fun! After solving those I was looking forward to compete with real ones.

Secondly I am glad with my result although I couldn't get points that I should get, at least in my opinion. I solved one big puzzle in last 5 minutes but my time was not enough to submit my solution. Also I had solved one puzzle of all types but I lost myself in some puzzles and of course it caused me to lose my strategy, and I couldn't. But I am glad with my performance.

Your puzzles are great! They have nice looking, very satisfying solving paths; and of course new point system is cool! You made a great job, thank you so much, Thanks to LMI and shining man Deb :)
@ 2011-10-16 11:23 AM (#5799 - in reply to #5749) (#5799) Top

joshuazucker



Posts: 31
20
Country : United States

joshuazucker posted @ 2011-10-16 11:23 AM

Thanks for a great test! I liked the scoring system, too, both the structure of the bonuses and the penalties with the instant grading. I enjoyed all the puzzles, but particularly the same two that forcolin mentioned, though I still need more time to finish the rest of the test to see if there are some gems there that I didn't want to attempt with time pressure.
@ 2011-10-16 2:29 PM (#5800 - in reply to #5749) (#5800) Top

rob



Posts: 170
100202020
Country : Germany

rob posted @ 2011-10-16 2:29 PM

Loved the test, and the scoring system. The instant grading might have made me a little more careless than usual. Three genuine mistakes in reading off the code feels like a lot for me. I'm amazed I was able to make the same mistake on both "Almost Simple Loop" puzzles!

It did seem the instant grading slightly affected my solving: On one or two puzzles, after I finished them up with some intuition, I used the submit button to verify the solution, instead of double checking by hand.
@ 2011-10-16 7:27 PM (#5801 - in reply to #5749) (#5801) Top

vopani



Posts: 739
50010010020
Country : India

vopani posted @ 2011-10-16 7:27 PM

Very good set of puzzles. Thanks Thomas!

I liked everything about the scoring system. I just wanted to throw open a point that comes to my mind. Should we have different penalties for different puzzles? (High-point puzzles have greater penalty?) Maybe not very large, but at least some amount of distinction.
@ 2011-10-16 10:22 PM (#5802 - in reply to #5801) (#5802) Top

detuned



Posts: 152
1002020
Country : United Kingdom

detuned posted @ 2011-10-16 10:22 PM

So with this new system, I think I was more careful about entering keys then normal, conscious of the four point penalties. And no mistakes!! (at least mistakes I didn't catch, seems I'm a little rusty from not doing any LMI tests in ages). So yeah, thumbs up from me on this system. I'm sure it'd save me lots of future grief, however I'm not sure it should be implemented on every test. Instantly knowing when you have a puzzle right or wrong doesn't accurately match up with an offline solving experience, for instance...
@ 2011-10-16 11:57 PM (#5803 - in reply to #5802) (#5803) Top

motris



Posts: 199
10020202020
Country : United States

motris posted @ 2011-10-16 11:57 PM

Rohan Rao - 2011-10-16 6:27 AM
I liked everything about the scoring system. I just wanted to throw open a point that comes to my mind. Should we have different penalties for different puzzles? (High-point puzzles have greater penalty?) Maybe not very large, but at least some amount of distinction.


I thought a lot about different implementations; certainly the existing typo standard of 80% would suggest a larger penalty but I think, given the time put into solving the puzzle versus the time to enter the submission, it is excessively punitive (should it be 4 points and 10 points on this test, for example?). I will say that one change I would consider looking over the results is possibly an escalating penalty if making many errors on the same puzzle. It also seems possible to use the time to fix an error to split the cases (typos are fixed quickly, puzzle errors most often take 2+ minutes), but this could also be risky for some types of errors.

Considering all these options, I actually prefer the simplicity used here, just one kind of penalty and it is the same everywhere.

detuned - 2011-10-16 9:22 AM
So with this new system, I think I was more careful about entering keys then normal, conscious of the four point penalties. And no mistakes!! (at least mistakes I didn't catch, seems I'm a little rusty from not doing any LMI tests in ages). So yeah, thumbs up from me on this system. I'm sure it'd save me lots of future grief, however I'm not sure it should be implemented on every test. Instantly knowing when you have a puzzle right or wrong doesn't accurately match up with an offline solving experience, for instance...


I expect a few people to make this argument and it may be why several of the better solvers (uvo, melon, Para) have voted negative or neutral on this system. My view is offline contests are offline contests and online contests are online contests. They can borrow from each other at times and innovate and do new things at other times. I would compare this system to being in a playoff round at a WPC and turning in each puzzle as finished. After a fixed amount of time you get a signal if you are correct or not. So it is an offline test mode, just not one people have a lot of experience with. The penalty is set to act like the equivalent WPC penalty, which costs you a small amount of points/time, but puts you back in control of fixing whatever mistake you made.

The results in the stat page so far should reveal at lot of the errors solvers make are "online only"; their paper probably has a correct solution but entering a particular piece of information doesn't come through with high fidelity. Since I'm not grading entire grids, I'm happy to experiment with a system that helps remove the "online only errors" from other errors. I think this has gone very well on this test, and Deb has done a very good job realizing the scoring system I wanted.

Edited by motris 2011-10-17 12:05 AM
2011 Double Decathlon — LMI October Puzzle Test — 15th and 16th October62 posts • Page 1 of 3 • 1 2 3
Jump to forum :
Search this forum
Printer friendly version