@ 2010-08-30 10:05 AM (#1409 - in reply to #1278) (#1409) Top | |
Posts: 774 Country : India | rakesh_rai posted @ 2010-08-30 10:05 AM Another important aspect which was especially relevant to this test is the concept of penalty for wrong answers. Many of the answers were guessable, and we either need to have penalty points or more complex answer keys (not too complex, but not single digits either). In fact, I had three puzzles left with one minute left. I submitted dummy answers for the three and got one correct too.There may or may not be others who may have done this as well. And, this should not be allowed. |
@ 2010-08-30 10:14 AM (#1410 - in reply to #1409) (#1410) Top | |
Country : India | debmohanty posted @ 2010-08-30 10:14 AM rakesh_rai - 2010-08-30 10:05 AM Another important aspect which was especially relevant to this test is the concept of penalty for wrong answers. Many of the answers were guessable, and we either need to have penalty points or more complex answer keys (not too complex, but not single digits either). In fact, I had three puzzles left with one minute left. I submitted dummy answers for the three and got one correct too.There may or may not be others who may have done this as well. And, this should not be allowed. Very valid point Rakesh. [ While I was testing the submission system on Friday, I entered dummy answers. And when I looked at the score page, I had got 18 ] I would prefer non-guessable (or difficult-to-guess) answer keys to -ve points. |
@ 2010-08-30 10:15 AM (#1411 - in reply to #1278) (#1411) Top | |
Posts: 199 Country : United States | motris posted @ 2010-08-30 10:15 AM As rakesh mentions, having answer strings that are "guessable" requires either different choices for the submission or penalties for being wrong or both. Guessing a sudoku row is unlikely (oftentimes approaching 9! options), but guessing "0" in a puzzle that could only take 0,1,2,3,4,5,6 as possible entries, and maybe only 0-3 as likely entries is a problem. |
@ 2010-08-30 10:31 AM (#1412 - in reply to #1408) (#1412) Top | |
Country : India | debmohanty posted @ 2010-08-30 10:31 AM rakesh_rai - 2010-08-30 10:00 AM There are two cases here: (1) Mistake in answer submission: The participant should not be given bonus points, because he probably had time to re-check his answers for correctness. It is always an accuracy v/s speed balance. The participant took a risk by going for maximum bonus points. It is perfectly possible that those who have actually got bonus points have checked their answer multiple times before submitting. (2) Incapable of solving one of the puzzles: The participant should try to solve it in the remaining time rather than try to gain partial points through this mechanism. Rakesh, your point is valid. But players make silly mistakes, and to lose 51 or 43 points (out of 100) because of the silly mistakes is too heavy a penalty. There are multiple stages to make mistakes a) player solves incorrectly b) player solves correctly, but computes the answer key as incorrectly c) player finds the correct answer key, but types incorrectly (if it is a long answer key) d) player forgets to click submit button :-) I would think we should give bonus points (based on one of the formulas suggested above or any other) to players doing b/c type of mistake. [because only b and c type of mistake can happen in online tests like ours] But to determine whether it is a-type mistake or b/c-type mistake becomes very subjective. So we should give partial bonus points to players. As long as "value of the bonus per minute" does not exceed "value of solving the puzzle". |
@ 2010-08-30 10:44 AM (#1413 - in reply to #1278) (#1413) Top | |
Posts: 774 Country : India | rakesh_rai posted @ 2010-08-30 10:44 AM debmohanty - 2010-08-30 10:31 AM There are multiple stages to make mistakes a) player solves incorrectly b) player solves correctly, but computes the answer key as incorrectly c) player finds the correct answer key, but types incorrectly (if it is a long answer key) d) player forgets to click submit button :-) I would think we should give bonus points (based on one of the formulas suggested above or any other) to players doing b/c type of mistake. [because only b and c type of mistake can happen in online tests like ours]But to determine whether it is a-type mistake or b/c-type mistake becomes very subjective.So we should give partial bonus points to players. As long as "value of the bonus per minute" does not exceed "value of solving the puzzle". I think (b) should be treated like (a) - finding the answer key is (practically) part of the puzzle solving. For (c), if the organisers think it is a typing mistake and is a genuine case - go ahead and award the points for the puzzle; the bonus shall take care of itself. |
@ 2010-08-30 11:01 AM (#1414 - in reply to #1413) (#1414) Top | |
Country : India | debmohanty posted @ 2010-08-30 11:01 AM rakesh_rai - 2010-08-30 10:44 AM I think (b) should be treated like (a) - finding the answer key is (practically) part of the puzzle solving. For (c), if the organisers think it is a typing mistake and is a genuine case - go ahead and award the points for the puzzle; the bonus shall take care of itself. I agree (b) should be like (a) Differentiating a typing mistake with a genuine mistake is too subjective. Lets just scrap a/b/c/d. Either we give partial bonus points based on some formula or we don't. |
@ 2010-08-30 12:51 PM (#1416 - in reply to #1399) (#1416) Top | |
Posts: 329 Country : India | neerajmehrotra posted @ 2010-08-30 12:51 PM motris - 2010-08-30 3:51 AM Fun but simple test. I made my typical boneheaded answer entry mistake (not counting a 90 degree turn in the zigzag that was made out of diagonal lines) but will simply imagine the score I might have had. Thanks Rohan and Tejal. I am happy that world Champs mind and my mind work in the same manner.............He also did the same mistake as I did in the Zig-zag... LOL |
@ 2010-08-30 1:40 PM (#1417 - in reply to #1416) (#1417) Top | |
Posts: 774 Country : India | rakesh_rai posted @ 2010-08-30 1:40 PM Only 9 participants have rated the puzzles (out of 75 non zero scores) Should we have some bonus points for rating puzzles also ? |
@ 2010-08-30 1:43 PM (#1418 - in reply to #1417) (#1418) Top | |
Country : India | debmohanty posted @ 2010-08-30 1:43 PM rakesh_rai - 2010-08-30 1:40 PM Only 9 participants have rated the puzzles (out of 75 non zero scores) Should we have some bonus points for rating puzzles also ? it will be too harsh I guess ... but we can think about not displaying the detailed scores if someone has not rated the puzzles :-) OR Not displaying scores which are higher than that player :-) OR encrypting all others players' user ids :-) Anyway, I think its okay, if players don't rate. We should not force them. |
@ 2010-08-30 3:27 PM (#1421 - in reply to #1278) (#1421) Top | |
Posts: 739 Country : India | vopani posted @ 2010-08-30 3:27 PM Thank You: Nikola, Rakesh, Semax, Dave, Amit, Thomas, Jason and all participants. Congrats to Hideaki, Ulrich and Takei! I'm glad most of you'll enjoyed the test. The test could've been a little shorter (maybe 75-80 minutes as suggested by Deb). The low participation was expected due to other contests. Apologies for the multiple-solutions Zigzag and the incomplete-instructions Tapa. See you all at Evergreen 2! Rohan. |
@ 2010-08-30 6:16 PM (#1422 - in reply to #1421) (#1422) Top | |
Posts: 542 Country : India | rajeshk posted @ 2010-08-30 6:16 PM Thanks Rohan/Tejal for this great test. I enjoyed solving all these puzzles. Nice to see more and more people creating puzzles. LMI provides right environment for showcasing not only your puzzles solving talent but also your puzzle creation talent. Three cheers to LMI! Looking forward for more such puzzle tests. |
@ 2010-08-30 6:21 PM (#1423 - in reply to #1422) (#1423) Top | |
Posts: 81 Country : India | Tejal Phatak posted @ 2010-08-30 6:21 PM Thanks a lot! I truly agree with you and I'm sure there will be better and more exciting contests by Indians (other than you, Amit, Deb, Rakesh, the regulars...) in future :-) |
@ 2010-09-01 2:39 PM (#1442 - in reply to #1278) (#1442) Top | |
Posts: 349 Country : India | amitsowani posted @ 2010-09-01 2:39 PM At LMI online we try to design the test timings in such a way that an average solver is able to solve all (or most of the) puzzles in the test and thereby we expect some of the top solvers to get a time bonus. Even at offline competitions it is difficult to estimate the correct time for a test given the rate at which sudoku solve timings have reduced over the past couple of years. It was nice to see a discussion on the loss of bonus points due to small oversights. In offline competitions we can do away with bonus points by introducing bonus puzzles like we have had in the Indian Sudoku Championships in the past and the WSC in Goa. However since this is not possible for online competitions we have to devise a way in which participants do not loose a large number of bonus points due to silly submission mistakes. Both Ziti and motris had similar ideas off giving weighted bonus points depending on the number of puzzles solved incorrectly and the number of puzzle points solved incorrectly. The puzzle points are always related to the time taken to solve the puzzle, so we will compute the percentage of test completed as the percentage of puzzle points solved. The weights will be based on Ziti's approach and hence all participants solving more then 50 % of the test can expect some bonus points for time saved in the test. |
@ 2011-09-05 4:14 PM (#5537 - in reply to #1278) (#5537) Top | |
Posts: 72 Country : South Korea | Joo M.Y posted @ 2011-09-05 4:14 PM Where can I get IB? The IB File is Broken...... (LMIMT_M201008P_IB ? The file is broken..) |
@ 2011-09-05 4:19 PM (#5538 - in reply to #5537) (#5538) Top | |
Country : India | debmohanty posted @ 2011-09-05 4:19 PM Joo M.Y - 2011-09-05 4:14 PM Please check now.Where can I get IB? The IB File is Broken...... (LMIMT_M201008P_IB ? The file is broken..) |
@ 2011-09-06 6:38 AM (#5546 - in reply to #5538) (#5546) Top | |
Posts: 72 Country : South Korea | Joo M.Y posted @ 2011-09-06 6:38 AM Thanks. |