Thread - LMI Screen Test #3 — December Sudoku Test

debmohanty - 2012-12-26 7:31 AM

Thank you everyone for using the feedback system and letting us know how you felt about the test.

However, I'm bit confused by the feedback about "Number of puzzles". More than 40% of the votes suggest there were too many puzzles / way too many puzzles.
I thought in the IB, it was clear that 12 puzzles are meant for 'All', next 9 puzzles as 'Bonus', and last 9 as 'Extra Bonus'. If you are not a top player, you were not expected to reach section E in any case. Similarly, if you were a beginner, you should have thought that there were 12 puzzles for you.

If we plan for a similar test in future, I am not sure if we can / should reduce the number of puzzles drastically. It will be interesting to understand why players thought here were a lot more puzzles in this test than what it should have been.

I kept putting off and forgot to officially do this test (would have been my second, I think) despite doing the demo. I think the reason may have something to do with the fact that a puzzle can be skipped as incomplete, and with the appearance as a whole of a 30 puzzle test. You can't please everyone, and if the screen test had been one hour for 12 puzzles - something I don't consider too out of the ordinary, as those not as skilled can then spend five minutes on a puzzle without stressing - then some others would have said "Where's the challenge?" With a test of 30 puzzles, and the ability to skip puzzles, I don't blame someone who skipped over 5 puzzles they couldn't do and otherwise solved 18 (right or wrong, don't matter) before running out of time for saying there was way too many puzzles. Personally, I thought it was too many; you have to literally solve each in, on average, two minutes. However, if the goal had been to solve any 20 and skip any six, that would give a little more time and allow people to customize their test for the best result. Obviously, bonus points could then be awarded for correct solves of 21-30 (not by puzzle number but by number of correct puzzles), and the best performances thus would well exceed the otherwise expected maximum test score based on 20 puzzles (as an example). For 24 puzzles, for instance, that shaves off 12 minutes that can be allocated to other puzzles, giving 2:30 to each puzzle instead of 2:00, and skip any six you don't like the look of.

Just my opinion.

Also, a booklet of the puzzles now that the test is complete might be nice. :)

Cyclone

Edited by Cyclone 2013-01-04 3:48 AM


	@ 2013-01-04 3:47 AM (#9326 - in reply to #9242) (#9326) Top
Cyclone Posts: 8 Country : Canada	Cyclone posted @ 2013-01-04 3:47 AM debmohanty - 2012-12-26 7:31 AM Thank you everyone for using the feedback system and letting us know how you felt about the test. However, I'm bit confused by the feedback about "Number of puzzles". More than 40% of the votes suggest there were too many puzzles / way too many puzzles. I thought in the IB, it was clear that 12 puzzles are meant for 'All', next 9 puzzles as 'Bonus', and last 9 as 'Extra Bonus'. If you are not a top player, you were not expected to reach section E in any case. Similarly, if you were a beginner, you should have thought that there were 12 puzzles for you. If we plan for a similar test in future, I am not sure if we can / should reduce the number of puzzles drastically. It will be interesting to understand why players thought here were a lot more puzzles in this test than what it should have been. I kept putting off and forgot to officially do this test (would have been my second, I think) despite doing the demo. I think the reason may have something to do with the fact that a puzzle can be skipped as incomplete, and with the appearance as a whole of a 30 puzzle test. You can't please everyone, and if the screen test had been one hour for 12 puzzles - something I don't consider too out of the ordinary, as those not as skilled can then spend five minutes on a puzzle without stressing - then some others would have said "Where's the challenge?" With a test of 30 puzzles, and the ability to skip puzzles, I don't blame someone who skipped over 5 puzzles they couldn't do and otherwise solved 18 (right or wrong, don't matter) before running out of time for saying there was way too many puzzles. Personally, I thought it was too many; you have to literally solve each in, on average, two minutes. However, if the goal had been to solve any 20 and skip any six, that would give a little more time and allow people to customize their test for the best result. Obviously, bonus points could then be awarded for correct solves of 21-30 (not by puzzle number but by number of correct puzzles), and the best performances thus would well exceed the otherwise expected maximum test score based on 20 puzzles (as an example). For 24 puzzles, for instance, that shaves off 12 minutes that can be allocated to other puzzles, giving 2:30 to each puzzle instead of 2:00, and skip any six you don't like the look of. Just my opinion. Also, a booklet of the puzzles now that the test is complete might be nice. :) Cyclone Edited by Cyclone 2013-01-04 3:48 AM