PR 2024 R2 - Loops & Numbers (23rd - 29th Feb) Score Discuss
SM 2024 R2 - Odd Even & Hybrids (8th - 14th Mar) Score Discuss
Sprint Test — LMI Sep Puzzle Test — 3rd and 4th September80 posts • Page 2 of 4 • 1 2 3 4
How frequently you would want to see Sprint tests at LMI?
The aim of the Sprint test is to have relatively easier and less number of puzzles so that many more players can complete the full set. Please let us know if we should have more Sprint tests at LMI.
OptionResults
Once in a month22 Votes - [47.83%]
Once in a quarter18 Votes - [39.13%]
Once in 6 months5 Votes - [10.87%]
Once in a year1 Votes - [2.17%]
Never. This should be the last Sprint Test.0 Votes - [0%]
View Results

@ 2011-09-05 12:59 AM (#5518 - in reply to #5517) (#5518) Top

MellowMelon



100
Country : United States

MellowMelon posted @ 2011-09-05 12:59 AM

Yeah, I can concur with having the pulse racing. Although here, that took the place of the huge amount of sweat I've started to feel all over me after finishing a 90+ minute test.
@ 2011-09-05 6:25 AM (#5519 - in reply to #5455) (#5519) Top

debmohanty




1000500100100100202020
Country : India

debmohanty posted @ 2011-09-05 6:25 AM

With no one participating now, Sprint test is over. MellowMelon (33:51), motris (34:05), xevs (37:48) take the top 3 positions. Their timings are extremely close (note that xevs took 3.5 minutes to recheck all answers before hitting 'Claim Bonus'). All of them and 3 more in top 10 are well ahead of their 'target' time.

Thank you everyone for participating and for voting in the poll. It is important for us to know what everyone expects.

Some stats :
Total number of participants : 264
Number of non-zero scores : 210
Number of players claiming bonus : 41
Number of players getting bonus : 36
Number of players submitting all 15, but not claiming bonus : 4
Number of players with all 15 correct: 29
Number of players with 14 correct: 19

Median Score : 110

@ 2011-09-05 6:36 AM (#5520 - in reply to #5455) (#5520) Top

debmohanty




1000500100100100202020
Country : India

debmohanty posted @ 2011-09-05 6:36 AM

Please post any feedback you might have regarding the test
  • Length of the test
  • Difficulty of puzzles
  • Complexity of puzzles
  • Number of puzzles
Bastien will share his thoughts some time later in the day.
@ 2011-09-05 7:15 AM (#5521 - in reply to #5455) (#5521) Top

spmcandrews



Posts: 1

Country : United States

spmcandrews posted @ 2011-09-05 7:15 AM

Can I ask how I got 4 points out of 5 on Masyu? Was there partial credit somehow?
@ 2011-09-05 8:18 AM (#5522 - in reply to #5521) (#5522) Top

motris



Posts: 199
10020202020
Country : United States

motris posted @ 2011-09-05 8:18 AM

spmcandrews - 2011-09-04 6:15 PM

Can I ask how I got 4 points out of 5 on Masyu? Was there partial credit somehow?


It looks like your answer was on the "accepted" list, but was not actually correct for the described answer mode. The solution should be 13,22, for lengths of line segments in the indicated rows, and your entry was 24,33 with consistent overcounting. So you got credit, but it counted as a typo for -20%.


------------------
I really liked the test, particularly the page with the Star Battle (123 theme) and the Tapa below (with 1234 by quadrant theme). Some other puzzles also had cute themes that didn't compromise the lower difficulty goal.

You'll notice though that I am the voter with the least interest in seeing these every month or even every quarter. Just as I liked the Screen Test when it was run a year ago, I felt that was something that could happen every year and be a welcome change from the usual. I view this kind of test the same way. I would not want a Sprint Test to replace the 2h tests we've been having every month, nor to add on a third monthly test if that is the alternate option. But I wouldn't mind it once or twice a year as a (literal) change of pace.

One side comment on scoring - we have consistently been granular on the order of minutes when it comes to bonus. I see no reason to not have fractional points to give the most correct accounting of relative performance (particularly when this test greeted me with my score of 986.252 which has excessive significance anyway). One side effect is with fractional bonus you will never have the rankings incorrectly sorted after a test which I seem to see this time around with Janka1 behind Spelvin despite earlier submission and onigame ahead of two others despite being in the same minute too. Order could change with refreshing, but it should certainly sort by score and then time. (I think the specific bug is sorting on last correct submission and not "claim bonus" time.)

Edited by motris 2011-09-05 8:21 AM
@ 2011-09-05 8:42 AM (#5524 - in reply to #5522) (#5524) Top

rakesh_rai




Posts: 774
500100100202020
Country : India

rakesh_rai posted @ 2011-09-05 8:42 AM

motris - 2011-09-05 8:18 AM

One side effect is with fractional bonus you will never have the rankings incorrectly sorted after a test which I seem to see this time around with Janka1 behind Spelvin despite earlier submission and onigame ahead of two others despite being in the same minute too. Order could change with refreshing, but it should certainly sort by score and then time. (I think the specific bug is sorting on last correct submission and not "claim bonus" time.)


I think its sorted based on "points + last correct submission time" currently. It should perhaps be changed to "points + claim time + last correct submission time". We are seeing this effect because of many claims this time (unlike earlier tests).
@ 2011-09-05 8:49 AM (#5525 - in reply to #5524) (#5525) Top

debmohanty




1000500100100100202020
Country : India

debmohanty posted @ 2011-09-05 8:49 AM

rakesh_rai - 2011-09-05 8:42 AM

motris - 2011-09-05 8:18 AM

One side effect is with fractional bonus you will never have the rankings incorrectly sorted after a test which I seem to see this time around with Janka1 behind Spelvin despite earlier submission and onigame ahead of two others despite being in the same minute too. Order could change with refreshing, but it should certainly sort by score and then time. (I think the specific bug is sorting on last correct submission and not "claim bonus" time.)


I think its sorted based on "points + last correct submission time" currently. It should perhaps be changed to "points + claim time + last correct submission time". We are seeing this effect because of many claims this time (unlike earlier tests).
Certainly a glitch there. Will fix that in a while.
@ 2011-09-05 9:44 AM (#5526 - in reply to #5455) (#5526) Top

debmohanty




1000500100100100202020
Country : India

debmohanty posted @ 2011-09-05 9:44 AM

Updated score page - http://logicmastersindia.com/M201109P/score.asp

skywalker > Janka1 > spelvin
ByronosaurusRex > S_Aoki > onigame

Also,
Para > tarotaro > ppeetteerr

Players with same scores but less than 14 puzzles correct are sorted by "Last Correct Submission" irrespective of "Claim Bonus Time"
@ 2011-09-05 9:50 AM (#5527 - in reply to #5522) (#5527) Top

debmohanty




1000500100100100202020
Country : India

debmohanty posted @ 2011-09-05 9:50 AM

motris - 2011-09-05 8:18 AM

spmcandrews - 2011-09-04 6:15 PM

Can I ask how I got 4 points out of 5 on Masyu? Was there partial credit somehow?


It looks like your answer was on the "accepted" list, but was not actually correct for the described answer mode. The solution should be 13,22, for lengths of line segments in the indicated rows, and your entry was 24,33 with consistent overcounting. So you got credit, but it counted as a typo for -20%.

It was not necessarily a typo, but was a misunderstanding of answer key. It was debatable whether it should be 100% or 80%. We had same problems in JPL as well (even though the authors had done a splendid job of explaining using an image)

In fact we had players who entered row A using one method, and row B using another method. So clearly, it is not a good answer key.

We should be using Method 4 described here for loop puzzles.
@ 2011-09-05 11:24 AM (#5529 - in reply to #5455) (#5529) Top

Valezius



Posts: 66
202020
Country : Hungary

Valezius posted @ 2011-09-05 11:24 AM

I dont understand this result.
As I see the score page, I think the target time column is totally pointless. If you delete it, then the order wont be change.

I thought before the test the target time is important. And I thought I will get points for my saved minutes from my target time. This would be logical.
@ 2011-09-05 11:41 AM (#5530 - in reply to #5529) (#5530) Top

debmohanty




1000500100100100202020
Country : India

debmohanty posted @ 2011-09-05 11:41 AM

kiwijam - 2011-09-04 6:53 AM

Will the Hall of Fame entries be based on how much better than the Target Time you achieved?
Sure we want to know who was fastest overall, but the same names are always seen on the podium.
Here is a rare chance for the normal puzzlers to achieve a small amount of glory! :)


Valezius - 2011-09-05 11:24 AM

I dont understand this result.
As I see the score page, I think the target time column is totally pointless. If you delete it, then the order wont be change.

I thought before the test the target time is important. And I thought I will get points for my saved minutes from my target time. This would be logical.


We had planned the Sprint test such that a 'lot' of players should be able to complete the whole set. That also meant top players will be completing the set much earlier. That is when we thought of adding a 'target time' for each player based on LMI ratings.

While giving bonus points based on 'target — achieved' certainly came across my mind, it was not done primarily because of reasons below.
1) There was no scientific / logical way to compute the target time. Rakesh had an interesting idea, but we stuck to a simple linear formula.
2) There are several new players who were playing first time. They didn't have a target time. For example onigame, Nilz
3) There are several players who have started to play at LMI recently (just 1 or 2 tests). Target time for them is clearly not accurate. For example murat, TiiT

In future Sprint Tests, it will be definitely interesting to fine tune target time. But I'm still now sure if we can give some points based on 'target — achieved' because of points 2 and 3 above.

And should there be penalty if target < achieved?
@ 2011-09-05 11:59 AM (#5531 - in reply to #5530) (#5531) Top

MellowMelon



100
Country : United States

MellowMelon posted @ 2011-09-05 11:59 AM

I am inclined to believe a serious usage of target time will not be worth much if you base it only on ratings (and I have no idea what else to base it on), for the same reason winning Under-X rating sections in chess tournaments is usually a matter of being significantly underrated. Even among players with established ratings, they can be in the process of improving, or others conversely may be a little rusty if they took a brief break from these tests. Either way their rating would not be the best reflection of their skill level.

To me the current system, where the target time is a recommendation with no impact on scores or rankings, seems to serve all the intended purposes well enough. One change that couldn't hurt is to have a separate unofficial ranking list with the best performers relative to their target time.
@ 2011-09-05 12:18 PM (#5532 - in reply to #5530) (#5532) Top

Valezius



Posts: 66
202020
Country : Hungary

Valezius posted @ 2011-09-05 12:18 PM

Naturally, I see the problems with "my" bonus system.
But in this test the target time hadnt function, and I hope it will have in the future :)

I dont have better idea than making an offical and unofficial result.
You can perform on offical list if you have at least 6 non-zero results before the Sprint test. And in this case the target time can be accurate.

I know, I disqualify many solvers, but if the LMI hold a Sprint test in every half year, than this isnt a big problem :)
@ 2011-09-05 12:41 PM (#5533 - in reply to #5531) (#5533) Top

vopani



Posts: 739
50010010020
Country : India

vopani posted @ 2011-09-05 12:41 PM

There will always be players who's rating does not reflect their capability, especially, those who play few tests, or those who are new-comers, like Deb mentioned. So, I would second Palmer's suggestion of having the target time just as a 'benchmark' for players, having no impact on scores. A list of best players relative to their target time would be an interesting read.

Also, regarding the frequency of these tests, it is certainly not feasible to have it once a month. Once a quarter sounds like a good regular event. It helps amateurs gain confidence and motivation throughout the year when there are simpler tests.
@ 2011-09-05 12:42 PM (#5534 - in reply to #5531) (#5534) Top

forcolin




Posts: 171
100202020
Country : ITALY

forcolin posted @ 2011-09-05 12:42 PM

I am one of the four players who submitted 15 solutions but did not claim the bonus.

well, I had 14 solutions and 6 minutes to go. Had I clicked on the CLAIM BONUS button I'd earned 18 points, but if I could solve the final puzzle I 'd earned 45 points, so I tried to do it, but unfortunately I didn't succeed. I submitted an asnwer but I noticed it was wrong so I kept trying (unsuccessfully) to solve te puzzle until the last minute (panic!!), so I got no points out of my last 6 minutes. If I (or another player) had only two or three minutes after puzzle #14, by hitting the CLAIM BONUS button would earn immediately 6 or 9 points. Motris may find this situation familiar because of what happened to him in Zilina. In the past the time bonus was calculated only on the basis of last submission time. Is the CLAIM BONUS button really necessary?

Also, I noticed that a player who did not hit the CLAIM BONUS button has not been awarded not only the time bonus, but also the 25 points for completing all the puzzle correctly, I believe this is unfair.

Apart from this, the puzzle set was good (I like particularly the FORTRESS), but in my opinion the puzzles were not exactly "EASY" as defined somewhere (I had a debate with Deb on a different forum). Easier than usual, OK; the contest was solvable in the 75 minutes time, OK, (although my target seemed to me unrealistic, other players of similar level have achieved it), but if the target was to attract new players I believe only a few 5 or 10 points diagrams were simple enough for beginners.

stefano

Edited by rakesh_rai 2011-09-05 2:08 PM
@ 2011-09-05 12:53 PM (#5535 - in reply to #5534) (#5535) Top

debmohanty




1000500100100100202020
Country : India

debmohanty posted @ 2011-09-05 12:53 PM

forcolin - 2011-09-05 12:42 PM

Also, I noticed that a player who did not hit the CLAIM BONUS button has not been awarded not only the time bonus, but also the 25 points for completing all the puzzle correctly, I believe this is unfair.
Yet another bug. Updated score page. Melvy gets 225.
@ 2011-09-05 2:08 PM (#5536 - in reply to #5455) (#5536) Top

rakesh_rai




Posts: 774
500100100202020
Country : India

rakesh_rai posted @ 2011-09-05 2:08 PM

forcolin - 2011-09-05 12:42 PM

...If I (or another player) had only two or three minutes after puzzle #14, by hitting the CLAIM BONUS button would earn immediately 6 or 9 points. Motris may find this situation familiar because of what happened to him in Zilina. In the past the time bonus was calculated only on the basis of last submission time. Is the CLAIM BONUS button really necessary?


As far as I understand this, players with 14 correct will be awarded a bonus ONLY IF they have genuinely attempted the fifteenth puzzle also, i.e., it is not a bonus for doing 14 puzzles, but only on submitting 15 puzzles (with one mistake). So by hitting the CLAIM BONUS, you may not immediately gain 6 or 9 points automatically.

However, as you said, the interface is simpler without the extra button.
@ 2011-09-05 10:41 PM (#5543 - in reply to #5534) (#5543) Top

motris



Posts: 199
10020202020
Country : United States

motris posted @ 2011-09-05 10:41 PM

forcolin - 2011-09-04 11:42 PM

I am one of the four players who submitted 15 solutions but did not claim the bonus.

well, I had 14 solutions and 6 minutes to go. Had I clicked on the CLAIM BONUS button I'd earned 18 points, but if I could solve the final puzzle I 'd earned 45 points, so I tried to do it, but unfortunately I didn't succeed. I submitted an asnwer but I noticed it was wrong so I kept trying (unsuccessfully) to solve te puzzle until the last minute (panic!!), so I got no points out of my last 6 minutes. If I (or another player) had only two or three minutes after puzzle #14, by hitting the CLAIM BONUS button would earn immediately 6 or 9 points. Motris may find this situation familiar because of what happened to him in Zilina. In the past the time bonus was calculated only on the basis of last submission time. Is the CLAIM BONUS button really necessary?

Also, I noticed that a player who did not hit the CLAIM BONUS button has not been awarded not only the time bonus, but also the 25 points for completing all the puzzle correctly, I believe this is unfair.
stefano


It doesn't sound to me that the system is broken in your case. You had 6 minutes to earn 45 points and chose to go for them instead of stopping early. (There was also the chance one of your 14 submissions was incorrect so you can not be sure you would even have gotten the 18 points for sure.)

When I've discussed "partial" bonus before, it has been in the context of having a reasonable but incorrect answer on the last puzzle. A blank submission would not count, and the administrators would judge whether to award it on a case-by-case basis. I believe this is the fairest way to do it, to sometimes award some points to early finishers (ie uvo) who made a mistake, but not so many that a solver would really benefit from stopping early and not trying to complete the test.

Having an end test button is also meant to allow someone who finishes early, for example 40 minutes early, to not have to spend the next 40 minutes constantly checking their work before seeing their score. It also exactly matches the WPC round/time bonus methodology of turning in your paper before you start your finish clock. That >90% of players (41 of 45) that could have claimed bonus did suggests the button generally works, particularly since the vast majority of those solvers ran into this situation for the first time.

Your last point is most important though. I agree that "claim bonus" should only affect time bonus points and not the 25 point overall bonus for being complete and correct. I do not recall if the instruction booklet was clear on this point, but I would view someone who took the last ~5 minutes to simply check their work and not turn in to be worth full marks and completion bonus whether here or on a WPC. They simply wouldn't get extra time/rank bonus.
@ 2011-09-05 10:45 PM (#5544 - in reply to #5543) (#5544) Top

motris



Posts: 199
10020202020
Country : United States

motris posted @ 2011-09-05 10:45 PM

motris - 2011-09-05 9:41 AM
Your last point is most important though. I agree that "claim bonus" should only affect time bonus points and not the 25 point overall bonus for being complete and correct. I do not recall if the instruction booklet was clear on this point, but I would view someone who took the last ~5 minutes to simply check their work and not turn in to be worth full marks and completion bonus whether here or on a WPC. They simply wouldn't get extra time/rank bonus.


And now reading the rest of the thread, I see that Deb has corrected the one instance where the 25 points was not rewarded. So I think this was an unintentional error and is certainly now fairly resolved.
@ 2011-09-06 4:45 AM (#5545 - in reply to #5455) (#5545) Top

Ours brun




Posts: 148
1002020
Country : France

Ours brun posted @ 2011-09-06 4:45 AM

Sorry for my very limited presence these days but I have been travelling all day yesterday and I will be again today, so here are just a few words ; I shall complete them later.

Firstly, many thanks to all the players who had a try at this test. Despite its shortness and facility, it really needed lots of work to make it fulfill our purposes as much as possible. The big participation, as well as all the positive feedbacks I got before, during and after the test are a great reward and make it largely worth the spent time.

Congratulations to Palmer, Thomas and Ko for topping the test with around 34' total time each, and to all the people who did their best to try to beat their target time.

motris

I really liked the test, particularly the page with the Star Battle (123 theme) and the Tapa below (with 1234 by quadrant theme). Some other puzzles also had cute themes that didn't compromise the lower difficulty goal.

I am glad you noticed the 4 quadrants theme on Tapa; I was slightly afraid no one would see it. For me it is one detail that makes the puzzle more than just a very easy tapa. But I will post some more comments about the puzzles themselves later.

motris

I would not want a Sprint Test to replace the 2h tests we've been having every month, nor to add on a third monthly test if that is the alternate option. But I wouldn't mind it once or twice a year as a (literal) change of pace.

About that : I voted for once a month, which is kinda dishonest since I would rather go for once in two months. What is sure is that I would clearly not want to see it replace the current monthly puzzle tests (which had never been the idea) and 3 different tests in a month would perhaps be too much indeed, in particular if we consider the fact that more and more sites are organizing puzzles/sudoku competitions. Anyway - my main desire is to have easier puzzle tests on a regular basis, even if it is only twice a year. The idea seems to seduce many players, which is the essential point. I now just hope we can work together to make it happen.

I abbreviate since I really need to sleep a bit.

Thank you all once again and see you quickly to pursue this discussion. I hope most of you, if not all, had fun; and before everything else, I hope newcomers found a sufficient interest in the test to consider participating in future puzzle competitions.
@ 2011-09-06 9:06 AM (#5547 - in reply to #5545) (#5547) Top

debmohanty




1000500100100100202020
Country : India

debmohanty posted @ 2011-09-06 9:06 AM

Ours brun - 2011-09-06 4:45 AM
motris

I would not want a Sprint Test to replace the 2h tests we've been having every month, nor to add on a third monthly test if that is the alternate option. But I wouldn't mind it once or twice a year as a (literal) change of pace.

About that : I voted for once a month, which is kinda dishonest since I would rather go for once in two months. What is sure is that I would clearly not want to see it replace the current monthly puzzle tests (which had never been the idea) and 3 different tests in a month would perhaps be too much indeed, in particular if we consider the fact that more and more sites are organizing puzzles/sudoku competitions. Anyway - my main desire is to have easier puzzle tests on a regular basis, even if it is only twice a year. The idea seems to seduce many players, which is the essential point. I now just hope we can work together to make it happen.


The idea of the poll was not to change the scheduling of LMI tests. We are certainly not going to add a 3rd monthly test, it is lot of work for us. Replacing the regular 2h test is obviously not an option.
At the same time, the polls suggests that it is interesting to have easy puzzle tests (e.g. Sampler Platter / FLIP / this test). We'll keep that in mind. It is always a difficult task to cater to all kind of solvers with much wide experience and expertise.
@ 2011-09-06 9:22 AM (#5548 - in reply to #5536) (#5548) Top

debmohanty




1000500100100100202020
Country : India

debmohanty posted @ 2011-09-06 9:22 AM

Regarding partial bonus :

Just to repeat what Rakesh and motris posted, partial bonus is not to encourage players to leave early, and get the time bonus. We expect players to be greedy and try to get as much points as possible. Also, the wrong puzzle will be manually checked to determine if the player has tried to solve it genuinely. It is some times difficult in a puzzle test, but I would assume that anyone with 10+ minutes bonus and a wrong answer has tried to solve the puzzle genuinely.

In the upcoming Sudoku test, we'll enforce a rule which requires player to have filled at least x correct cells of the 17 cells to be eligible for partial bonus.
@ 2011-09-06 12:20 PM (#5549 - in reply to #5455) (#5549) Top

gramar



Posts: 9

Country : United Kingdom

gramar posted @ 2011-09-06 12:20 PM

As a relatively new puzzler I would love to see some of the easy puzzle tests appear more frequently. I can see your dilemma. For many of the world class puzzlers on here, that would not present much of a challenge, but it would be great occasionally to see a competition aimed at people like myself who are keen (but quite slow!) puzzle solvers. I donlt imagine I could ever compete with the top solvers however hard I practised, but I would still find it fun to enter the competitions and try to beat my own scores etc. At the moment I find I am downloading quite a few of the puzzle booklets and then not submitting my score because it is too low to bother with! I then take away the booklets and do the puzles at leiisure when I can usually complete most of them in the end I have to say I really enjoy the challenge and variety of the puzzles in these tests because you get so bored with all the regular sudokus that appear in every magazine over here! I really enjoyed the Sprint test puzzles, but was just too slow to enter my results!

Just to say I really appreciate all the hard work everyone puts in here - it's a great site. Thank you.
@ 2011-09-06 2:55 PM (#5551 - in reply to #5455) (#5551) Top

Quela



Posts: 1

Country : ITALY

Quela posted @ 2011-09-06 2:55 PM

I'm a new puzzler and I have tried online puzzle test for the first time, with this Sprint Test. I have appreciate it so much !!
I agree with Gramar. If possible we need other session of puzzle for beginners.
I am slow too, never tried to solve puzzle with timer.
I agree with Forcolin too, about this test was not so "easy" for newbie. The time is not sufficient for who of us that have tried periodically some puzzle on magazines, considering that many of them never appeared on magazines, and the difficult is absolutely not easy for other of new puzzler that have never tried this kind of game, or done it too few time.

Anyway, I will exercise with past tests, and hope do better next time :)

Congratulation for your work !!
@ 2011-09-06 6:14 PM (#5552 - in reply to #5455) (#5552) Top

swaroop2011




Posts: 668
500100202020
Country : India

swaroop2011 posted @ 2011-09-06 6:14 PM

can anybody post the solution of horse snake (in form of image).
and how to solve the Galaxies puzzle (i am finding it hard to solve it)
Sprint Test — LMI Sep Puzzle Test — 3rd and 4th September80 posts • Page 2 of 4 • 1 2 3 4
Jump to forum :
Search this forum
Printer friendly version