PR 2024 R2 - Loops & Numbers (23rd - 29th Feb) Score Discuss
SM 2024 R2 - Odd Even & Hybrids (8th - 14th Mar) Score Discuss
Sprint Test — LMI Sep Puzzle Test — 3rd and 4th September80 posts • Page 2 of 4 • 1 2 3 4
How frequently you would want to see Sprint tests at LMI?
The aim of the Sprint test is to have relatively easier and less number of puzzles so that many more players can complete the full set. Please let us know if we should have more Sprint tests at LMI.
OptionResults
Once in a month22 Votes - [47.83%]
Once in a quarter18 Votes - [39.13%]
Once in 6 months5 Votes - [10.87%]
Once in a year1 Votes - [2.17%]
Never. This should be the last Sprint Test.0 Votes - [0%]
View Results

@ 2011-09-03 8:28 PM (#5511 - in reply to #5510) (#5511) Top

debmohanty




1000500100100100202020
Country : India

debmohanty posted @ 2011-09-03 8:28 PM

pribaros - 2011-09-03 8:19 PM

i dont see the password and Pdf can not open, anyone knows? (my time is started, immediate pleasee :) )

The password is shown below the timer. If you still can't see the password, send me a message


@ 2011-09-03 8:31 PM (#5512 - in reply to #5511) (#5512) Top

pribaros



Posts: 2

Country : Turkey

pribaros posted @ 2011-09-03 8:31 PM

ahh sooo, ok i see thanx for reply
@ 2011-09-03 9:24 PM (#5514 - in reply to #5502) (#5514) Top

Administrator



2000100050020
Country : India

Administrator posted @ 2011-09-03 9:24 PM

Administrator - 2011-09-03 6:15 AM

As usual, please use the score page to settle all claims
All claims will be looked into. Sometimes, it might take a while.
Please check your forum inbox for updates.
@ 2011-09-04 6:53 AM (#5516 - in reply to #5455) (#5516) Top

kiwijam



Posts: 181
10020202020
Country : New Zealand

kiwijam posted @ 2011-09-04 6:53 AM

Will the Hall of Fame entries be based on how much better than the Target Time you achieved?
Sure we want to know who was fastest overall, but the same names are always seen on the podium.
Here is a rare chance for the normal puzzlers to achieve a small amount of glory! :)
@ 2011-09-04 11:36 PM (#5517 - in reply to #5455) (#5517) Top

motris



Posts: 199
10020202020
Country : United States

motris posted @ 2011-09-04 11:36 PM

My pulse is racing more than on any other test. Waiting till the end to do all the typing didn't help. Many good designs and definitely "sprint" was the captured feel. Thanks Bastien!
@ 2011-09-05 12:59 AM (#5518 - in reply to #5517) (#5518) Top

MellowMelon



100
Country : United States

MellowMelon posted @ 2011-09-05 12:59 AM

Yeah, I can concur with having the pulse racing. Although here, that took the place of the huge amount of sweat I've started to feel all over me after finishing a 90+ minute test.
@ 2011-09-05 6:25 AM (#5519 - in reply to #5455) (#5519) Top

debmohanty




1000500100100100202020
Country : India

debmohanty posted @ 2011-09-05 6:25 AM

With no one participating now, Sprint test is over. MellowMelon (33:51), motris (34:05), xevs (37:48) take the top 3 positions. Their timings are extremely close (note that xevs took 3.5 minutes to recheck all answers before hitting 'Claim Bonus'). All of them and 3 more in top 10 are well ahead of their 'target' time.

Thank you everyone for participating and for voting in the poll. It is important for us to know what everyone expects.

Some stats :
Total number of participants : 264
Number of non-zero scores : 210
Number of players claiming bonus : 41
Number of players getting bonus : 36
Number of players submitting all 15, but not claiming bonus : 4
Number of players with all 15 correct: 29
Number of players with 14 correct: 19

Median Score : 110

@ 2011-09-05 6:36 AM (#5520 - in reply to #5455) (#5520) Top

debmohanty




1000500100100100202020
Country : India

debmohanty posted @ 2011-09-05 6:36 AM

Please post any feedback you might have regarding the test
  • Length of the test
  • Difficulty of puzzles
  • Complexity of puzzles
  • Number of puzzles
Bastien will share his thoughts some time later in the day.
@ 2011-09-05 7:15 AM (#5521 - in reply to #5455) (#5521) Top

spmcandrews



Posts: 1

Country : United States

spmcandrews posted @ 2011-09-05 7:15 AM

Can I ask how I got 4 points out of 5 on Masyu? Was there partial credit somehow?
@ 2011-09-05 8:18 AM (#5522 - in reply to #5521) (#5522) Top

motris



Posts: 199
10020202020
Country : United States

motris posted @ 2011-09-05 8:18 AM

spmcandrews - 2011-09-04 6:15 PM

Can I ask how I got 4 points out of 5 on Masyu? Was there partial credit somehow?


It looks like your answer was on the "accepted" list, but was not actually correct for the described answer mode. The solution should be 13,22, for lengths of line segments in the indicated rows, and your entry was 24,33 with consistent overcounting. So you got credit, but it counted as a typo for -20%.


------------------
I really liked the test, particularly the page with the Star Battle (123 theme) and the Tapa below (with 1234 by quadrant theme). Some other puzzles also had cute themes that didn't compromise the lower difficulty goal.

You'll notice though that I am the voter with the least interest in seeing these every month or even every quarter. Just as I liked the Screen Test when it was run a year ago, I felt that was something that could happen every year and be a welcome change from the usual. I view this kind of test the same way. I would not want a Sprint Test to replace the 2h tests we've been having every month, nor to add on a third monthly test if that is the alternate option. But I wouldn't mind it once or twice a year as a (literal) change of pace.

One side comment on scoring - we have consistently been granular on the order of minutes when it comes to bonus. I see no reason to not have fractional points to give the most correct accounting of relative performance (particularly when this test greeted me with my score of 986.252 which has excessive significance anyway). One side effect is with fractional bonus you will never have the rankings incorrectly sorted after a test which I seem to see this time around with Janka1 behind Spelvin despite earlier submission and onigame ahead of two others despite being in the same minute too. Order could change with refreshing, but it should certainly sort by score and then time. (I think the specific bug is sorting on last correct submission and not "claim bonus" time.)

Edited by motris 2011-09-05 8:21 AM
@ 2011-09-05 8:42 AM (#5524 - in reply to #5522) (#5524) Top

rakesh_rai




Posts: 774
500100100202020
Country : India

rakesh_rai posted @ 2011-09-05 8:42 AM

motris - 2011-09-05 8:18 AM

One side effect is with fractional bonus you will never have the rankings incorrectly sorted after a test which I seem to see this time around with Janka1 behind Spelvin despite earlier submission and onigame ahead of two others despite being in the same minute too. Order could change with refreshing, but it should certainly sort by score and then time. (I think the specific bug is sorting on last correct submission and not "claim bonus" time.)


I think its sorted based on "points + last correct submission time" currently. It should perhaps be changed to "points + claim time + last correct submission time". We are seeing this effect because of many claims this time (unlike earlier tests).
@ 2011-09-05 8:49 AM (#5525 - in reply to #5524) (#5525) Top

debmohanty




1000500100100100202020
Country : India

debmohanty posted @ 2011-09-05 8:49 AM

rakesh_rai - 2011-09-05 8:42 AM

motris - 2011-09-05 8:18 AM

One side effect is with fractional bonus you will never have the rankings incorrectly sorted after a test which I seem to see this time around with Janka1 behind Spelvin despite earlier submission and onigame ahead of two others despite being in the same minute too. Order could change with refreshing, but it should certainly sort by score and then time. (I think the specific bug is sorting on last correct submission and not "claim bonus" time.)


I think its sorted based on "points + last correct submission time" currently. It should perhaps be changed to "points + claim time + last correct submission time". We are seeing this effect because of many claims this time (unlike earlier tests).
Certainly a glitch there. Will fix that in a while.
@ 2011-09-05 9:44 AM (#5526 - in reply to #5455) (#5526) Top

debmohanty




1000500100100100202020
Country : India

debmohanty posted @ 2011-09-05 9:44 AM

Updated score page - http://logicmastersindia.com/M201109P/score.asp

skywalker > Janka1 > spelvin
ByronosaurusRex > S_Aoki > onigame

Also,
Para > tarotaro > ppeetteerr

Players with same scores but less than 14 puzzles correct are sorted by "Last Correct Submission" irrespective of "Claim Bonus Time"
@ 2011-09-05 9:50 AM (#5527 - in reply to #5522) (#5527) Top

debmohanty




1000500100100100202020
Country : India

debmohanty posted @ 2011-09-05 9:50 AM

motris - 2011-09-05 8:18 AM

spmcandrews - 2011-09-04 6:15 PM

Can I ask how I got 4 points out of 5 on Masyu? Was there partial credit somehow?


It looks like your answer was on the "accepted" list, but was not actually correct for the described answer mode. The solution should be 13,22, for lengths of line segments in the indicated rows, and your entry was 24,33 with consistent overcounting. So you got credit, but it counted as a typo for -20%.

It was not necessarily a typo, but was a misunderstanding of answer key. It was debatable whether it should be 100% or 80%. We had same problems in JPL as well (even though the authors had done a splendid job of explaining using an image)

In fact we had players who entered row A using one method, and row B using another method. So clearly, it is not a good answer key.

We should be using Method 4 described here for loop puzzles.
@ 2011-09-05 11:24 AM (#5529 - in reply to #5455) (#5529) Top

Valezius



Posts: 66
202020
Country : Hungary

Valezius posted @ 2011-09-05 11:24 AM

I dont understand this result.
As I see the score page, I think the target time column is totally pointless. If you delete it, then the order wont be change.

I thought before the test the target time is important. And I thought I will get points for my saved minutes from my target time. This would be logical.
@ 2011-09-05 11:41 AM (#5530 - in reply to #5529) (#5530) Top

debmohanty




1000500100100100202020
Country : India

debmohanty posted @ 2011-09-05 11:41 AM

kiwijam - 2011-09-04 6:53 AM

Will the Hall of Fame entries be based on how much better than the Target Time you achieved?
Sure we want to know who was fastest overall, but the same names are always seen on the podium.
Here is a rare chance for the normal puzzlers to achieve a small amount of glory! :)


Valezius - 2011-09-05 11:24 AM

I dont understand this result.
As I see the score page, I think the target time column is totally pointless. If you delete it, then the order wont be change.

I thought before the test the target time is important. And I thought I will get points for my saved minutes from my target time. This would be logical.


We had planned the Sprint test such that a 'lot' of players should be able to complete the whole set. That also meant top players will be completing the set much earlier. That is when we thought of adding a 'target time' for each player based on LMI ratings.

While giving bonus points based on 'target — achieved' certainly came across my mind, it was not done primarily because of reasons below.
1) There was no scientific / logical way to compute the target time. Rakesh had an interesting idea, but we stuck to a simple linear formula.
2) There are several new players who were playing first time. They didn't have a target time. For example onigame, Nilz
3) There are several players who have started to play at LMI recently (just 1 or 2 tests). Target time for them is clearly not accurate. For example murat, TiiT

In future Sprint Tests, it will be definitely interesting to fine tune target time. But I'm still now sure if we can give some points based on 'target — achieved' because of points 2 and 3 above.

And should there be penalty if target < achieved?
@ 2011-09-05 11:59 AM (#5531 - in reply to #5530) (#5531) Top

MellowMelon



100
Country : United States

MellowMelon posted @ 2011-09-05 11:59 AM

I am inclined to believe a serious usage of target time will not be worth much if you base it only on ratings (and I have no idea what else to base it on), for the same reason winning Under-X rating sections in chess tournaments is usually a matter of being significantly underrated. Even among players with established ratings, they can be in the process of improving, or others conversely may be a little rusty if they took a brief break from these tests. Either way their rating would not be the best reflection of their skill level.

To me the current system, where the target time is a recommendation with no impact on scores or rankings, seems to serve all the intended purposes well enough. One change that couldn't hurt is to have a separate unofficial ranking list with the best performers relative to their target time.
@ 2011-09-05 12:18 PM (#5532 - in reply to #5530) (#5532) Top

Valezius



Posts: 66
202020
Country : Hungary

Valezius posted @ 2011-09-05 12:18 PM

Naturally, I see the problems with "my" bonus system.
But in this test the target time hadnt function, and I hope it will have in the future :)

I dont have better idea than making an offical and unofficial result.
You can perform on offical list if you have at least 6 non-zero results before the Sprint test. And in this case the target time can be accurate.

I know, I disqualify many solvers, but if the LMI hold a Sprint test in every half year, than this isnt a big problem :)
@ 2011-09-05 12:41 PM (#5533 - in reply to #5531) (#5533) Top

vopani



Posts: 739
50010010020
Country : India

vopani posted @ 2011-09-05 12:41 PM

There will always be players who's rating does not reflect their capability, especially, those who play few tests, or those who are new-comers, like Deb mentioned. So, I would second Palmer's suggestion of having the target time just as a 'benchmark' for players, having no impact on scores. A list of best players relative to their target time would be an interesting read.

Also, regarding the frequency of these tests, it is certainly not feasible to have it once a month. Once a quarter sounds like a good regular event. It helps amateurs gain confidence and motivation throughout the year when there are simpler tests.
@ 2011-09-05 12:42 PM (#5534 - in reply to #5531) (#5534) Top

forcolin




Posts: 171
100202020
Country : ITALY

forcolin posted @ 2011-09-05 12:42 PM

I am one of the four players who submitted 15 solutions but did not claim the bonus.

well, I had 14 solutions and 6 minutes to go. Had I clicked on the CLAIM BONUS button I'd earned 18 points, but if I could solve the final puzzle I 'd earned 45 points, so I tried to do it, but unfortunately I didn't succeed. I submitted an asnwer but I noticed it was wrong so I kept trying (unsuccessfully) to solve te puzzle until the last minute (panic!!), so I got no points out of my last 6 minutes. If I (or another player) had only two or three minutes after puzzle #14, by hitting the CLAIM BONUS button would earn immediately 6 or 9 points. Motris may find this situation familiar because of what happened to him in Zilina. In the past the time bonus was calculated only on the basis of last submission time. Is the CLAIM BONUS button really necessary?

Also, I noticed that a player who did not hit the CLAIM BONUS button has not been awarded not only the time bonus, but also the 25 points for completing all the puzzle correctly, I believe this is unfair.

Apart from this, the puzzle set was good (I like particularly the FORTRESS), but in my opinion the puzzles were not exactly "EASY" as defined somewhere (I had a debate with Deb on a different forum). Easier than usual, OK; the contest was solvable in the 75 minutes time, OK, (although my target seemed to me unrealistic, other players of similar level have achieved it), but if the target was to attract new players I believe only a few 5 or 10 points diagrams were simple enough for beginners.

stefano

Edited by rakesh_rai 2011-09-05 2:08 PM
@ 2011-09-05 12:53 PM (#5535 - in reply to #5534) (#5535) Top

debmohanty




1000500100100100202020
Country : India

debmohanty posted @ 2011-09-05 12:53 PM

forcolin - 2011-09-05 12:42 PM

Also, I noticed that a player who did not hit the CLAIM BONUS button has not been awarded not only the time bonus, but also the 25 points for completing all the puzzle correctly, I believe this is unfair.
Yet another bug. Updated score page. Melvy gets 225.
@ 2011-09-05 2:08 PM (#5536 - in reply to #5455) (#5536) Top

rakesh_rai




Posts: 774
500100100202020
Country : India

rakesh_rai posted @ 2011-09-05 2:08 PM

forcolin - 2011-09-05 12:42 PM

...If I (or another player) had only two or three minutes after puzzle #14, by hitting the CLAIM BONUS button would earn immediately 6 or 9 points. Motris may find this situation familiar because of what happened to him in Zilina. In the past the time bonus was calculated only on the basis of last submission time. Is the CLAIM BONUS button really necessary?


As far as I understand this, players with 14 correct will be awarded a bonus ONLY IF they have genuinely attempted the fifteenth puzzle also, i.e., it is not a bonus for doing 14 puzzles, but only on submitting 15 puzzles (with one mistake). So by hitting the CLAIM BONUS, you may not immediately gain 6 or 9 points automatically.

However, as you said, the interface is simpler without the extra button.
@ 2011-09-05 10:41 PM (#5543 - in reply to #5534) (#5543) Top

motris



Posts: 199
10020202020
Country : United States

motris posted @ 2011-09-05 10:41 PM

forcolin - 2011-09-04 11:42 PM

I am one of the four players who submitted 15 solutions but did not claim the bonus.

well, I had 14 solutions and 6 minutes to go. Had I clicked on the CLAIM BONUS button I'd earned 18 points, but if I could solve the final puzzle I 'd earned 45 points, so I tried to do it, but unfortunately I didn't succeed. I submitted an asnwer but I noticed it was wrong so I kept trying (unsuccessfully) to solve te puzzle until the last minute (panic!!), so I got no points out of my last 6 minutes. If I (or another player) had only two or three minutes after puzzle #14, by hitting the CLAIM BONUS button would earn immediately 6 or 9 points. Motris may find this situation familiar because of what happened to him in Zilina. In the past the time bonus was calculated only on the basis of last submission time. Is the CLAIM BONUS button really necessary?

Also, I noticed that a player who did not hit the CLAIM BONUS button has not been awarded not only the time bonus, but also the 25 points for completing all the puzzle correctly, I believe this is unfair.
stefano


It doesn't sound to me that the system is broken in your case. You had 6 minutes to earn 45 points and chose to go for them instead of stopping early. (There was also the chance one of your 14 submissions was incorrect so you can not be sure you would even have gotten the 18 points for sure.)

When I've discussed "partial" bonus before, it has been in the context of having a reasonable but incorrect answer on the last puzzle. A blank submission would not count, and the administrators would judge whether to award it on a case-by-case basis. I believe this is the fairest way to do it, to sometimes award some points to early finishers (ie uvo) who made a mistake, but not so many that a solver would really benefit from stopping early and not trying to complete the test.

Having an end test button is also meant to allow someone who finishes early, for example 40 minutes early, to not have to spend the next 40 minutes constantly checking their work before seeing their score. It also exactly matches the WPC round/time bonus methodology of turning in your paper before you start your finish clock. That >90% of players (41 of 45) that could have claimed bonus did suggests the button generally works, particularly since the vast majority of those solvers ran into this situation for the first time.

Your last point is most important though. I agree that "claim bonus" should only affect time bonus points and not the 25 point overall bonus for being complete and correct. I do not recall if the instruction booklet was clear on this point, but I would view someone who took the last ~5 minutes to simply check their work and not turn in to be worth full marks and completion bonus whether here or on a WPC. They simply wouldn't get extra time/rank bonus.
@ 2011-09-05 10:45 PM (#5544 - in reply to #5543) (#5544) Top

motris



Posts: 199
10020202020
Country : United States

motris posted @ 2011-09-05 10:45 PM

motris - 2011-09-05 9:41 AM
Your last point is most important though. I agree that "claim bonus" should only affect time bonus points and not the 25 point overall bonus for being complete and correct. I do not recall if the instruction booklet was clear on this point, but I would view someone who took the last ~5 minutes to simply check their work and not turn in to be worth full marks and completion bonus whether here or on a WPC. They simply wouldn't get extra time/rank bonus.


And now reading the rest of the thread, I see that Deb has corrected the one instance where the 25 points was not rewarded. So I think this was an unintentional error and is certainly now fairly resolved.
@ 2011-09-06 4:45 AM (#5545 - in reply to #5455) (#5545) Top

Ours brun




Posts: 148
1002020
Country : France

Ours brun posted @ 2011-09-06 4:45 AM

Sorry for my very limited presence these days but I have been travelling all day yesterday and I will be again today, so here are just a few words ; I shall complete them later.

Firstly, many thanks to all the players who had a try at this test. Despite its shortness and facility, it really needed lots of work to make it fulfill our purposes as much as possible. The big participation, as well as all the positive feedbacks I got before, during and after the test are a great reward and make it largely worth the spent time.

Congratulations to Palmer, Thomas and Ko for topping the test with around 34' total time each, and to all the people who did their best to try to beat their target time.

motris

I really liked the test, particularly the page with the Star Battle (123 theme) and the Tapa below (with 1234 by quadrant theme). Some other puzzles also had cute themes that didn't compromise the lower difficulty goal.

I am glad you noticed the 4 quadrants theme on Tapa; I was slightly afraid no one would see it. For me it is one detail that makes the puzzle more than just a very easy tapa. But I will post some more comments about the puzzles themselves later.

motris

I would not want a Sprint Test to replace the 2h tests we've been having every month, nor to add on a third monthly test if that is the alternate option. But I wouldn't mind it once or twice a year as a (literal) change of pace.

About that : I voted for once a month, which is kinda dishonest since I would rather go for once in two months. What is sure is that I would clearly not want to see it replace the current monthly puzzle tests (which had never been the idea) and 3 different tests in a month would perhaps be too much indeed, in particular if we consider the fact that more and more sites are organizing puzzles/sudoku competitions. Anyway - my main desire is to have easier puzzle tests on a regular basis, even if it is only twice a year. The idea seems to seduce many players, which is the essential point. I now just hope we can work together to make it happen.

I abbreviate since I really need to sleep a bit.

Thank you all once again and see you quickly to pursue this discussion. I hope most of you, if not all, had fun; and before everything else, I hope newcomers found a sufficient interest in the test to consider participating in future puzzle competitions.
Sprint Test — LMI Sep Puzzle Test — 3rd and 4th September80 posts • Page 2 of 4 • 1 2 3 4
Jump to forum :
Search this forum
Printer friendly version