Reg answer key mechanisms :

Kakuro and Different Neighbours - During my solve, I couldn't find any row / column / contiguous cells to be marked as answer key. (Kakuro for being so scattered solve and DN for being DN). When I shared the circled cells with one circle per column idea to Tom, he instantly agreed that this will be a cleaner approach. I just adopted the same for DN.

Zoltan was never a big fan of marking letters inside the grid for B&W Loop. I was not keen on marking "rows with longest length". I have been seeing how players are making mistakes in the longest length mechanism for a while now. It was my decision to mark letters inside the grid, rather than arrows outside the grid - based on this poll results - http://logicmastersindia.com/forum/forums/thread-view.asp?tid=358
Yes, for a big grid, it is not an easy key, but the other way I looked at it, when you are trying to find the answer key, and you don't visit some letters, that means you definitely have a mistake in the solve.

We discussed about some potential scoring systems. I'm attaching the individual solving times (in excel form) so that it will be easier to do any kind of simulations.
For example : bonus should be given only to players with solving time < 30 minutes + best time is captured in the excel.

Link : http://logicmastersindia.com/M201201P/MarathonSolvingTimes.xlsx

Edited by debmohanty 2012-01-30 10:50 AM

For Snake, it was a problem. I found many players submitting "longest black cells", not "longest snake part".
I decided not to penalize players for making this answer key misunderstanding, but their bonus was not adjusted.

That reminds me to add a note that, during Decathlon we put lot of effort to make sure that all possible answer keys are captured in the system (e.g. row / column swaps). I didn't have to do similar effort in this case because of "single puzzle" submission mechanism.

All puzzles are pinned and uploaded as a single pdf without password here

Thanks to all who participated, and to Deb for allowing me to contribute a puzzle and design the logo for this test.

If you have an account on my blog, The Griddle, and solved my braille word search in this test, enter the two missing words in your code entry page to unlock the new "Run For Your Life!" badge: http://thegriddle.net/home/badges/18

I noticed that some of the authors have participated as players too. They have been awarded an arbitrary 100 points for the puzzle they provided. I believe this is penalizing. In a competition in which the difference between players is given by the bonuses (which is good, and is the strongest point of this beautiful competition), it is equivalent to deny them the opportunity to earn a bonus in the puzzle they provided (for which they are supposed to be strong solvers too...). In my opinion it could be fair to award the author of a puzzle a bonus score equivalent to the average of their bonus scores obtained in the remaining puzzles solved (including zeroes, if any).

I agree that 100 points is not fair to all authors (it was not arbitrary though, 100 was assigned based on the assumption that an author should be able to solve his puzzles, and we just took the worst case scenario where there is no bonus). So, yeah, it is bit harsh.

In fact we started "best 9 of 10" to handle authors' cases. But later, 9 of 10 turned out to be very essential for this kind of contest even otherwise. So, we can give some bonus points based on forcolin's formula above. Or, we can say for authors, it should be best 8 of 9, and then multiply the score by 9/8.

Is it a good idea to have an option where a player can choose if he/she needs a hint to solve a puzzle at the cost of some X points depending on the time lapsed from the start of puzzle along with reduced bonus system (if applicable) ?
This might help few solvers to have the satisfaction of solving all the puzzles and create more interest in puzzles.

Regards,
Ravi

Can we make mine best 4 of 9 for this one and then multiply?

Anyway, on a serious note, I personally was fine with this format because I considered it a bonus in itself to co-author and participate in the same test. However, if everyone feels that what Stefano or Deb have suggested is fine to implement next time, then all the better!

I was surprised to be fastest on 2 puzzles. I don't generally top lists. As Palmer said he didn't finish any puzzle fastest in the playoffs, I didn't score any top 3 spots in any round, but still finished 5th overall after 2 days on the WPC before the playoffs.
I'm also surprised a bit to be in the top 5 as I've never considered myself good at solving big puzzles on speed. I usually make too many mistakes. It was fun, but I think I would have done better on the Samurai and Graffiti Snake if I had solved them in a row with the other 8 puzzles. I hasn't realised when I started all 10 puzzle types weren't listed to be honest. Will remember that for next time.

I think the scoring probably works better with a distance from the top time system. It seems a bit weird to be the fastest solver in a type and have to drop that puzzle.

Now that the full puzzle booklet is available, I am finding that it crashes my Adobe within a few seconds of opening it. Can we get individual puzzle versions?

Cyclone

Individual puzzle booklets without password uploaded at http://logicmastersindia.com/M201201P/

It doesn't make sense to me. It also is very impractical.

macherlakumar: I see some use in having easier puzzles available for people to try and to get started with, but to implement them in a test here is impractical, and this really doesn't seem the place for it. If there are any types that anyone wants to start on but where some simpler puzzles are needed, I strongly suggest contacting some puzzle authors in the community and requesting them. Speaking for myself, I'm happy to take requests, and many others in the community probably would be at least somewhat accommodating too.

Yes you are right I did not think through this thoroughly.

Regards,
Ravi

Time for some statistics -

Number of Puzzles Vs Starts / Finishes / Bonus

It is extremely pleasing to see that 124 players finished all 10 puzzles.
Also, on an average (of 259 players who submitted at least 1 puzzle), a player finished 7.4 puzzles.


And because of the interesting bonus system, here is how the 20th / 50th score compared against the top score.

From the feedback page :



There is a bit of story behind Graffiti Snake. The first version of IB had "Paint By Number". We wanted to include PNB because, as per Rohan's word, PNB is king of big puzzles. But before I asked Serkan to make PNB, I suggested that he should make a Graffiti Snake instead. (I get 1% credit for selecting the type, and Serkan gets 99% credit for making a beautiful puzzle)




Next 3 sets of graphs pretty much suggest that the corresponding aspects of the test were close to perfect.












Many players voted that they would use Online solving if provided. We will try to provide that next time, but no promises. We face enough issues while supporting both online and paper for Sudoku tests.




Of 149 players, 144 players voted that they would participate in future marathons, either as player or as player + author.

I found a technical issue at the result page(score.asp)
... columns of each puzzle are sorted improperly when they are displayed in 'Points'(not 'Submission Time').

They are to be sorted in numerical order(like 'Points' and 'Bonus' columns),
but they are sorted in character-based(ASCII) order ...

# I remember that some of them were correctly sorted a few days ago.

I'd really appreciate someone giving a break down of an entry point into Different Numbers - I really struggle with these and got absolutely nowhere with this particualr one.

And Serkan (Different Neighbours)

Why did I have to wait till someone point me that?

There is cheeky start to the Different Neighbours at the top right corner.
Note that X has to be 1 or 2, otherwise the top right is not solvable uniquely.

Then transferring the 4 we get that the 2X2 cell can only be 3.

Who are the test solvers ? I am not sure if it is mentioned somewhere and I missed it or it is not mentioned anywhere.

Regards,
Ravi

Oops... I didn't mention anywhere.
We had 3 live-testers this time - Branko, Prasanna and Rohan. While everyone else had 9 days to solve the puzzles at their own comfort timings, these guys had to solve all puzzles within two days time. Fortunately, we didn't find any issues during their solving and their scores remained official.

Yes, that is a bug. Too late to fix though

I have done some analysis of the score and bonus system.

First of all, in my opinion the scoring system in this contest was very good because every player had a realistic possibility of gaining bonuses on most puzzles, which means that the rank is very close to the sum of the times obtained in the individual puzzles. There is an exception, the Samurai Sudoku which was much more difficult than the remaining puzzles, and in which only 20 players were awarded bonus points, and which even the best solver (motris) had to drop as his worst result.

Overall, the number of players gaining a bonus was 1108 out of 1927 (57.5%), relatively high, and this is the distribution among the various puzzles.




If we consider the percentage of players which gained a bonus as a measure of the difficulty of the puzzle, we must conclude that the easiest of the puzzle was the Braille wordsearch, with 84% of the submissions gaining a bonus. This was originally indicated as an AVERAGE puzzle. Which means that an attempt to allocate different times (or different bonus thresholds) to puzzle of different difficulties as proposed by detuned, may be affected by wrong evaluation of the difficulty.

I have also analysed the proposal of awarding bonuses only to those players completing a puzzle within a fixed time (30 minutes) from the top solver. The total number of players earning a bonus in this case would be of 786, 40.8%, and the distribution is the following.



In my personal opinion, this system would be much worse. Not only the peculiarity of the Samurai sudoku is not solved (of course, 30 minutes margin on a very though puzzle means much less for a tough puzzle than for an easy one) but the total number of bonusus decreases dramatically, punishing the players earning 10-15 points with a solution time between 40 and 50 minutes. Overall, almost 350 submissions would earn no bonus at all, and this would be concentrated in the middle category solvers. Also, for those players, the average bonus would be reduced therefore the score would privilege a player with a very good time in just one puzzle against a player with decent times overall, and I do not think this is (or should be) the target of this competition.


I have tried to develop a different system. This is based on assigning to the top solver a bonus of, say, 50 points, to define a bonus threshold to n times the time of the top solver, and to calculate the bonus by linear interpolation between these two values. I have prepared 3 scenarios, with n= 4, 5 and 6 respectively. Which means that a player would earn a bonus if his/her time was 4, 5 or 6 times the time of the best solver, or better.


The following distributions are obtained








The total number of bonus scores is 905 (46.9%) for n=4, 1118 (58%) for n=5 and 1275 (66%) for n=6.

All these calculations give a better distribution of the scores among the puzzles, (the number of players earning a bonus on the samurai is now comparable to the other puzzles) and the situation which better approaches the system adopted is for n=5. Of course this system would give different results in terms of final ranking, benefitting mainly those players which had a good time on the Samurai, but not good enough to gain a bonus on it.

The negative consequence is that, with the system adopted for this competition, it was clear that after one hour from starting a player could put the puzzle in a corner to solve it the next day. With this system it could be possible (except for the very first player to start a puzzle) to show a “current bonus threshold” as an indication about when a player could give up, and also as an indication of the level of difficulty of the puzzle as required by Puzzlescot, but this indication may change with the time, as strong players will set up best times.


Overall, I think that the system adopted for Marathon number one has the advantage of being simple, and could be adopted again without variation if only the organizers will avoid to use puzzles with a remarkable difference in difficulty, such as the Samurai Sudoku. If a new system has to be adopted, a calculation based on a bonus threshold of minimum 5 or 6 times the time of the best solver can be an improvement and could allow to use puzzles of different level of difficulty, but I am convinced that very difficult puzzles requiring the average solver much more than an hour to be solved, should be avoided for practical reasons.


Excel Analysis : http://logicmastersindia.com/M201201P/MarathonSolvingTimes_forcolin...