Judging panel results

[appel]

The results have been published.

I must apologize for the delay, I disappeared for a few days because I was on a conference in London and had problem doing any work online. And the judges required a deadline extension. Unfortunately, princec did not deliver and so we only have 3 judges then, and that is all good.

See results:
Grades
Reviews

[ra4king]

Thanks for the reviews!

[appel]

Thanks to all contestants for participating and congratulations to ALL the winners

Games published by our own members! Check 'em out!

[kappa]

oh interesting how some of the judging results are so close to each other

btw something looks odd about the java4k judging grades e.g. Simple4k got a grade of 2.3% but was reviewed by the judges as 36%,38%,39%

[pjt33]

oh interesting how some of the judging results are so close to each other

btw something looks odd about the java4k judging grades e.g. Simple4k got a grade of 2.3% but was reviewed by the judges as 36%,38%,39%

The scores must be normalised to the full range 0%-100%.

I don't know what two of you guys were thinking when you rated my game above 4Kanabalt, but thanks!

PS Appel, I expect it's your busy schedule, but in case it's forgetfulness instead: the community voting page still has "Review not ready" for all the games.

[appel]

PS Appel, I expect it's your busy schedule, but in case it's forgetfulness instead: the community voting page still has "Review not ready" for all the games.

Fixed.

Yes, the normalization method gives a weird result for Simple4k. I don't believe it deserves such a low score. But nothing we can do about it now. I hope Gavin doesn't get too offended. :\ Just check the judges actual score because that's a more accurate representation.

The results are interesting, both community and judges consider 4Kube3D to be a winner, and that's great. Then the order changes totally almost, clearly difficult year to compare games.

[Riven]

oh interesting how some of the judging results are so close to each other

btw something looks odd about the java4k judging grades e.g. Simple4k got a grade of 2.3% but was reviewed by the judges as 36%,38%,39%

The scores must be normalised to the full range 0%-100%.

I agree, you should / must simply take the average.

Thanks for the effort of publishing the results! (I have no idea how much work it is )

[appel]

Hey wow, what are these medals?  I feel like a winner!!!

How do these medals work? How do I give someone a medal?

[Riven]

Hey wow, what are these medals?  I feel like a winner!!!

How do these medals work? How do I give someone a medal?

It's just a side effect of the (reworked) appreciation feature!
http://www.java-gaming.org/topics/new-feature-appreciation-results-in-post-medals/24011/view.html

[pjt33]

The results are interesting, both community and judges consider 4Kube3D to be a winner, and that's great. Then the order changes totally almost, clearly difficult year to compare games.

Yes and no. No because the Pearson rank correlation coefficient between the overall judges' score and the community vote is 0.75, which is only a hair below what it was last year (0.78). Yes because the correlations between the judges this year are much lower than last year (0.32, 0.59 and 0.52 this year vs 0.65, 0.45 and 0.57 last year).

Games published by our own members! Check 'em out!

[Riven]

You mean the correlation per judge with the community votes?

e.g.
correlation judge A and community: 0.32
correlation judge B and community: 0.59
correlation judge C and community: 0.52



or the correlation between the judges themselves?

e.g.
correlation judge A and B: 0.32
correlation judge B and C: 0.59
correlation judge C and A: 0.52



both are interesting to know

[pjt33]

The correlation between the judges themselves.

The per-judge correlations with the community votes this year are 0.62, 0.58, 0.65; vs last year 0.59, 0.81, 0.55. If Demonpants wants to get into game reviewing as a career, he could do worse than to cite these figures

[princec]

sorry dudes, just been too busy!

Cas

[bysse]

Wow!
I'm surprised i won, so many great games this year!

Big thanks for the comments on the forum and of course to the judge panel for doing the reviews!
How long did it take to review all games?

[ra4king]

they took forever thanks to Riven

[appel]

Wow!
I'm surprised i won, so many great games this year!

Big thanks for the comments on the forum and of course to the judge panel for doing the reviews!

Congrats Erik Byström on winning BOTH the community voting and judging panel voting, a clear winner.

How long did it take to review all games?

I spend maybe 10-15 minutes per game. So, that's 3-4 games per hour, and I usually don't spend more than 2 hours per evening. With 45 games that can spread over many evenings, but I try to include 1 or 2 games during the day as well, here and there. So, overall it takes a full week to finish the reviewing, doing 6-7 games a day. But my pleasure

[kappa]

Wow!
I'm surprised i won, so many great games this year!

yup, congrats on becoming the Java4k 2011 winner (should make a nice addition to your CV ).

How long did it take to review all games?

About 2 weeks to randomly just play through entries and about 3 hours (over 3-4 days) to write up the reviews.

[Riven]

How long did it take to review all games?

Two evenings and two nights, as I was under the impression I was the last judge, holding up everything.

At the time, I wasn't, but after Cas didn't have the time to review the entries, in the end, I was the last judge... but still, I could have spread it over a few more days, as appel was having connectivity issues. Blah blah blah.

[princec]

I still haven't played any of them even now! Next time try to organise it so I'm not having a baby and releasing on Steam heh

Cas

[Ranger]

Thanks judges!  Excellent reviews of my game.  Very helpful feedback.  Lookout Java4K 2012! 

And a big congrats to Erik for a well deserved win!

[kappa]

look what turned up on the indiegames site

http://www.indiegames.com/blog/2011/03/java4k_2011_competition_result.html

[appel]

look what turned up on the indiegames site

http://www.indiegames.com/blog/2011/03/java4k_2011_competition_result.html

Pretty cool.

[zeroone]

http://www.rockpapershotgun.com/2011/03/29/impossigames-the-java4k-challenge/

[kappa]

http://www.rockpapershotgun.com/2011/03/29/impossigames-the-java4k-challenge/

ah cool.

* kappa notes the thanks at the bottom of article

[bysse]

look what turned up on the indiegames site

http://www.indiegames.com/blog/2011/03/java4k_2011_competition_result.html

I've never seen cu-on-pa, but i guess that it makes my game a mere 'demake' not worthy of the great Yakatoris approval. Making a 4k submission requires a lot of both imagination and creativity, even if the concept is from another game.

I guess i'm preaching to the choir, but still

[appel]

More awesomeness news I can see traffic getting a fair bump.

[kappa]

More awesomeness news I can see traffic getting a fair bump.

Just curious, where is most of it coming from? the above links?

[appel]

More awesomeness news I can see traffic getting a fair bump.

Just curious, where is most of it coming from? the above links?

In the past days the above referrals have been large, but still less than 50%.

All of January was quite "normal", direct+searchengines were roughly 80% while referring sites 20%.

Visitors on a ordinary day can be between 300-1,000, but probably average around 500. I think most per day is something in the neighborhood of 15,000, it usually goes up to this number when referred to by a large site.
Not HUGE numbers, like hundreds of thousands, but the traffic is steady, and I assume those 500 visitors are doing something with their time there

Quite funny, I can't think of a larger Java-only game site. 

[StephR]

Thanks to all participants for all these great games this year - my favorite ones being Legend of Zelda 4K, Outrun 4K, Space Explorer and the really underrated Morning Dash 4k. And congratulations to the authors of the best rated ones, I mean Erik Byström, Kevin Glass, pjt33 and of course zeerone.

My only regret this year was the impossibility for me to play to Alan Waddington's Mage Wars, which looked very promising... Too bad there was no one player version of this game.

But now that I think about it, I have a second regret : not seeing the completion of Super Me4k Boy !

Appel, it was a great idea to allow code sharing on the java4k site. And thanks to all who shared their code, with a special mention to zeerone ( of course ! ).

See you on the 2012 session. I already wonder how much the "end of the world" theme will be traited...

[CatWeazle]

congrats to everyone! and many thanks to all the reviewers! it was great fun participating in this, I'll defo be back for 2012!