Java-Gaming.org    
Featured games (79)
games approved by the League of Dukes
Games in Showcase (476)
Games in Android Showcase (106)
games submitted by our members
Games in WIP (530)
games currently in development
News: Read the Java Gaming Resources, or peek at the official Java tutorials
 
    Home     Help   Search   Login   Register   
Pages: [1] 2
  ignore  |  Print  
  Judging..  (Read 4626 times)
0 Members and 1 Guest are viewing this topic.
Offline appel

JGO Wizard


Medals: 50
Projects: 4


I always win!


« Posted 2013-03-08 20:23:46 »

I'm sorry I haven't announced anything about judging, but the reasons are I haven't been able to recruit a minimum amount of judges (3). Currently it's me and Rebirth.

We need 1 more judge to reach the minimum. The last ditch attempt is to advertise here for someone clever who might be interested, but it's some work considering there's just over a week until it has to be finished (but well possible).

I'll give it until tomorrow, and in case we're unable to fill the panel I'll call off the judging panel part and let community voting be the only voting... which may well be the future anyway.

Good thing is, I planned for this eventuality by adding community voting feedback, so those who submitted 4k games will probably get more feedback compared to previous contests.


If you're interested, send me a PM. I won't recruit any unknown bearded wanderer.   Kiss

Check out the 4K competition @ www.java4k.com
Check out GAMADU (my own site) @ http://gamadu.com/
Offline moogie

JGO Knight


Medals: 12
Projects: 6
Exp: 10 years


Java games rock!


« Reply #1 - Posted 2013-03-08 21:41:17 »

whats ChrisM up to these days? perhaps he would like to moonlight as a judge for old times sake?
Offline teletubo
« League of Dukes »

JGO Ninja


Medals: 48
Projects: 4
Exp: 8 years



« Reply #2 - Posted 2013-03-08 21:52:19 »


We need 1 more judge to reach the minimum. The last ditch attempt is to advertise here for someone clever who might be interested, but it's some work considering there's just over a week until it has to be finished (but well possible).
 

maybe you could extend by 1 week the voting deadline so the new judge (and even community) might have a little more time. I don't think there's a reason for someone to whine about that.

Games published by our own members! Check 'em out!
Legends of Yore - The Casual Retro Roguelike
Offline Cero
« Reply #3 - Posted 2013-03-08 22:11:33 »

Thats 68 games. How long would a judge usually take to rate one game and by what aspects.

I mean there so much to consider... for example if a game looks really good or is 3D... thats great for 4k, crazy. But does that make a good game alone ? well no
should I even give plus points for a technological feat ? since a review should just be a player

you see where I am going

also the fact that - I looked at some earlier years ratings and I sometimes didn't agree with other judges at all

Offline pjt33
« Reply #4 - Posted 2013-03-08 23:06:18 »

Thats 68 games. How long would a judge usually take to rate one game and by what aspects.
It took me about 20 minutes per game last year. Rating it isn't really the time-consuming bit: that's writing an evaluation.
Offline ReBirth
« Reply #5 - Posted 2013-03-09 05:18:56 »

Playing is easy, the hard part that I have to keep the scale good after playing them all so a truly better game is above. As usual judging by human, they're pretty subjective.

I have no beard in RL Grin

Offline appel

JGO Wizard


Medals: 50
Projects: 4


I always win!


« Reply #6 - Posted 2013-03-09 13:27:18 »

Ok, the judging panel will consist of myself, Rebirth and r4king.

Judging results will be delayed a little, but it's in.

Check out the 4K competition @ www.java4k.com
Check out GAMADU (my own site) @ http://gamadu.com/
Offline Jimmt
« League of Dukes »

JGO Kernel


Medals: 128
Projects: 4
Exp: 3 years



« Reply #7 - Posted 2013-03-09 17:31:29 »

ra4king? Is that your first judge under 18?
Offline ReBirth
« Reply #8 - Posted 2013-03-10 03:16:37 »

Yeah, so we have reviews from two old men and one underage boy now.

Offline appel

JGO Wizard


Medals: 50
Projects: 4


I always win!


« Reply #9 - Posted 2013-03-10 03:39:15 »

Well... I'm not _that_ old.  Huh Tongue

Check out the 4K competition @ www.java4k.com
Check out GAMADU (my own site) @ http://gamadu.com/
Games published by our own members! Check 'em out!
Legends of Yore - The Casual Retro Roguelike
Offline ReBirth
« Reply #10 - Posted 2013-03-10 03:44:52 »

When they bring up about above/under 18 yo, there are only 2 options: young or old Grin

What am I doing here? Excuse me I want to play some 4ks Cool

Online ra4king

JGO Kernel


Medals: 336
Projects: 2
Exp: 5 years


I'm the King!


« Reply #11 - Posted 2013-03-10 05:43:58 »

Wait...how old are you Rebirth? I always thought you were in your 20's! Huh

Offline Jimmt
« League of Dukes »

JGO Kernel


Medals: 128
Projects: 4
Exp: 3 years



« Reply #12 - Posted 2013-03-10 06:03:43 »

Rebirth, aren't you around 23 or so?
Offline ReBirth
« Reply #13 - Posted 2013-03-10 06:46:59 »

That moment when everyone want to know... Grin

Yeah I am 22. But since everyone always talk about 18 limit, like I said, it will divide us to 2 groups, young and old/matured.

Back to topic, since lot of games this year need to be played my review may won't be long but still hit the main points.

Offline Morre

JGO Knight


Medals: 2
Projects: 10


I'm Dragonene on IRC.


« Reply #14 - Posted 2013-03-10 15:09:33 »

I'm happy you were able to find a full judging panel. Personally, I find the judges' results far more interesting - primarily because comments interest me more than scoring, but also because the kind of community vote we're using (with a points pool per user) favor people who advertise their games (as it's based on a total score rather than an average - correct?). I'm not saying this is necessarily a bad thing, but I personally prefer scorings where the number of voters matters less. Smiley

Offline forthx

Junior Member


Medals: 1
Projects: 1



« Reply #15 - Posted 2013-03-10 15:10:52 »

Back to topic, since lot of games this year need to be played my review may won't be long but still hit the main points.

I think that is all we need Wink
Offline Cero
« Reply #16 - Posted 2013-03-10 21:39:16 »

comments interest me more than scoring

This.
All number ratings should be abolished.

There is "Classic Game Room" on Youtube, and they do exactly that, ever since they started with online video reviews of video games in 1999 believe it or not.
They also make fun of the whole thing sometimes by giving out ratings such as "7 out of green" for fun

Offline appel

JGO Wizard


Medals: 50
Projects: 4


I always win!


« Reply #17 - Posted 2013-03-10 21:57:48 »

I think an ordered relative bucket rating is better than an absolute score.

What do I mean by "ordered relative bucket rating"?

Let's say instead of assigning a score from 0-100 to a game, all you do is decide into which bucket it goes. "Superb" bucket, or "Good", "Fair", "Mediocre", "Poor".

Next step is sorting the games in each bucket in order of how good it is. So, if game C is better than game A, but game B is better than C, then the order would be B, C, A.

This would give "winners" for each bucket, but no score. I think this is a better assessment of the game than what we currently do.

The problem with rating games like this is it requires judges to agree, and to have a dialogue on each game (possible using voice chat), deciding on which bucket a game goes into, and then sorting inside each bucket.

Being realistic, I don't think that approach will work too well. It's going to be a nightmare to coordinate and very time-consuming. Disagreement deadlocks might happen.
The good thing with the current judging process is it allows us to do it when we like, where we like it, how long we like it etc. And disagreements don't exist.



But this is a discussion we have every year, don't we? Smiley In the end, everybody are content with the end results.

Check out the 4K competition @ www.java4k.com
Check out GAMADU (my own site) @ http://gamadu.com/
Offline SimonH
« Reply #18 - Posted 2013-03-11 00:34:59 »

I really don't envy you guys the task, there's a lot of games there, so if I can help in any way, say, brown envelopes full of cash, obliging young lovers, whatever, just let me know...  Wink

People make games and games make people
Offline Morre

JGO Knight


Medals: 2
Projects: 10


I'm Dragonene on IRC.


« Reply #19 - Posted 2013-03-11 18:46:50 »

Just to be clear, I was in no way trying to complain about either of our two scoring methods - I think they're both fine. I'm just saying I'm personally glad you managed to find judges, since these results are the ones that interest me the most. Smiley

Offline Cero
« Reply #20 - Posted 2013-03-11 20:57:15 »

I should play all 68 games and make a lets play online review ;D

Online ra4king

JGO Kernel


Medals: 336
Projects: 2
Exp: 5 years


I'm the King!


« Reply #21 - Posted 2013-03-11 21:09:26 »

Ok well today I start judging! I still can't decide how harsh I should be.... Tongue

Offline Rooster_Miami

Junior Newbie





« Reply #22 - Posted 2013-03-11 21:33:39 »

The developers on this forum spend hours to days on their entries, sometimes pouring their hearts into their efforts.  For every negative point that appears in your review, try to come up with something positive to balance it out.
Offline ctomni231

JGO Wizard


Medals: 98
Projects: 1
Exp: 7 years


Not a glitch. Just have a lil' pixelexia...


« Reply #23 - Posted 2013-03-12 04:32:35 »

I should play all 68 games and make a lets play online review Grin

That would be awesome actually, it'll give Java4K some needed Youtube coverage. Nonetheless, I wish all the judges this year luck on rating all 68 of these games. I wouldn't mind if the time for judging gets extended a bit, writing that many reviews can take a lot out of someone...

Offline ReBirth
« Reply #24 - Posted 2013-03-12 13:09:56 »

Before youtube maybe java4k needs twitter first Grin

Offline appel

JGO Wizard


Medals: 50
Projects: 4


I always win!


« Reply #25 - Posted 2013-03-13 22:10:26 »

Judging panel results are going to be published on wednesday (in 1 week from now). I think that should be enough time for us to complete it.

Check out the 4K competition @ www.java4k.com
Check out GAMADU (my own site) @ http://gamadu.com/
Offline appel

JGO Wizard


Medals: 50
Projects: 4


I always win!


« Reply #26 - Posted 2013-03-21 00:29:24 »

Ok, pushing judging panel reviews back to Friday. This is immense work, but we're almost there!


Check out the 4K competition @ www.java4k.com
Check out GAMADU (my own site) @ http://gamadu.com/
Offline ctomni231

JGO Wizard


Medals: 98
Projects: 1
Exp: 7 years


Not a glitch. Just have a lil' pixelexia...


« Reply #27 - Posted 2013-03-21 00:35:51 »

I'm fine with this actually. Take as much time as you need given that this is the biggest year ever!

Offline appel

JGO Wizard


Medals: 50
Projects: 4


I always win!


« Reply #28 - Posted 2013-03-21 00:39:53 »

I'm fine with this actually. Take as much time as you need given that this is the biggest year ever!
The problem was that we got started probably a week too late because of scarcity of judges Smiley

Check out the 4K competition @ www.java4k.com
Check out GAMADU (my own site) @ http://gamadu.com/
Offline ReBirth
« Reply #29 - Posted 2013-03-21 03:31:25 »

I am cool enough to finish it in time Cool, without mentioning the quality of my reviews Tongue

Pages: [1] 2
  ignore  |  Print  
 
 
You cannot reply to this message, because it is very, very old.

 

Add your game by posting it in the WIP section,
or publish it in Showcase.

The first screenshot will be displayed as a thumbnail.

pw (12 views)
2014-07-24 01:59:36

Riven (10 views)
2014-07-23 21:16:32

Riven (11 views)
2014-07-23 21:07:15

Riven (12 views)
2014-07-23 20:56:16

ctomni231 (42 views)
2014-07-18 06:55:21

Zero Volt (38 views)
2014-07-17 23:47:54

danieldean (32 views)
2014-07-17 23:41:23

MustardPeter (34 views)
2014-07-16 23:30:00

Cero (50 views)
2014-07-16 00:42:17

Riven (50 views)
2014-07-14 18:02:53
HotSpot Options
by dleskov
2014-07-08 03:59:08

Java and Game Development Tutorials
by SwordsMiner
2014-06-14 00:58:24

Java and Game Development Tutorials
by SwordsMiner
2014-06-14 00:47:22

How do I start Java Game Development?
by ra4king
2014-05-17 11:13:37

HotSpot Options
by Roquen
2014-05-15 09:59:54

HotSpot Options
by Roquen
2014-05-06 15:03:10

Escape Analysis
by Roquen
2014-04-29 22:16:43

Experimental Toys
by Roquen
2014-04-28 13:24:22
java-gaming.org is not responsible for the content posted by its members, including references to external websites, and other references that may or may not have a relation with our primarily gaming and game production oriented community. inquiries and complaints can be sent via email to the info‑account of the company managing the website of java‑gaming.org
Powered by MySQL Powered by PHP Powered by SMF 1.1.18 | SMF © 2013, Simple Machines | Managed by Enhanced Four Valid XHTML 1.0! Valid CSS!