Java-Gaming.org Hi !
Featured games (81)
games approved by the League of Dukes
Games in Showcase (513)
Games in Android Showcase (119)
games submitted by our members
Games in WIP (576)
games currently in development
News: Read the Java Gaming Resources, or peek at the official Java tutorials
 
    Home     Help   Search   Login   Register   
Pages: 1 2 3 [4]
  ignore  |  Print  
  who needs judges?  (Read 17812 times)
0 Members and 1 Guest are viewing this topic.
Offline moogie

JGO Knight


Medals: 13
Projects: 6
Exp: 10 years


Java games rock!


« Reply #90 - Posted 2006-01-30 02:15:58 »

I am actually more keen on a few "experts" as judges as I am more interested in comments about different sections about the entries rather than who wins Smiley

I doubt anyone will put critical comments down if the voting is public.
Offline x30ice

Senior Newbie





« Reply #91 - Posted 2006-01-30 14:13:04 »

I like the different sub categories idea, but it may be hard to make a simple way to vote. Anyway, the best gameplay, best graphics, best technical achievement and best sound/music would be great. I think it would be better for this categories to get only one vote and not a top x.

If searching for the critical comments, I think too that public vote will stop lots of critical comments.

I think that if we make people vote, make people vote the games they played. I seriously doubt that all the people who may vote will play all the games, maybe played the ones they get attention for screenshots or name (for example) and then vote the best from the ones they played, so rather than a best 3/5/10 I think it would be better a list with all the games and then the voter rate the games that he/she played with the different categories required (pulldown menus to make it easy) and a final score that he/she thinks the game deserves (so the game may lack sound, for example, but it could score 10 on the final score) and finally a textbox for comments (maybe not required but very appreciated) . This way it could take a long time to vote for ones that played all the games but it would be more fair than a "top something" IMHO.

Offline Mojomonkey

Senior Duke




ooh ooh eee eeee


« Reply #92 - Posted 2006-01-30 18:19:30 »

I think we should just text IDOL01 into our Cingular phones to vote for Latoya London!

After reading this thread, I believe the title is answered : "who needs judges?" The 4k Contest and it needs them badly.


Don't send a man to do a monkey's work.
Games published by our own members! Check 'em out!
Legends of Yore - The Casual Retro Roguelike
Offline woogley
« Reply #93 - Posted 2006-01-30 18:22:49 »

agreed, sir monkey Tongue

volunteers?
Offline darkprophet

Senior Duke




Go Go Gadget Arms


« Reply #94 - Posted 2006-01-30 18:29:52 »

Quote
If you decide to want judges this year again, i'll be more than happy to be one...

*cough* me! *cough*

DP

Friends don't let friends make MMORPGs.

Blog | Volatile-Engine
Offline blahblahblahh

JGO Coder


Medals: 1


http://t-machine.org


« Reply #95 - Posted 2006-01-30 18:54:09 »

Hey, why not have judges? Wink

Kev

Honestly, it's simple and works - it's transparent, in a way that voiting by anonysmous people isnt'. And you can be sure a handful of people almost certainly aren't cheating because people *know who they are*.

You *do* need to tell the judges in advance waht teh "objectvie" criteria are - this is the palce where it fell down last time (as noted before, TBH I think simply reading the judges comments from last time it would be easy to do it really well this time with minimal effort. Why re-invent the wheel, why not just improve? Shrug)

Finally...I'm speaking at the Casuality conference in a week's time. I would really really really like to be able to point people at 4k entries whenever I come across someone interested in it. Please, authors, make sure you've got something up by the 7th feb Wink.

malloc will be first against the wall when the revolution comes...
Offline blahblahblahh

JGO Coder


Medals: 1


http://t-machine.org


« Reply #96 - Posted 2006-01-30 18:56:22 »

volunteers?

If you need an extra one, and we have a deadline for judging Wink, and someone can write guidelines, and they actually all work this time Tongue, then I'm happy to do it again.

malloc will be first against the wall when the revolution comes...
Offline jbanes

JGO Coder


Projects: 1


"Java Games? Incredible! Mr. Incredible, that is!"


« Reply #97 - Posted 2006-01-30 19:00:54 »

You *do* need to tell the judges in advance waht teh "objectvie" criteria are - this is the palce where it fell down last time (as noted before, TBH I think simply reading the judges comments from last time it would be easy to do it really well this time with minimal effort. Why re-invent the wheel, why not just improve? Shrug)

While I would *like* to see public voting, I agree that we should have discussed this earlier rather than at the last minute. From where we're standing, judges are certainly the path of least resistence. Perhaps this year each judge should just give a 1-10 ranking instead of bothering with the individual components? Other than first place (T4XI), I don't think the results came out the way any of you three thought they should. At least with a simple ranking you can intentionally bin each game in the ranking you think it deserves.

What are your thoughts, Blah?

Quote
Finally...I'm speaking at the Casuality conference in a week's time. I would really really really like to be able to point people at 4k entries whenever I come across someone interested in it. Please, authors, make sure you've got something up by the 7th feb Wink.

What do you need more entries for? Just point them at Xero and you're done! (I kid! I kid!)  Tongue Grin

Java Game Console Project
Last Journal Entry: 12/17/04
Offline woogley
« Reply #98 - Posted 2006-01-30 19:06:55 »

wow I have not seen blah^3 in a while! since you don't have a game in the contest adam, we'd love to have you as a judge. I'm trying also to get some of my gamer friends from Dell (that's where I work). those guys really don't care about the technology aspects, just if the game is good quality fun.

3 tech judges and 3 gamer judges would be a sweet balance
Offline Mojomonkey

Senior Duke




ooh ooh eee eeee


« Reply #99 - Posted 2006-01-30 19:09:11 »

I'd be willing to judge depending on the time frame. I'm moving to Austin, TX mid-Feb, so will be indisposed for a few weeks.

Don't send a man to do a monkey's work.
Games published by our own members! Check 'em out!
Legends of Yore - The Casual Retro Roguelike
Offline DonaldEKnuth

Junior Duke





« Reply #100 - Posted 2006-01-30 19:10:56 »

Quote
3 tech judges and 3 gamer judges would be a sweet balance
Replace the 3:s with 10:s and it would be even sweeter! Smiley But I guess that's impossible.

My 4k 2006 Entry: Sokoban4k
Offline Morre

JGO Knight


Medals: 2
Projects: 10


I'm Dragonene on IRC.


« Reply #101 - Posted 2006-01-30 19:17:42 »

Now, I would like to see public voting as well, and I still believe it can be done, and done well, if you do it the way I proposed, hehe. Anyway, giving the judges nothing but a 1-10 scale to work with would be the same as having public voting the way I proposed, but with less voters - I can't see how that improves the voting. No, you'd have to give them different things to rate, but surely the scales and criterion have to be improved compared to last year.

Judges are fine, but give them either a large scale or several scales - 1 to 10 for 30 games would force the judges to put several numbers on each scale, maybe leading to two games having 10 from all judges, thus making it a draw. That won't do Wink

The more judges, the more unlikely this is. The bigger the scales, and the more criterion used, the more unlikely this is. Judges - sure, but make sure it's better coordinated than last year Cheesy

Offline BitDragon

Junior Duke


Projects: 1


Sunset? Nice gradient paint!


« Reply #102 - Posted 2006-01-31 09:21:22 »

Just jumped into this thread, perhaps somebody already proposed this:

Have the best of both worlds. Keep the judges, give them guidelines, try to get as objective a judgement as possible, for example, use principles from hci, like heuristic evaluation. In addition, offer a public vote, so people can rate their favorites and play votebot games if they like. With 50+ entries this year, I see no problem with having a "favorite of the audience" in addition to the official winners. This would also invalidate the argument that changing the evaluation method late in the contest is a bad move.

Cheers

Wolfgang

--
"I'm a f****** starship, I'm allowed to cheat!"
GCU Arbitrary, Culture Craft
Offline Morre

JGO Knight


Medals: 2
Projects: 10


I'm Dragonene on IRC.


« Reply #103 - Posted 2006-01-31 10:13:26 »

Great idea! Cheesy

Offline jojoh

JGO Knight


Medals: 5
Projects: 7


games4j.com


« Reply #104 - Posted 2006-01-31 13:05:45 »

Quote
3 tech judges and 3 gamer judges would be a sweet balance
Replace the 3:s with 10:s and it would be even sweeter! Smiley But I guess that's impossible.
Yep!
I just had a look at last years votes and because there were so few judges, some games got heavily penalized because one judge killed it.
Neb 4K for example (one of my favs) got 9 from one judge and 21 and 14 from other. Quite a gap! Bubble Racer got 8 to 18 points, Trek 9 to 20 and Blast got 5 from Adam 14 from Scott and 20 from Chris  Shocked Average score from Scott and Chris is then 17 which would have given Blast a ... 2nd place! Instead it ended up with average 13.5 and place 19...

Judges can be good if there only are enough of them.

Offline woogley
« Reply #105 - Posted 2006-01-31 13:41:14 »

Judges can be good if there only are enough of them.

hence why I've been pushing for a (simple) public vote
Offline DonaldEKnuth

Junior Duke





« Reply #106 - Posted 2006-01-31 15:06:21 »

Is it really necessary that the judges aren't competing? It could be a rule that they aren't allowed to rate their own game (which they shouldn't). If so I would gladly be one as well, I intend to try out every game anyway and I am a really fair guy! Wink

My 4k 2006 Entry: Sokoban4k
Offline jbanes

JGO Coder


Projects: 1


"Java Games? Incredible! Mr. Incredible, that is!"


« Reply #107 - Posted 2006-01-31 15:14:16 »

Is it really necessary that the judges aren't competing? It could be a rule that they aren't allowed to rate their own game (which they shouldn't).

It's a conflict of interest. Anyone entering the competiton is automatically going to want their entry to win. Whether they do it conciously or not, they may find themselves rating other games based a perception of how they rate in comparison to their own "Uber cool, super l33t!" title. Therefore, to maintain objectivity it has generally been required that the judge either:

A) Not have an entry
B) Remove his entry from judging

I believe the precident for B was set when Mlk offered to withdraw his entry so that he could judge. On the other hand, it was already known that his Stag Party 4K wasn't going to take top position. (He had some trouble with his 3D rotations, and really released it as one of those "Isn't this cool to play when you're drunk?" type of things. Smiley) I'm not sure what the community would think about withdrawing a more likely contender.

Java Game Console Project
Last Journal Entry: 12/17/04
Offline DonaldEKnuth

Junior Duke





« Reply #108 - Posted 2006-01-31 15:31:29 »

I don't think that I am very likely to win, but I would like to know what the judges think. So I guess I can't join in and judge. Smiley There seem to be a shortage of judges though.

My 4k 2006 Entry: Sokoban4k
Offline arne

Senior Duke




money is the worst drug- we should not let it rule


« Reply #109 - Posted 2006-01-31 18:03:10 »

If you can only vote by i.e. choosing the best three entries, you can't vote other entries down. Then, if you exlude your own entry from that list, I think it's only ok for competitors to judge, because they then give points to other entries -> so they more or less vote their own entries down.

:: JOODE :: Xith3d :: OdeJava ::
Offline Markus_Persson

JGO Wizard


Medals: 16
Projects: 19


Mojang Specifications


« Reply #110 - Posted 2006-01-31 18:21:56 »

I'd be willing to act as a judge if there's a shortage.

Yes, that means miners4k can't win, but I'm not in it for the competition. =)

Play Minecraft!
Offline blahblahblahh

JGO Coder


Medals: 1


http://t-machine.org


« Reply #111 - Posted 2006-01-31 18:41:16 »

Just jumped into this thread, perhaps somebody already proposed this:

Have the best of both worlds. Keep the judges, give them guidelines, try to get as objective a judgement as possible, for example, use principles from hci, like heuristic evaluation. In addition, offer a public vote, so people can rate their favorites and play votebot games if they like. With 50+ entries this year, I see no problem with having a "favorite of the audience" in addition to the official winners. This would also invalidate the argument that changing the evaluation method late in the contest is a bad move.

Yes to both. All the stuff about heuristics - pretty much what we said last time (I know I did, at least Tongue). Public vote in parallel - simple first-past-the-post, see-how-it-goes. Why not? Smiley

malloc will be first against the wall when the revolution comes...
Offline blahblahblahh

JGO Coder


Medals: 1


http://t-machine.org


« Reply #112 - Posted 2006-01-31 18:46:08 »

wow I have not seen blah^3 in a while!

Yeah Sad. Our game is too popular!

malloc will be first against the wall when the revolution comes...
Offline woogley
« Reply #113 - Posted 2006-01-31 20:54:21 »

which game is yours?
Offline jbanes

JGO Coder


Projects: 1


"Java Games? Incredible! Mr. Incredible, that is!"


« Reply #114 - Posted 2006-01-31 21:22:34 »

which game is yours?

I'm going to go out on a limb here, and say "Survivor". No, I didn't see Blah's sig. I have no idea what you're talking about. STOP LOOKING AT ME LIKE THAT!  Wink

Java Game Console Project
Last Journal Entry: 12/17/04
Offline kevglass

JGO Kernel


Medals: 186
Projects: 24
Exp: 18 years


Coder, Trainee Pixel Artist, Game Reviewer


« Reply #115 - Posted 2006-01-31 21:33:44 »

Na, the game of the company he works for he means i think. Its an ARG and its outrageously popular.

Kev

Offline Anon666

Junior Duke




aka Abuse/AbU5e/TehJumpingJawa


« Reply #116 - Posted 2006-02-01 13:05:48 »

If you can only vote by i.e. choosing the best three entries, you can't vote other entries down. Then, if you exlude your own entry from that list, I think it's only ok for competitors to judge, because they then give points to other entries -> so they more or less vote their own entries down.

Like they do in the Eurovision?

That works sooooo well  Wink
Offline DonaldEKnuth

Junior Duke





« Reply #117 - Posted 2006-02-01 15:09:30 »

If there is a public vote it would be nice if the visitors could give grades on different aspects of the game (graphics etc) and also be able to provide a one sentence motivation for giving each grade. Those comments and grades would be really nice to have for the game authors.

My 4k 2006 Entry: Sokoban4k
Pages: 1 2 3 [4]
  ignore  |  Print  
 
 
You cannot reply to this message, because it is very, very old.

 

Add your game by posting it in the WIP section,
or publish it in Showcase.

The first screenshot will be displayed as a thumbnail.

Longarmx (38 views)
2014-10-17 03:59:02

Norakomi (28 views)
2014-10-16 15:22:06

Norakomi (24 views)
2014-10-16 15:20:20

lcass (28 views)
2014-10-15 16:18:58

TehJavaDev (53 views)
2014-10-14 00:39:48

TehJavaDev (54 views)
2014-10-14 00:35:47

TehJavaDev (43 views)
2014-10-14 00:32:37

BurntPizza (64 views)
2014-10-11 23:24:42

BurntPizza (36 views)
2014-10-11 23:10:45

BurntPizza (78 views)
2014-10-11 22:30:10
Understanding relations between setOrigin, setScale and setPosition in libGdx
by mbabuskov
2014-10-09 22:35:00

Definite guide to supporting multiple device resolutions on Android (2014)
by mbabuskov
2014-10-02 22:36:02

List of Learning Resources
by Longor1996
2014-08-16 10:40:00

List of Learning Resources
by SilverTiger
2014-08-05 19:33:27

Resources for WIP games
by CogWheelz
2014-08-01 16:20:17

Resources for WIP games
by CogWheelz
2014-08-01 16:19:50

List of Learning Resources
by SilverTiger
2014-07-31 16:29:50

List of Learning Resources
by SilverTiger
2014-07-31 16:26:06
java-gaming.org is not responsible for the content posted by its members, including references to external websites, and other references that may or may not have a relation with our primarily gaming and game production oriented community. inquiries and complaints can be sent via email to the info‑account of the company managing the website of java‑gaming.org
Powered by MySQL Powered by PHP Powered by SMF 1.1.18 | SMF © 2013, Simple Machines | Managed by Enhanced Four Valid XHTML 1.0! Valid CSS!