woogley
JGO Neuromancer     Posts: 1098 Medals: 5
|
 |
«
on:
2006-02-17 13:47:50 » |
|
the contest is drawing to close now. we need judges to volunteer so we can start judging on time (by March 1st).
just a quick note, judges cannot have a game in the contest.
|
|
|
|
|
Myself
JGO n00b  Posts: 17
Java games rock!
|
 |
«
Reply #1 on:
2006-02-17 14:42:25 » |
|
just a quick note, judges cannot have a game in the contest.
Even if they don't vote for themself?
|
|
|
|
|
jbanes
JGO Neuromancer     Posts: 1178
"Java Games? Incredible! Mr. Incredible, that is!"
|
 |
«
Reply #2 on:
2006-02-17 14:53:55 » |
|
Even if they don't vote for themself? It's a conflict of interest. As a judge, you're in a position to give the competing games a lower score. This can be done intentionally (sabotaging the scores to raise your own score) or unintentionally (unconciously comparing other games to your own). Thus it's best that judges are not entered in the contest.
|
|
|
|
Games published by our own members! Go get 'em!
|
|
woogley
JGO Neuromancer     Posts: 1098 Medals: 5
|
 |
«
Reply #3 on:
2006-02-17 15:11:01 » |
|
the best results will come from 3rd party judges. im even thinking about having some of my random friends from school do some judging. they're not techincally savvy at all, they just know if a game is fun or not 
|
|
|
|
|
Markus_Persson
JGO Kernel      Posts: 2092 Medals: 10
Mojang Specifications
|
 |
«
Reply #4 on:
2006-02-17 17:36:50 » |
|
Unless anyone wants me not to be a judge (like if they want to see how their games does compared to mine), I'd be willing to judge. :-)
|
|
|
|
woogley
JGO Neuromancer     Posts: 1098 Medals: 5
|
 |
«
Reply #5 on:
2006-02-17 17:42:42 » |
|
i personally want to see Miners4K in the compeition (particuarly against Xero) 
|
|
|
|
|
Markus_Persson
JGO Kernel      Posts: 2092 Medals: 10
Mojang Specifications
|
 |
«
Reply #6 on:
2006-02-17 17:49:52 » |
|
ok then. But if you're a judge short, let me know. =)
|
|
|
|
nonnus29
JGO Ninja    Posts: 687
Giving Java a second chance after ludumdare fiasco
|
 |
«
Reply #7 on:
2006-02-17 22:02:20 » |
|
Yeah Markus, you have to give miners4k a chance to win, that thing deserves it. I'd volunteer, but I still hope to get an entry into this thing... 
|
|
|
|
|
BitDragon
Jr. Member   Posts: 66
Sunset? Nice gradient paint!
|
 |
«
Reply #8 on:
2006-02-18 08:44:20 » |
|
I thought you'd have some guys from industry or research, senior developers or the like, as judges. Soo ... am I getting this right, contest judges are pulled from people from this board who did not manage to contribute to the contest themselves?  Wolfgang "I'm a ****ing starship, I'm allowed to cheat!" GCU Arbitrary, Culture Craft
|
|
|
|
|
woogley
JGO Neuromancer     Posts: 1098 Medals: 5
|
 |
«
Reply #9 on:
2006-02-18 08:48:57 » |
|
basically. but they're just as good as any of the contest participants, so it works out. take for instance blahblahblahh, who would probably have submitted a 4K game if he wasn't so busy developing a commercial game at the moment. but he says he has time to judge 
|
|
|
|
|
Games published by our own members! Go get 'em!
|
|
BitDragon
Jr. Member   Posts: 66
Sunset? Nice gradient paint!
|
 |
«
Reply #10 on:
2006-02-18 10:00:58 » |
|
(...) but they're just as good as any of the contest participants (...)
To make this very clear: It was not my intention to imply that people not submitting to the contest are somehow less qualified to sit in as judges than participants of the contest. I'm totally aware of the many reasons (including serious work  ) which can hinder finalization of a submission, and I found myself hard-pressed to complete my submission, too, because of project deadlines at work. However, recalling the discussion about the pros and cons of a public vote, I was under the impression that you had professionally qualified judges available, that people at least as adept in Java development as the best of us would judge our entries. Knowing that this is not the case, I tend more towards a public vote than before: If the outcome of the contest is to be determined by members of this community, then let it be many, if not all, of us. Wolfgang "I'm a ****ing starship, I'm allowed to cheat!" GCU Arbitrary, Culture Craft
|
|
|
|
|
woogley
JGO Neuromancer     Posts: 1098 Medals: 5
|
 |
«
Reply #11 on:
2006-02-18 10:17:47 » |
|
Knowing that this is not the case, I tend more towards a public vote than before: If the outcome of the contest is to be determined by members of this community, then let it be many, if not all, of us.
i completely agree, which is why i attempted the public vote, but there were too many complaints ..
|
|
|
|
|
nonnus29
JGO Ninja    Posts: 687
Giving Java a second chance after ludumdare fiasco
|
 |
«
Reply #12 on:
2006-02-18 12:06:54 » |
|
It's a mistake to get hung up on voting in this competition. The entries are so different voting for the 'best game' is pretty much meaningless, imho. It'll come down to what type of game the judge likes; if he likes shooter he may pick xero, if he likes tech, he may favor ares or frag4k, if he likes racing games he may favorer speed4k etc... You can't win really, so there's no point in being anal about it.
Having said that, last year blah, S. Campbell, and Chris M. were judges; Chris is a Sun VP and blah and Shawn are professional developers so I thought that was a nice mix.
|
|
|
|
|
BitDragon
Jr. Member   Posts: 66
Sunset? Nice gradient paint!
|
 |
«
Reply #13 on:
2006-02-18 12:59:35 » |
|
It's a mistake to get hung up on voting in this competition. The entries are so different voting for the 'best game' is pretty much meaningless "Contest: an occasion on which a winner is selected from among two or more contestants" (wordnet) Either we do a competition for the best Java4k game (and I spend the time polishing my submission, as I did), and then determine ranking by some objective criteria. Or we do an exhibition of Java4k games (and I submit a sketch, or nothing at all), and do not determine ranking. Yes, I did my entry for the fun of it, but still, we have a contest here, and we should arrive at some kind of ranking in the end. Most of us wouldn't invest the time to finish our entries if not for the competitive aspect of the whole thing, which is why in my opinion, woogley's choice to call it a contest is just right. I agree that judging for "best game" ist next to impossible due to the wide variety of genres and personal preferences. However, I consider the focus to be on "best 4096 byte java code", with the game side just being thrown in to encourage meaningful, interactive submissions. Studying last year's results, where the entries most advanced in terms of structure, graphics and user interface were ranked top, it seems I'm not so far off the mark. Let's simply judge number of tricks used, rules bent, paradigms thrown overboard and unbelievable stunts pulled, and subsummize it into a "geek factor", which then determines ranking Serious again, last year's composition of the judge comitee sounds very reasonable. Wolfgang "I'm a ****ing starship, I'm allowed to cheat!" GCU Arbitrary, Culture Craft
|
|
|
|
|
chaosdeathfish
Jr. Member   Posts: 56
|
 |
«
Reply #14 on:
2006-02-18 15:05:01 » |
|
Hey, gameplay has to count for a lot! If the tech is amazing and the gameplay is sucky, I'd go find another game 8-) Which I imagine is what'd happen with a general vote. The really cool games that you keep coming back to (Fuzetsu and Miners have both grabbed me) would be the ones that would do best, surely?
Just my two cents..
|
|
|
|
|
DonaldEKnuth
Full Member   Posts: 127
|
 |
«
Reply #15 on:
2006-02-18 16:17:10 » |
|
Have lots of judges (10 perhaps) all of which have technical knowledge and know Java. Let them vote on the games based on a number of categories and don't give them any restrictions/guidance what so ever about how to place their votes. I think that it will solve itself then. Having Joe average user as a judge is a bad idea, it's not much better than having monkeys doing random votes if you ask me.  Edit: More seriously and to clairify my post, the best judge is someone who can apperciate both the gameplay value and the technical achievement of the games. And if we are just going to have a few judges I think all should have both of these qualities.
|
|
|
|
Morre
JGO Ninja    Posts: 507
I'm Dragonene on IRC.
|
 |
«
Reply #16 on:
2006-02-18 18:10:11 » |
|
In this particular question, I completely disagree with you, Donald. The average user's opinion is worth just as much as an "expert", if you ask me. Sure, they won't be as good when it comes to the tech side, so perhaps a separate judging for that would be nice. On the other hands, they are all expers on gameplay. For me, gameplay has always been the most important factor in games, and still is. This is, after all, a 4k game competion - not a tech showcase. The gameplay has to play an important role here. If we just wanted to show off tech, then we could just as well have had a "4k application" contest instead (see 256b.com - they've pulled it off without the gaming). I am an active member of GFXartist.com, submitting my not so good photographs, and I've seen the same thing over there. People disqualify themselves as judges, not placing critiques on artworks because they believe their opinions are less important. Similarly, artists disqualify people as judges because they are certain that their untrained art eyes give no better critiques than "monkeys doing random votes", as Donald put it. The artistic value is something that can and should be appreciated by anyone. Let's make sure that the winner of the contest is one that is popular with everyone, not just the judges. Having said that, I'll clarify that judges are fine since there's no time for anything else - the last thing this contest needs is a repetition of last year (great games - poor planning). Let's give the judges simple scales to work with, and let's coordinate them. 
|
|
|
|
DonaldEKnuth
Full Member   Posts: 127
|
 |
«
Reply #17 on:
2006-02-18 18:39:01 » |
|
Morre: I would be surprised if we really felt that different about this, I guess it was clear the comparison to monkeys was made in a humorus context? Anyway, let me rephrase myself; I think that the focus should indeed be on gameplay, but I don't want to skip the technical achivement all together. Which is why I think that the judges should have some technical ability, they don't have to be experts though.
Of course I understand that deciding on what's "techinically hard" is also very complicated, if you know an algorithm which you can fit in 4k when should it be considered technically hard? Still I think that it would be a pitty if we entierly lost the technical aspect, as I find some games to be quite poor when it comes to gameplay but still feel that the technical achievement should be acknowledged.
By the way things look I guess we should be glad to have any judges at all. I'm still positive that contestants could be judges as well and that they shouldn't be allowed to vote for their own game. Sure statistics could get skewed. I still have a hard time imagining someone who would try to give their own game a push forward using some kind of strategical voting, perhaps I'm not taking it seriously enough (I'm in the contest purely for my enjoyment).
|
|
|
|
nonnus29
JGO Ninja    Posts: 687
Giving Java a second chance after ludumdare fiasco
|
 |
«
Reply #18 on:
2006-02-18 20:53:17 » |
|
Hey, gameplay has to count for a lot! If the tech is amazing and the gameplay is sucky, I'd go find another game 8-) Which I imagine is what'd happen with a general vote. The really cool games that you keep coming back to (Fuzetsu and Miners have both grabbed me) would be the ones that would do best, surely?
Just my two cents..
Yes, technology typically does not do well in this contest.
|
|
|
|
|
BitDragon
Jr. Member   Posts: 66
Sunset? Nice gradient paint!
|
 |
«
Reply #19 on:
2006-02-19 06:43:03 » |
|
Yes, technology typically does not do well in this contest.
<sarcasm>Good to know. Where can I find that other contest, the one where the better 4k Java program wins?</sarcasm> Seriously, I should have asked beforehand, I suppose, I was under the impression that this is a programming contest. if you know an algorithm which you can fit in 4k when should it be considered technically hard?
No, it should be considered technically hard if you fit an algorithm into 4k which everyone knows cannot be made smaller than 8k  perhaps I'm not taking it seriously enough (I'm in the contest purely for my enjoyment)
No, imho you've got exactly the right attitude. I considered myself to be into this for the fun of it, too, but my nevermind factor still wasn't high enough. All fixed, after the recent discussion about evaluation criteria it asymptotically approaches positive_infinity. This is, after all, a 4k game competion - not a tech showcase. The gameplay has to play an important role here.
It's a 4k game competition and a tech showcase. Gameplay is important, and can be evaluated, for example, by number of interactions available to users, complexity of ingame entity behavior and so on. Techniques have to be applied to implement that gameplay in an attractive fashion. Even the "gameplay" fanatics crowd wouldn't enjoy a lemmings clone where your cute little ... white pixel digs up crumby little ... brown pixels. Anyhow, most people here seem to define gameplay as "I like it", so either we do a public vote (again, applause to woogley for proposing it), then this definition is on the spot, or we use judges, then this definition is plain wrong, and we need some objective criteria. (Promise to myself and all interested parties: This is my last posting on the topic of evaluation, voting and judges  ) Wolfgang "I'm a ****ing starship, I'm allowed to cheat!" GCU Arbitrary, Culture Craft
|
|
|
|
|
Markus_Persson
JGO Kernel      Posts: 2092 Medals: 10
Mojang Specifications
|
 |
«
Reply #20 on:
2006-02-19 07:27:15 » |
|
Even the "gameplay" fanatics crowd wouldn't enjoy a lemmings clone where your cute little ... white pixel digs up crumby little ... brown pixels. Say.. what? I get a lot of emails from people who actually PLAY THE GAME. I don't mean they just test it and think it's cute tech demo for 4kb; they actually play it as a game and like it. Most of them aren't even programmers themselves. I'm not entirely sure why you felt the need to pick on my game, but please stop it.
|
|
|
|
woogley
JGO Neuromancer     Posts: 1098 Medals: 5
|
 |
«
Reply #21 on:
2006-02-19 08:58:01 » |
|
the reason i focus more on gameplay than on technical achievement because it is a game programming contest - NOT a technical demo contest. the rules page even says "no pointless animations - must be a PLAYABLE game"
besides, if you're pulling off extreme graphics for a painfully boring game, you haven't made a big technical achievement anyway.
we're making games. we're making in them in 4K. but which one is the most enjoyable? which one is the best? (yes - there IS a best, that's why we're judging in the first place).
Donald: I wouldn't even worry about setting up a huge complex categorized system unless maybe we had prizes or something. even then i still probably wouldnt use a complex system. just, is it a good game or not? gameplay, replay value, etc.
|
|
|
|
|
BitDragon
Jr. Member   Posts: 66
Sunset? Nice gradient paint!
|
 |
«
Reply #22 on:
2006-02-19 09:24:20 » |
|
(promised no more ranting, but have to apologize to marcus ...) I'm not entirely sure why you felt the need to pick on my game, but please stop it.
I did not intend to pick on your game, I apologize if that is how my post came across. To illustrate my point using my own submission, shooting evil ... drawRectangle aliens with hot ... drawLine laser beams wouldn't be the same, even if I still included physics and enemy ai (which I suppose fall under gameplay?) I greatly enjoy your game and I would rate your game's replay value a lot higher than that of my own submission (and most other submissions I have seen so far). Wolfgang "I'm a ****ing starship, I'm allowed to cheat!" GCU Arbitrary, Culture Craft
|
|
|
|
|
Markus_Persson
JGO Kernel      Posts: 2092 Medals: 10
Mojang Specifications
|
 |
«
Reply #23 on:
2006-02-19 09:40:16 » |
|
Aaaahh, I see.
Heh, well, I totally misunderstood that post, heh. Sorry about that. And phew. :-D
|
|
|
|
DonaldEKnuth
Full Member   Posts: 127
|
 |
«
Reply #24 on:
2006-02-19 13:17:29 » |
|
To keep it simple why not let the judges give each game one score, but supply a little written comment. It would be nice I think, I'm not thinking about something complex at all. In fact any system will be nice, it seems hard to get any judges at all. 
|
|
|
|
woogley
JGO Neuromancer     Posts: 1098 Medals: 5
|
 |
«
Reply #25 on:
2006-02-19 13:18:48 » |
|
oh yes, there will be comments just like last year. also next year i want to implement that public comments thing that has been sitting in my dark corner of things to do.. 
|
|
|
|
|
noblemaster
JGO Ninja    Posts: 730 Medals: 6
Age of Conquest makes your day!
|
 |
«
Reply #26 on:
2006-02-19 16:23:07 » |
|
How about having more than just one rating system and one winner? You could declare an "Overall" winner for the best game, but then also allow winners for subcategories: -Gameplay -AI -Graphics/Sound -Technical Achievement
Also instead of either just using judges or just public votes, it could be a combination of both?
An overall winner is definitly necessary, but for a lot of folks, it might be cool, to put their game in their resume? There is no prize money, but if you apply for a job and can show off a "technical achievement award" for a game contest you entered, definitly makes employers be more interested.
Note: I always show off my games that I wrote during job applications and it's definitly getting people to listen. Even though, the job has nothing to do with gaming ...
|
|
|
|
Anon666
Sr. Member   Posts: 256
aka Abuse/AbU5e/TehJumpingJawa
|
 |
«
Reply #27 on:
2006-02-19 18:09:01 » |
|
I agree, 4K games are a very useful way of demonstrating technical abilities that are applicable in J2ME development (games or otherwise) a) Simple game design & implementation. b) Appreciation for size optimal code. c) Efficient exploitation of available APIs d) Familiarity with bytecode optimizers, obfuscators, and toolkits.
|
|
|
|
|
Mr_Light
JGO Strike Force    Posts: 893
shiny.
|
 |
«
Reply #28 on:
2006-02-19 20:52:38 » |
|
how much time would it cost to judge, and within which timespan?
I'd be willing, if wanted and able.
|
It's harder to read code than to write it. - it's even harder to write readable code.
The gospel of brother Riven: "The guarantee that all bugs are in *your* code is worth gold." Amen brother a-m-e-n.
|
|
|
noblemaster
JGO Ninja    Posts: 730 Medals: 6
Age of Conquest makes your day!
|
 |
«
Reply #29 on:
2006-02-19 23:07:20 » |
|
I guess I could judge too, if it does not take too much time? I did not submit a game.
|
|
|
|
|