I thought I read somewhere that you can pass the socket information from the server to the game and that would allow the game to talk to the client directly.
I'll see if I can get that going.
Edit: I'm an idiot, I've been using this already for quite a while with my chat program.

So what I'm looking for is a way for the client to talk directly to the Game that gets launched by the Server Program instead of having to talk to the server, have the server parse the code and see what kind of message it is, who its supposed to go to, etc.