Have you looked at getjar, http://www.getjar.com/software? They allow you to limit the number of beta tester downloads.
I haven't had them beta test anything of mine, but some developers speak highly of the service in this thread: http://www.j2me.org/yabbse/index.php?board=11;action=display;threadid=3710


