You might consider adding an alternate render pass (which doesn't get shown on-screen, but perhaps is overdrawn with the real render) which uses a unique color per object, so the system can query the object underneath the pixel via glReadPixels of the color buffer. I've been told by the NASA World Wind Java development team that they use this technique for picking in their system with good success.