If I were worried about drilling off center on a ball in a three jaw I would (a) use a center drill, and/or (b) face off a flat spot on the end the same diameter as the drill. Drilling using a drill press is a little more difficult, as Ian says, to drill a hole on a radius line directly to the center. A simple guide is easy enough to make if you have access to a lathe.