seanybaby,
Working in a production engineering capacity I came across the use of drill guides in a production environment. About 1300 operations per day. The biggest problem was the quickly buggered twist drills, as the jig etc. tended to rattle around during removal of the drill, it not being allowed to stop rotating. The operators were not very interested in correct positioning of the drill with respect to the guide before pushing the drill through the hole either. All this led to the active corners of the twist drills being quickly lost. Build up of swarf was also a problem as the flutes on the drills quickly became compacted and helped generate sufficient heat to 'blue' the drills, and sometimes smoke a bit. Now at the time most of the holes were 5mm or larger so the factory could just about live with the problems.
Fortunately 90% of the tasks requiring jigged drilling were solved with a jig redesign.
The Answer.
Get rid of the jig which was temporarily attached to the work.
I designed a jig which referenced the centre hole of the pillar drill table. The setup was to ensure that the drill was centred on the hole and the jig fitted to that. Adding fences, which in some cases were adjustable, allowed work to be aligned anywhere within reason. Job done. No more buggered twist drills, faster loading/unloading of work, jigs made very quickly in-house so no more costly drill guides, no more jig re-builds if the customer suddenly changed his design, easier swarf removal . All in all a reasonable success. Now I don't know if any of this is relavent to your job, but it may be worth looking at the job again.
xy