Use your lathe or drill press. A pad turned (made of hardwood or plastic) to fit the drill chuck in the tailstock and MDF or similar mounted to a faceplate. Push the parts together by winding in the tailstock. Same pad in the drill press pushing down towards the table.
Pete