On the basis you're trying to do this on smaller peices and probably not for selling to the queen, a cheap pillar drill might be of use? Mine is only the Silverstone one and while it's far from perfect, it does the job I want like putting 35mm holes in doors for hinges or whatever.
It's far...