Erm... I don't like to contradict Titman, but the answer here wasn't anything to do with the collet or bit size in the end. Although, I now agree, having been enlightened by the experts, that even 0.35mm makes a difference, my problem turned out to be caused because I wasn't snapping the collet...