The main reason for not bottoming the cutter is, as you tighten the collet it grips and lowers the bit and the collet and bit get jammed together making it very difficult to remove the bit, this would not cause it to become loose, in fact the opposite.
Try a different quality bit, could just be...