I did exactly as you advised. Some holes are now working better and some have still issues, but maybe after repeating the procedure a few times, it will sort out.May not help much in this scenario but the usual approach is slosh some oil on cotton wool/cloth/kitchen roll etc and wipe away. I'd be inclined to stick a dowel in your drill, wind some cotton cloth around it (making sure you wind in the direction that won't let it unwind in the hole), put plenty of olive oil on it and then use a slow speed and some pressure against the edges of the hole.