Can I suggest not to get too hung up on not damaging the wall? You'll have to make good anyway and it's often quicker, particularly if it's a stud wall to just re-lay new plasterboard. Before SDS hammer and rotation stop I sometimes used a long handled scraper, 24in or so long and a mallet on...