You have two dissimilar metals , this forms a corrosion and is called galvanic, soak the joint in say WD 40 after a while heat the ally from the front, it won't hurt the bearings, in the faceplate put a bolt through that you can hit and lock the outboard end somehow then hit the bolt down sharp...