Personally, it would drive me nuts, all that faffing around. It should be safe enough, done with care, but, as ChaiLatte points out, you may well have to true the wheels up after every change, even marking them and always installing in the same place as he suggests.
I would seriously consider...