What voltage are the units? 12V is a lot easier than 18V. A good 18V drill may require possibly 300-500W peak power, around 20A-30A. If your drill is that kind of power and you want full capability, you will need a suitably powerful PSU. They are available, at 12V. A computer PSU's and Amazon have some examples of 12V 30A supplies so it's just a case of a bit of engineering. Some battery chargers can be used, as a 12V supply. Others need 12V present to enable them.
I think it would be a lot of messing around when drills are so cheap now, but if it's a interesting challenge to you, it is possible. I haven't looked at any of the youtube videos, so not sure what techniques they use.
There are many options. First thing is to establish what voltage and current you really need. You can reduce the current to the drill, but the torque will reduce, just as it does when the battery goes flat. A quick check..... You can get laptop supplies, which are 19V/7.5A. That would power a 18V drill. You will find a suitable supply if you search, but you need to know what you are looking for.
If you just plan to use the drills for small scale stuff, there are lots of I.T. power modules available at 12V and 18V(19V), just try to find the highest rating for what you are willing to pay. You may have some suitable module already?