Backing out the shift rod retainer is a bit of a pain, but not impossible. You should be able to drop the lower, replace the impeller, and reinstall in less than 4 hours.
This video is a good run down of the LU removal process --> V4 LU Removal from Brandon's Garage