I would pull the rear housing either way, I would much rather know I was able to take a glance at the gears and inspect for any unusual wear and have a fresh RTV seal. IMO

I might be missing something here, but you said pull the axles apart, can't you just pull the rear diff cover nothing else?