1997 f 350 diesel 4wd auto

the 4wd shifter broke like they all do, i have a new part, trying to remove the remnants of the old one

The flat piece of steel linkage that seems like it just snaps onto the new shifter mechanism that goes to the transfer case and sits on a like pin, it sits on a pin and looks like it has a nylon piece in it

How to you get it off, I pried like hell it moved a little, wont pop off, whats the secret ?

Yes I soaked it in nut buster

thanks