You must have the long and skinny Mitsubishi starter.
Does it look like this?
And your trouble is the cross member is right in the way.
You need to turn the starter just a little at a time, when you get it in exactly the right place it will drop right out.
Try to pay close attention to how it is turned when it comes out, that is how it has to go back in.
I just swapped mine this summer, if I remember right turn the solenoid on top away from the motor just a little.