Has anyone changed out the plastic tailgate liner, particularly one with the tailgate step? What is under the plastic liner?

I want to get a gray spray-in bedliner (Rhino), but the color might look a bit goofy next to the black plastic of the factory tailgate liner. I could perhaps take the black plastic out, although that would expose the grab handle. Taking the grab handle out might solve that issue. Would removing the liner leave holes in the tailgate?

Anyone have any thoughts?