I think you maybe better off leaving it alone.
I would be afraid of it peeling even though
you would have to use an adhesive promoter.
Even to scuff it off is going to knock off the
texture.
My 2 cents, I'll ask a friend of mine what he thinks.