I did mine about a month ago to install new speakers.
I probably didn't do it the right way but didn't break anything.
I just removed the seat-belt nuts like Rockledge said and then just pulled the panel as hard as I could.
It worked.