shaved door, and need help

i shaved the passenger side door handle on my mazda and it looks really good but when i started grinding i realized that the skin just under the handle area was sortof stressed inwards, i can push the area back out and then it looks perfect but when i let go the metal just sinks right back in.its from the bottom of the door handle all the way down to the top of the bodyline.how do i make the door go back to its original shape??