Firstly,is it unlocking , can you feel the clunk when you press the key fob ?
if it is then it must be the catch mechanism. I have never had my door cards off but there is usually a little pull rod or a cable between the handle and the catch,this could have come adrift if it was slammed...