There are people that are born special. I don't think every human being has what it takes to be a great fighter for example, no matter how hard they might try. But this is not an excuse for not trying. A human only uses a very small percentage of his physical potential - he uses his full potential in life-death situations, which in my opinion proves that it's all mostly mental, not physical.
Try hard and you might suprise yourself.