Can anyone help me with this dilemma?

You don't owe anyone an explanation. If someone brings it up, well just like you say here you have a hard time dealing with failure and that is what lead to the confusion. If they really are your friends they should be able to deal with that.