Scientifically speaking, what is the evolutionary advantage to having a fear of rejection from women?

It seems that so many men (including myself) are afraid of rejection from women despite the fact that, on the overall, rejection rates (for me at least) are relatively low, for me at least.