I feel like this comment has a coherent point but it expresses it so poorly that you're left spending minutes working out different things it might mean and trying to weigh which is most likely.
Is the implication that he has an inflated opinion of himself so shields himself from the world because on some level he knows it will violate and undermine his self perception?
Or is it implying that he's based his self-image on the idea of being an underappreciated and unfairly ostracized intellectual with a good heart, which would put him in a no-win situation, i.e. either she rejects him, which he expects and which gains him nothing, or she gives him a chance, in which case he subconsciously fears she'll later end things with him after seeing the real him, thus shattering his much needed illusion that the only reason he's ostracized is because people don't take the time to get to know him and judge him too quickly.
These are my leading ideas and I think I put them both across way better than the comic did. If it actually is anything else then it's just beyond me.