To get labeled a TERF, you would have to say more than that you like women.
You also have to say that men are terrible, being trans doesn't count and fuck trannies, those traitors and weasels!
Really, they are shunned among feminists for their vile rhetoric, and among other radfems for missing the point of fighting the supposed male oppression by discriminating against (at least the wrong) others.
So, to get kicked out of the lesbo-feminist hugbox, you have to say some real bad shit. And nobody else will yell at you for feminist heresy. They just call you a feminist, SJW or whatever.
This is not like "Nazi" where anyone could yell that at you. This is like being called the wrong kind of Nazi. Whatever that means. Maybe what shade of brown is okay or whether Aryan Persians are a reason to abandon the term?