I'm getting sick of words that don't have an agreed upon or simple meaning. "Fan" could mean a lot of things. It's not really a practical description for quality or behaviour.
To put more simply:
It think it is (probably) for the best that you ENJOY what you create, but I can also think of instances where some cynical person who hates their work puts out a fantastic job. Alternatively I can envision someone who is passionate completely fucking up. In the most realistic case, I think there are a lot of neutral people who don't really care either way, but you can't still guarantee what the quality might be. But you might also get somebody who genuinely cares for their work (they may, or may not be "fans") who can do great things.
That's my answer, as short as possible. Essentially: IT ISN'T SIGNIFICANT.