Having `imposter syndrome' is being aware of your incompetence. Telling yourself that you're being too critical of yourself is just cope.
The real problem is that you haven't been critical enough of others in the same way. Perhaps you're too afraid to admit your field is not as good as you thought.