Season 1 and 4 were directed by the original creator Van Partible and 2 and 3 were when he got kicked off.
Just adding flavor text to your post because I feel the same way. I like season 1 just for the fact that Johnny isn't a "he eats with his hands because he doesnt know what a fork is" bumbling idiot, but season 4 is the worst. The entire Hollywood special is trash. The Bollywood movie was trash.