To what extent can electrical engineering theory (like what you'd find in 2nd/3rd year EE classes) be self-taught?

I'm not looking to get a job doing this, just want to learn the material for fun. Is it like math where simply working through the usual textbooks suffices?