I'm 24 already trying to pursue a research career on math and theoretical physics, is it too late for me to dream about that lads? Can I make it?

I feel like I'm too old already, 24 is the age where the brain starts to slowdown, I should already have a degree by that age if I wanted to pursue a career as a professor/researcher. If I start now it will be 4 years of undergraduation then 2 years of masters then another 4 years for doctorate. 10 years in total, I would be 34 by the time I start doing serious shit and even then I probably won't even be close to the guys at ivy leagues, cambridge, oxford etc

Is there hope for me, brahs? Please be honest, I don't want to deluded, I want the cold truth.