Does the University ranking play a critical role in your academic career value?

I'm currently doing MSc in a mediocre University, the positive about it is that my level is better than some professors and I can easily ace any test, but would the name of the university play a big role in my CV? Especially that I'm planning to continue in PhD