Considering changing degree path to Math with a focus in teaching. Is this a horrible idea?

Two years into college now, focused towards computer science. Realizing outside of algorithms and computer architecture, I have no interest in working as a software engineer.

Tutoring students and learning math has always felt rewarding to me though.