Mathematics is a superclass over physics. The study of mathematics is the study of the foundations of the laws of physics.
There is an infinite amount of math that has nothing to do with physics, but all of physics is just math. The mathematics that's used to explain physics isn't just a "model" or "tool" it IS the law of physics.
Any notion of mathematics being in some way restricted to physics or "a language of the universe" or any other sentiment is nonsense. The universe and it's laws are math, math isn't the universe. It is a proper superclass over it.