How much physics do I have to know to understand theories about the beginning of the universe?

Im a math guy, no real physics background, but the beginning has always fascinated me. I would like to self-study a bit and gain a layman’s understanding of inflation, multiverses, the big bang etc. Where would I start?