I was thinking of a setting where all magic flows from this species of creature called the Baro worm. The worm's body absorbs magical energy from the area around it and retains it, meaning that each worm becomes a small well of magical energy. Ritualists use segments of of worms to power their circles. Meanwhile more traditional spellcasters enter a symbiotic relationship with a Baro worm by swallowing a worm larva and letting it live inside them like a tapeworm. In exchange for a share of the caster's energy, the worm acts as a magic reservoir and lets the caster throw fireballs and shit. However, this relationship usually terminates when the worm finally eats the caster's life force and kills them both.
Tell me if this sounds retarded, I'm still working on it. I was hoping to make a unique magic system and give a reason why everyone isn't a wizard