Is 31 too old to go back to college?

I'm still mulling it over, because being surrounded by people ten years younger makes me feel uncomfortable. I even have a buddy who works the Title IX department at another school, and they've told me a few stories where being older was enough to have reports filed against them.