Von Neumann could read a book and recall it pretty much forever - word for word.
But what you describe it's pretty common, you just have the wrong method of studying. Read something about memory retention, you can improve a bit just by googling it. So, you're not a 200+ iq supergenius, but you're not necessarily dumb.