Note: I have only done college(highschool) level physics. A common way of explaining wormholes is that you draw two dots on a piece of paper and then fold the paper so that the two dots touch and bam! Now say you travelled through that wormhole to a different point in spacetime that is situated on a different point on the time axis (when looking at the universe as a graph) than the point of spacetime that you are currently at. Would that not count as time travel?