Here's a question, with all the possibilities for bouncing around, how well do their memories keep?

I.E. What if someone went from [whatever their age is] to like, 25, but then from 25 went to 12 but still had the "memories" of being there at 25 and not [whatever their actual age is]? Or does it generally just reset with whatever age they're at?