There are four places I've been back to in as recently as the past four years.
Oddly, the level of my desire to return to each work backwards chronologically.
Washington DC area: I attended K thru 3 in McLean, VA. I'll actually be returning there to visit at the end of this month, and also another trip there next month. My family's in the area and I see it to hold no past memories other than the family tradition of whenever any family member visits, we all have to pile in the car and drive by the old house, keeping low in the car so the neighbors (who still live across the street) don't know we're doing this.
Frankfurt Germany: I was there for 5th and 6th grades, and we drove by Camp King a couple years ago to see where I used to live, and they were in the process of demolishing the whole street. It was emotionally devastating and I cried buckets. But I would go back, with no hesitation, to see the area again.
Carlisle Pennsylvania: Grade 4, and then again grades 7 thru 12. We went back for my 30th high school reunion. Everyone was the same. The old haunts still standing. It was...actually rather depressing to see this little community caught in a time warp. I really felt I was in the Twilight Zone. But, it also gave me a feeling of being 17 and going to football games. It was just really strange seeing so many people all in one room that I knew! I'd go back, but I'm not sure what I'd do if I did. I feel like I've moved on while they haven't. And I'd probably start saying "Ignernt" again.
Naples, Florida: The previous 20 years before here. (If you could see me you'll note that I'm holding both my index fingers up, together forming an "X".) N o . w a y . do . i . e v e r . w a n t . t o . g o . b a c k . Mostly to do with ex issues. But there really isn't anything there for me any more. Any friends I had have moved on themselves.