I live not too far from Stevenage. Stevenage a new town, and it's probably not going to win any beauty contests, but there are villages and towns around it that are older and more traditional. For instance Hertford, Ware, and even smaller villages. Stevenage is going to be cheaper than the prettier towns and villages to live in, and then there is a sort of middle choice which is Welwyn Garden City, which is slightly less concrete slab looking and will give good commuter train ride into the city if either of you are planning to stick with a job there.
My husband, a native Londoner, loves it in Hertfordshire. I miss London, but I don't mind living here. Part of what has made it bearable is living in a traditional town and not a new town. But as I said, there are many options from tiny village to large market towns as well as a handful of concrete new towns in the area.