...then just plain do it.
If in your heart (you and Tracy) you want the quiet and rural life, then just do it.
We moved to NH (I spent summers from my infant years at the lake) to make our home in 1996, having moved from Clifton Park NY. Clifton Park is a town of about 36,000 with no PD (sheriffs and State Police) and about 4 or 5 Vol FD's. You didn't say that you lived in south Clifton Park, you would say that you lived at Exit 8, exit 9, exit 10 etc off the Northway. We could run to Hannaford's or Market basket in 5 minutes. It was a bedroom community for Albany and Schenectedy, and was wall to wall subdivisions.
When we moved here, at the beginning of May, we found we had a 20-30 minute drive to a decent sized grocery store, and longer to a mall. It took us a while to adjust to this, like maybe June or perhaps July

, and we have never lived back. We live about a half mile off Alton Bay, on 3/4 acre of land, mostly wooded. We have a back porch that overlooks our brook, and that is where we spend most of our time in the summer.
Up here in the summer, you have Meadowbrook for entertainment, and smaller venues like coffee shops, 40 minutes or so to Concord and the Capitol Center, and about an hour to Manchester and the Verizon Center (entertainment, hockey, Concerts) or the FisherCats Baseball.
In short, if you want peace and quiet, rural pleasures, then as Nike says, "Just do it", and the rest will fall in place.
Enjoy, and an early welcome to the Lakes Region.