The reason our ancient ancestors dwelt in caves is because they were relatively stable, temperature wise. Close to the surface, the temps drop initially but the further you get into a large cave system the temps actually start to go back up, or so I've read. If you could get deep enough, you would have a constant temperature regardless of the weather outside.
An earth coupling can only do so much, but that is the basic principle it works off of. Likewise the Trombe Wall. Any large masonry structure will perform a moderating effect, slowing the loss of heat in winter and loss of cool in summer.
Passive solar is always something to consider, but it is easy to go overboard. Most places I've lived, solar not properly buffered in Summer would actually roast a place. So I've always thought, though never had the opportunity to actually do, to use the roof overhang to start cutting off the sunlight right around the Equinox, and allow the most sun during the Winter.
Here in the Southern US, cooling is the more difficult. An old trick from before air conditioning is a wrap around porch. North side isn't so much concern, but the South, East and West would have a covered porch that stuck out from the house, and while it may look old fashioned now it went a long way to moderating the summer temps without using electricity.
Another thing to consider is root cellars and the like, how food was stored before electricity was widespread. I was watching a show some time back that demonstrated the use of a little bit (a few blocks, but comparatively little) of ice and strategic insulation to keep a fairly large area cool enough to keep food refrigerator cold for prolonged time. The ice would last well into Spring, even early Summer.