Offline mode - base built away from initial respite disappears

I moved toward the middle of the Swamp Abeyance map away from my original "My Respite" map marker and built a modest 3X3 house with a new estate cairn and set it as my respite. I logged out and when i came back my house was gone as well as my original stick shelter at the "My Respite" marker. All of the materials used to create the shelter were missing as I thought it may not have been saved after I built the shelter.