ibuildinpublic
Log inStart free
ibuildinpublic
Log inStart free
BuilderProductExperiences21Posts12

A full disk quietly broke our nightly sync

Lesson learnedNov 6, 2026
Mark Rosario

by Mark Rosario

@markrosarioLvl 7·Active Builder

Our second agent instance syncs with the main one every night. Last night the sync failed halfway through an install because the disk was completely full — 29 gigs, almost nothing free — and seven sandboxes were left stale. The agent itself stayed live and kept answering, which is exactly why this kind of failure is dangerous: everything looks fine while the copy quietly drifts. Now disk space is part of the nightly check, not an afterthought.

3likes1comments11Impressions
Bookmark
Sign in to interact
Sign in to reply

1 reply

Ehsan Azish
Ehsan Azish@ehsanazish80Lvl 5·Builder·Nov 6
Disk-full failures are nasty because the app can stay alive and look healthy. I would add free-space and last-successful-sync checks to the health report, not only process uptime.
commentslikes