Receive daily AI-curated summaries of engineering articles from top tech companies worldwide.
Endigest AI Core Summary
This post explains how Dropbox reduced their server monorepo size from 87GB to 20GB (a 77% reduction), cutting clone times from over an hour to under 15 minutes.
•The monorepo had grown to 87GB and was approaching GitHub's 100GB hard limit, with CI jobs paying the full clone cost repeatedly
•Root cause was Git's delta compression heuristic, which uses only the last 16 characters of a file path to pair files — mismatching i18n files across languages instead of within them
•An experimental --path-walk flag fixed the issue locally but was incompatible with GitHub's server-side optimizations like bitmaps and delta islands
•The solution was a server-side repack using tuned --window and --depth parameters, which took ~9 hours but reduced the mirror from 84GB to 20GB
•
GitHub rolled out the production repack gradually (one replica per day) while monitoring fetch duration, push success rates, and API latency to ensure stability
This summary was automatically generated by AI based on the original article and may not be fully accurate.