I'm managing a fleet of devices that need to sync multi‑gigabyte data sets nightly. The current process saturates my ISP bandwidth and throttles other services. I've tried basic compression, but the gains are minimal.
Looking for strategies to reduce bandwidth usage while keeping sync times reasonable. Specifically:
- Delta sync algorithms that work across encrypted files.
- Bandwidth scheduling or throttling options in popular clients.
- Any open‑source tools that handle chunked transfers efficiently.
What have you implemented in similar environments?
Comments (3)
--link-destoption on the server side. It dramatically reduced the amount of data transferred after the initial full sync.--transfersand--bwlimitflags. It lets you cap the bandwidth per job.zsyncfor efficient delta syncing on encrypted blobs.