46

I use rsync to backup and synchronize network shares and my computer. I have this figured out.

The problem is, when using rsync to transfer files, it uses all the bandwidth it can. I want to cap it's speed, so that I can use my connection for other things.

Specifically, right now I am listening to Last.FM, but it keeps cutting out, as rsync is saturating local connection.

It sounds unlikely, but in this case my LAN really is as fast as my internet (10 megabit for both, yay university!). Either way, I have no extra bandwidth while rsync is running. Any ideas?

Oh, btw, specifically I am running Ubuntu 9.04.

Mike Cooper
  • 2,186
  • 7
  • 26
  • 36

2 Answers2

67

Use the --bwlimit=KBPS option to limit I/O bandwidth, KBytes per second

Also refer to the man page.

DaveParillo
  • 14,505
  • 1
  • 39
  • 46
  • Perfect. I don't know why I missed that in the `man` page the first time around. – Mike Cooper Oct 20 '09 at 23:03
  • 8
    after the fact, but wanted to point out that this option limits the average bandwidth. the first file is sent full blast and subsequent files are throttled to attempt to get down to the specified bandwidth value. to truly limit bandwidth, you would want to look into something like `trickle` – joshtronic Sep 19 '11 at 01:42
  • 1
    @joshtronic I wondered if you noticed supervacuo's answer? I have now tested this and can vouch for the fact that "the first file is sent full blast" is not true except for the smallest files. –  Apr 02 '13 at 19:14
20

(This would ideally be a reply to joshtronic's comment)

--bwlimit=XX in fact has the opposite problem; the transfer is indeed a moving average — as Rsync Basics helpfully explains:

Due to the nature of rsync transfers, blocks of data are sent, then if rsync determines the transfer was too fast, it will wait before sending the next data block. The result is an average transfer rate equaling the specified limit.

It's not clear whether the average is taken across files, but in any case it is not true that

the first file is sent full blast and subsequent files are throttled to attempt to get down to the specified bandwidth value

In fact the first file will be throttled as long as it is large enough for the averaging to kick in (which means all but the smallest files).

You're right that trickle would be a better solution, but what I understand from the explanatory paper ("Trickle: A Userland Bandwidth Shaper for Unix-like Systems") is that trickle also works by delaying I/O based on a moving transfer average. I guess the hope in recommending it is that it uses a higher-frequency measurement to apply the average. I haven't been able to find any data online that confirms this to be the case (although the paper above does refer to rsync's code as "simple", suggesting the authors of trickle think theirs does a better job).

Community
  • 1
supervacuo
  • 531
  • 5
  • 10