I need to transfer 350GB of data from my home to my parents' home.
-
@bojanlandekic @flux @david_chisnall I am not aware of a way to do it adaptively by time (e.g. use full bandwidth during "night" hours, and throttle to 2Mbit during "day" hours), or any other factor come to think of it...
Ideas welcome!
@neil @bojanlandekic @flux @david_chisnall Restrict it to 90% all the time.
-
@neil @bojanlandekic @flux @david_chisnall Restrict it to 90% all the time.
@mansr @bojanlandekic @flux @david_chisnall
That would leave my parents with ~1Mbit, so not ideal!
-
@mansr @bojanlandekic @flux @david_chisnall
That would leave my parents with ~1Mbit, so not ideal!
@neil @bojanlandekic @flux @david_chisnall I suppose you could have a cron job restart the rsync with different options at different times. There are also ways of rate limiting at the kernel level.
-
@neil @bojanlandekic @flux @david_chisnall I suppose you could have a cron job restart the rsync with different options at different times. There are also ways of rate limiting at the kernel level.
@mansr @neil @bojanlandekic @david_chisnall Yes! Lots of good options. Wonder if rclone has some additional features that make it easier than rsync to manage.
-
@mansr @neil @bojanlandekic @david_chisnall Yes! Lots of good options. Wonder if rclone has some additional features that make it easier than rsync to manage.
@flux @neil @bojanlandekic @david_chisnall Additional features is something I've rarely wished for in rsync.
-
@mansr @bojanlandekic @flux @david_chisnall
That would leave my parents with ~1Mbit, so not ideal!
@neil @mansr @bojanlandekic @flux
TCP rate limits based on the delay of the acknowledgments and most consumer routers are pretty good at ensuring some modest fairness between streams.
The main failure mode is in the opposite direction with asymmetric home connections. If you’re doing a lot of uploads, the TCP window replies get delayed and that tanks the download speed.
-
I need to transfer 350GB of data from my home to my parents' home.
It will take ~70 hours longer to do this via the Internet, than if I copied it to a drive here, travelled there, plugged the drive in, then travelled back.
Oh well.
@neil This reminds me of a visit to Jodrell Bank in the early 2000s. They were syncing data between an international array of radio telescopes, and boasted that their fastest data transfer medium was FedEx.
-
@neil This reminds me of a visit to Jodrell Bank in the early 2000s. They were syncing data between an international array of radio telescopes, and boasted that their fastest data transfer medium was FedEx.
@kbm0 Yep!
-
I need to transfer 350GB of data from my home to my parents' home.
It will take ~70 hours longer to do this via the Internet, than if I copied it to a drive here, travelled there, plugged the drive in, then travelled back.
Oh well.
@neil Here’s me, preparing to transfer half a terabyte from our data center to the office. 20 mins or so, less if I ignored a few speed limits.
-
I need to transfer 350GB of data from my home to my parents' home.
It will take ~70 hours longer to do this via the Internet, than if I copied it to a drive here, travelled there, plugged the drive in, then travelled back.
Oh well.
@neil A few years ago, a friend of mine used to use the phrase "sneakernet" for that.
-
I need to transfer 350GB of data from my home to my parents' home.
It will take ~70 hours longer to do this via the Internet, than if I copied it to a drive here, travelled there, plugged the drive in, then travelled back.
Oh well.
Sometimes sneakernet is still the fastest way to move data.
I remember working for an org decades ago with little tiny WAN pipes when I first got there, people complained all the time, it never met expectations. I recall doing the math for them to give them some kind of mental picture.
Our most remote building was about 5 mi / 8 km from town. If you had to move more than about a CD's worth of data it was faster to walk it over.
-
I need to transfer 350GB of data from my home to my parents' home.
It will take ~70 hours longer to do this via the Internet, than if I copied it to a drive here, travelled there, plugged the drive in, then travelled back.
Oh well.
My maths sucked. 27 hours
-
I need to transfer 350GB of data from my home to my parents' home.
It will take ~70 hours longer to do this via the Internet, than if I copied it to a drive here, travelled there, plugged the drive in, then travelled back.
Oh well.
@neil subscribe to Neil now for 5x faster data speeds.
-
My maths sucked. 27 hours
@neil you may keep your geek card. The sin is *under*estimating the bandwith of tapes in a stationwagon. Overestimating it is allowed.
