| 03:02.11 | *** join/#byumug guest_0044 (~BYUMUG@s216-232-15-17.bc.hsia.telus.net) |
| 03:43.33 | *** join/#byumug wps_ (~wade@65.73.113.199) |
| 03:44.18 | *** mode/#byumug [+o wps] by ChanServ |
| 06:17.36 | *** join/#byumug dburton82 (~icechat5@24-119-173-242.cpe.cableone.net) |
| 06:17.48 | dburton82 | hello |
| 13:25.00 | *** join/#byumug guest_4343 (~BYUMUG@dhcp-180-43.eps.utexas.edu) |
| 13:25.07 | *** part/#byumug guest_4343 (~BYUMUG@dhcp-180-43.eps.utexas.edu) |
| 13:35.43 | *** join/#byumug guest_1393 (~BYUMUG@dhcp-180-43.eps.utexas.edu) |
| 13:35.50 | *** part/#byumug guest_1393 (~BYUMUG@dhcp-180-43.eps.utexas.edu) |
| 15:55.44 | *** join/#byumug wps (~wade@207.108.169.214) |
| 15:55.47 | *** mode/#byumug [+o wps] by ChanServ |
| 15:56.25 | macnewbold | ~seen drewbono |
| 15:56.27 | jbot | drewbono <~andrew@c-67-161-242-223.hsd1.ut.comcast.net> was last seen on IRC in channel #byumug, 21h 50m 27s ago, saying: 'or whatever command you want to run'. |
| 15:56.32 | macnewbold | doh |
| 15:56.37 | macnewbold | where's drew when you need him... |
| 15:59.33 | wps | :) |
| 16:01.20 | wps | mac? |
| 16:01.45 | wps | macnewbold |
| 16:01.56 | macnewbold | yep |
| 16:02.23 | macnewbold | (sorry, "mac" doesn't get my attention, cause if I had a nickel for every time someone said "mac" and wasn't talking about me...) |
| 16:02.26 | macnewbold | sup, wps? |
| 16:02.33 | wps | understood :) |
| 16:03.08 | wps | how much data would you consider too much to be reasonable to rsync across the internet on a semi-daily basis? |
| 16:04.16 | wps | as much as you are willing to wait for? or is there a point where it is ridiculous and a different approach should be investigated? |
| 16:05.30 | macnewbold | that's the beauty of rsync - you only have to transfer what has changed, which usually is much smaller than the size of the collectoin |
| 16:05.35 | macnewbold | thta you're syncing |
| 16:05.52 | macnewbold | it depends mostly on how much is changing |
| 16:06.02 | wps | ah, sorry... let me rephrase |
| 16:06.03 | macnewbold | I know that rsync is a pretty popular way to do backups |
| 16:06.28 | wps | well, actually not rephrase completely |
| 16:06.46 | wps | even if nothing has changed, it still takes a certain amount of time to run through each file and check if there were changes |
| 16:06.49 | wps | so even the check takes time |
| 16:07.23 | wps | and if you are rsync-ing 50 GBs, even a check without any changes would take a while |
| 16:08.13 | macnewbold | not really, wps... it depends on number of files, not size of the files. |
| 16:08.30 | macnewbold | it just checks the timestamps and sizes of the files |
| 16:08.31 | wps | ah, yes, correct |
| 16:08.55 | macnewbold | so unless the average file in your 50GB is less than 1MB, you'll be fine |
| 16:09.08 | macnewbold | just make sure to _never_ turn on the checksums for the whole thing ;) |
| 16:09.13 | macnewbold | that _would_ take forever |
| 16:09.25 | macnewbold | about how many files do you think it is? |
| 16:09.37 | wps | my home directory is 15 GB |
| 16:09.42 | wps | let me get the file count |
| 16:09.47 | macnewbold | (if you don't know, you can go to the dir, and type "find . | wc" |
| 16:09.49 | macnewbold | ) |
| 16:10.05 | wps | 31869 |
| 16:10.08 | macnewbold | that will be files and directories, which is what matters to rsync |
| 16:10.25 | macnewbold | we regularly do over 5000 files for one client, and it takes just a few seconds |
| 16:10.32 | macnewbold | it runs through them _really_ fast. |
| 16:10.53 | macnewbold | for an idea of what it would take if it didn't have to actually transfer any changes, you can run your rsync command with the -n option |
| 16:11.01 | wps | my 31869 took about ten minutes |
| 16:11.04 | macnewbold | which says "just tell me what you would do, but don't actually change anything" |
| 16:11.07 | macnewbold | cool |
| 16:11.23 | macnewbold | if that 10 minutes per day is worth it to you, then it's worth doing the backup probably |
| 16:11.51 | wps | well, the nice thing is it'll be happening while I am commuting so I won't even be waiting in front of the computer for it |
| 16:11.54 | macnewbold | the biggest thing that will affect how much has to get transferred is how much you touch/change in a day |
| 16:11.56 | macnewbold | right |
| 16:12.21 | macnewbold | what speed will the connection be between the two hosts? |
| 16:12.22 | wps | I might choose to leave my caches out too, as that would speed things up |
| 16:12.29 | macnewbold | yeah, that's true |
| 16:12.43 | macnewbold | you'd really only want to send stuff that mattered long-term probably |
| 16:12.48 | macnewbold | caches are disposable |
| 16:13.10 | wps | well, my purpose is to have my work environment and home environment identical |
| 16:13.24 | macnewbold | right, so you'll sync both ways? |
| 16:13.29 | wps | yes |
| 16:13.40 | wps | with the remote location being an inbetween |
| 16:13.48 | wps | sync home to server when I leave house |
| 16:13.54 | macnewbold | then you'll want to be careful if/how you use --delete |
| 16:14.07 | macnewbold | right... sync up when you leave each place, and you can use --delete |
| 16:14.09 | macnewbold | safely |
| 16:14.19 | macnewbold | include or exclude caches won't really matter |
| 16:14.19 | wps | sync server to work when I get to the office |
| 16:14.29 | macnewbold | and vice versa |
| 16:14.32 | wps | sync work to server when I leave office |
| 16:14.33 | wps | exactly |
| 16:14.42 | macnewbold | what's your bw from home to the server and from work to the server? |
| 16:15.01 | wps | I am supposed to have 1 MB up at home |
| 16:15.15 | wps | currently I am only getting 80k/s though :( |
| 16:15.28 | wps | I am working with my ISP right now though to figure out what is wrong |
| 16:16.12 | macnewbold | where's the server? |
| 16:16.25 | wps | Orem |
| 16:16.40 | macnewbold | what internet connection does it have? |
| 16:16.59 | wps | it's the uphpu.org box, at UVNet, so it has a nice pipe |
| 16:17.11 | macnewbold | yeah, something's messed then |
| 16:17.18 | macnewbold | are you slow to anywhere, or just to the server? |
| 16:17.25 | wps | everywhere |
| 16:18.18 | macnewbold | yeah, then it's your pipe |
| 16:18.27 | macnewbold | what about work? what cnxn does it have to the net? |
| 16:18.38 | wps | oh yeah, it's definitely something wrong on my end. |
| 16:18.44 | wps | not sure about work |
| 16:18.48 | wps | it's a business DSL line |
| 16:19.15 | macnewbold | is there something sending stuff to/from your home that you're not aware of? Maybe another computer on your network? |
| 16:19.29 | macnewbold | a dsl line should probably get at least 1.5Mbps down, and probably almost 1mbps up |
| 16:19.44 | wps | might be, not sure |
| 16:20.03 | wps | this is what the java speed test just gave me here at work: |
| 16:20.04 | wps | Your download speed : 1222386 bps, or 1193 kbps. |
| 16:20.04 | wps | A 149.2 KB/sec transfer rate. |
| 16:20.04 | wps | Your upload speed : 832812 bps, or 813 kbps. |
| 16:22.10 | wps | if I can get my upload fixed at home then I should be set |
| 16:22.38 | wps | because all of the big file size changes (adding new MP3s or photos to my home dir) that I will be making will be made at home |
| 16:22.54 | macnewbold | yeah, that sounds good |
| 16:23.38 | macnewbold | do you have any bandwidth quotas or caps (i.e. per week or per month) on any of your connections (home, server, or work)? |
| 16:24.02 | wps | I do at home |
| 16:24.13 | macnewbold | how high is it? that might be an issue... |
| 16:25.04 | wps | 3 GB/month |
| 16:26.57 | macnewbold | 3GB?!?! |
| 16:27.02 | macnewbold | yeah, that won't last long |
| 16:27.41 | macnewbold | XM just raised theirs from 20GB/mo up and down for dsl to 100GB/mo total, IIRC |
| 16:27.59 | macnewbold | big changes will blow that away pretty quick, I think |
| 16:28.00 | wps | wow |
| 16:28.18 | wps | yeah, I wonder if this is even going to work |
| 16:28.19 | macnewbold | they do that on DSL cause nobody really uses that much except for a handful they need to keep under wraps |
| 16:28.36 | macnewbold | our coloc box currently is on the 75G/mo plan, soon to upgrade to the 150GB/mo plan |
| 16:28.48 | macnewbold | (equiv. to 512Kbps constantly) |
| 16:28.58 | wps | I might have to go back to way I was doing it earlier: using my iPod as the inbetween |
| 16:29.12 | macnewbold | if you're carrying it with you, that would work. |
| 16:29.19 | wps | yeah, it was working |
| 16:29.29 | macnewbold | transfers over firewire or usb2 should be about 400Mbps |
| 16:29.59 | macnewbold | yeah, unless that 3GB limit is negotiable, you might have to keep doing htat, |
| 16:30.04 | macnewbold | though you could still use rsync nicely |
| 16:30.19 | macnewbold | it would work just like syncing one local dir to another local dir |
| 16:30.33 | wps | yeah |
| 16:30.45 | macnewbold | 400Mbps should be about 50MB in a second |
| 16:31.03 | macnewbold | or up to 3GB/minute |
| 16:31.10 | macnewbold | so it should be pretty quick if all goes well |
| 16:31.16 | wps | yeah, it was quick |
| 19:38.59 | *** join/#byumug drewbono (~andrew@c-67-161-242-223.hsd1.ut.comcast.net) |
| 19:39.03 | *** mode/#byumug [+o drewbono] by ChanServ |
| 23:23.20 | *** join/#byumug wps (~wade@207.108.169.214) |
| 23:23.23 | *** mode/#byumug [+o wps] by ChanServ |
| 23:32.52 | *** join/#byumug wps_ (~wade@207.108.169.214) |
| 23:35.33 | *** mode/#byumug [+o wps] by ChanServ |
| 23:49.42 | *** join/#byumug wps (~wade@207.108.169.214) |
| 23:49.45 | *** mode/#byumug [+o wps] by ChanServ |