Try To Use rsync To Complete scp Failed Job

Here is a little trick/tip for nerds who manage websites with a server which allows tools such as SSH and Rsync.  Basically, let’s say you were doing scp command such as …

[scp -r -Cpv example@example.com:/home/example/public_html/* ~/Download/backup/example.com/public_html/]

but your Internet connection got disconnected and stopped the scp command from completing the process of copying files from remote server to local server.  If you don’t have a lot of files to copy, then you should be able to use the same scp command to copy the same files again until everything got copied from remote server to local server.  What if you got huge amount of files (i.e., in tens of Gigabytes) to copy down from remote server to local server?  The disconnection of the Internet during scp process is a devastation in this situation, because the scp command would restart the copying of existing files that already downloaded to your local server.  This would be a waste of time.

No sweat.  I got a solution for you.  Try to use rsync command to sync remote files to local files instead.  This would mean existing files will be skipped, and rsync would only download new files from remote server to local server.  Of course you can reverse the direction of file copying too such as from local server to remote server using rsync.  Nonetheless, the command right after this paragraph shows you how to stop wasting time and continuing the copying of files from remote server to local server in the case scp got interrupted.

[rsync -avzhe ssh example@example.com:/home/example/public_html/* ~/Download/backup/example.com/public_html]

This rsync command I’d mentioned above uses the e parameter to append the ssh command so rsync can be done through SSH for secure file copying.  Basically, the e parameter specifies a remote shell to be used.  By the way, the other parameters are -a (equivalent to -rlptgoD – meaning preserving more files attributes than just using -r), -v (verbose printout), -z (compress files during transfer for faster file transfer), and -h (output numbers in human readable format).  By using rsync this way, you can now continuing the process of copying files from remote server to local server when scp failed to complete the job the first time around.

Advertisements

You Can Still Upgrade To Windows 10 For Free Unless You Watch This Video Too Late

Microsoft stopped allowing people to upgrade to Windows 10 for free the regular way, and so you either have to purchase Windows 10 from Microsoft and online web stores such as Amazon or you can try the method in this video to get Windows 10.  In the video, I reveal how you can upgrade your Windows 10 from Windows 8.1 for free.  I’m not sure you can do this with Windows 8 or 7, but you can give it a try.  I know for sure this method will work with Windows 8.1 though.  Anyhow, check out how to upgrade to Windows 10 for free in the video right after the break.  Enjoy!

Unity Adam Demonstration Short Film Shows Amazing Real Time Graphics Rendering By Unity Game Engine

Unity, the latest Unity’s game engine iteration perhaps or I could be wrong, shows how powerful it is to be able to render super high quality graphics in real time, and the result can be seen in the a short film right after the break.  Unity is a game engine, and the personal edition is freely available for downloading.  You have to pay if you want the professional edition.

XSLT Basics For Transforming One Specific XML Structure To Another XML Structure

I was messing around with R (i.e., a free program that can organize and transform data), and I told R to transform the data into CSV format.  I converted this CSV format file into XML file using one of those CSV to XML free tools on the Internet.  The problem is that the XML file I got from the whole process contains structure in which is radically different from the XML structure that I need to use with a software.  Luckily, XSLT comes to the rescue.  With XSLT, I discover that it’s possible to transform one XML structure to another XML structure.  The problem is that I have no knowledge of how to use XSLT just yet.  Once again, YouTube is a treasure trove of free information, and the YouTube video right after the break introduces me to XSLT basics.  Of course, I may have to do more study and research on XSLT before I would know how to properly transform one XML structure to another XML structure.

R Datalicious

R is calling me.  Anyhow, I’m trying to learn R.  I think R is very powerful, because it has features that allow you to collect data in various ways.  With R, you can also easily analyze data and make charts, graphs, and whatnot.  I’m a newbie in R, and so I may not be able to fully appreciate R.  I’m a newbie in R, and so I don’t know how to express how powerful R is to you.  Nonetheless, I know a few things so far.

Here is one example among many of how I understand R could be used by you.  With R, you can install Rvest package to easily collect data from the Internet (i.e., websites).  Note:  Data don’t have to come from the Internet.  It’s possible to use R to collect data and then store the data into MySQL database.  It is also possible that the data in MySQL can also be converted back into appropriate data formats in which R would be able to utilize.  Marrying MySQL and R together, it’s possible to enlarge the data collection scale by using R, and using R to format data in various manners.  (My newbie speak, because you may know of a more elegant way of going about using R in this specific manner.)

Anyhow, to scratch the surface of R and see how powerful R can be, just check out the two videos right after the break.  (These YouTube videos are not mine, because I embed them from other YouTube’s user-generated content authors.)  Enjoy!