Editing CommunityData:Hyak Mox migration

From CommunityData
Warning: You are not logged in. Your IP address will be publicly visible if you make any edits. If you log in or create an account, your edits will be attributed to your username, along with other benefits.

The edit can be undone. Please check the comparison below to verify that this is what you want to do, and then publish the changes below to finish undoing the edit.

Latest revision Your text
Line 1: Line 1:
This page includes resources that are useful for migration from Ikt to Mox (completed in June 2020) in Hyak.
=== Moving files from ikt to mox ===
 
== Home directories ==
 
You're responsible for moving your home directories from Ikt to Mox. To do so, follow these instructions:
 
=== 1. on IKT: prepare your homedirectory ===
 
First, go through and delete the things you don't want in your home directory. the program ncdu is installed on ikt and it will show you detailed information of what is taking up space. go through and recursively delete thing you don't want. if you want to archive things on cold storage, you can do that too by putting compressed tar files in /com/STAGING-cold_storage (we're strongly encouarged to ensure that each file is more than 100MB).
 
There are likely many hidden files as well. You can see those with "ls -a".
 
=== 2. on IKT: make a tarball of your home directory ===
 
You will need to make a tarball of your home directory and store it in <code>/com/STAGING-bbcp</code>
 
{{note}} change every instance of "'''<YOURUWNETID>'''" to your NetID (e.g., "makohill") before running the instructions below
 
<syntaxhighlight lang='bash'>
$ ssh login2.hyak.uw.edu
$ cd /usr/lusers
$ tar cvf /com/STAGING-bbcp/<YOURUWNETID>_ikt_homedir.tar <YOURUWNETID>
</syntaxhighlight>
 
=== 3. on IKT: copy the file over to your new homedirectory on MOX ===
 
<syntaxhighlight lang='bash'>
$ cd /com/STAGING-bbcp
$ hyakbbcp <YOURUWNETID>_ikt_homedir.tar mox1.hyak.uw.edu:/usr/lusers/<YOURUWNETID>/
</syntaxhighlight>
 
=== 4. on MOX: unpack you new data ===
 
Run the following:
 
<syntaxhighlight lang='bash'>
$ cd /usr/lusers/<YOURUWNETID>
$ tar xvf <YOURUWNETID>_ikt_homedir.tar --transform 's/^<YOURUWNETID>/ikt_homedir/'
$ rm ~/<YOURUWNETID>_ikt_homedir.tar
</syntaxhighlight>
 
This will create a new directory called <code>ikt_homedir</code> in my home directory on mox. I'll then go through and move out the things from <code>ikt_homedir</code> into <code>../</code> your new home dirctory.
Or just leave them there if you want.
 
== Moving files from ikt to mox ==


You can copy files at high speed without a password between the Hyak systems using commands like the ones below (instructions from the [http://wiki.cac.washington.edu/display/hyakusers/Hyak+mox+Overview Hyak documentation]).
You can copy files at high speed without a password between the Hyak systems using commands like the ones below (instructions from the [http://wiki.cac.washington.edu/display/hyakusers/Hyak+mox+Overview Hyak documentation]).
Please note that all contributions to CommunityData are considered to be released under the Attribution-Share Alike 3.0 Unported (see CommunityData:Copyrights for details). If you do not want your writing to be edited mercilessly and redistributed at will, then do not submit it here.
You are also promising us that you wrote this yourself, or copied it from a public domain or similar free resource. Do not submit copyrighted work without permission!

To protect the wiki against automated edit spam, we kindly ask you to solve the following CAPTCHA:

Cancel Editing help (opens in new window)

Template used on this page: