CommunityData:Hyak Mox migration

This page includes resources that are useful for migration from Ikt to Mox (completed in June 2020) in Hyak.

Home directories

You're responsible for moving your home directories from Ikt to Mox. To do so, follow these instructions:

1. on IKT: prepare your homedirectory

First, go through and delete the things you don't want in your home directory. the program ncdu is installed on ikt and it will show you detailed information of what is taking up space. go through and recursively delete thing you don't want. if you want to archive things on cold storage, you can do that too by putting compressed tar files in /com/STAGING-cold_storage (we're strongly encouarged to ensure that each file is more than 100MB).

There are likely many hidden files as well. You can see those with "ls -a".

2. on IKT: make a tarball of your home directory

You will need to make a tarball of your home directory and store it in /com/STAGING-bbcp

 Note: change every instance of "<YOURUWNETID>" to your NetID (e.g., "makohill") before running the instructions below

$ ssh login2.hyak.uw.edu
$ cd /usr/lusers
$ tar cvf /com/STAGING-bbcp/<YOURUWNETID>_ikt_homedir.tar <YOURUWNETID>

3. on IKT: copy the file over to your new homedirectory on MOX

$ cd /com/STAGING-bbcp
$ hyakbbcp <YOURUWNETID>_ikt_homedir.tar mox1.hyak.uw.edu:/usr/lusers/<YOURUWNETID>/

4. on MOX: unpack you new data

Run the following:

$ cd /usr/lusers/<YOURUWNETID>
$ tar xvf <YOURUWNETID>_ikt_homedir.tar --transform 's/^<YOURUWNETID>/ikt_homedir/'
$ rm ~/<YOURUWNETID>_ikt_homedir.tar

This will create a new directory called ikt_homedir in my home directory on mox. I'll then go through and move out the things from ikt_homedir into ../ your new home dirctory. Or just leave them there if you want.

Moving files from ikt to mox

You can copy files at high speed without a password between the Hyak systems using commands like the ones below (instructions from the Hyak documentation).

From ikt to mox

   ikt1$ hyakbbcp myfile mox1.hyak.uw.edu:/gscratch/comdata/users/YOUR_ID/YOUR_DIR
   ikt1$ hyakbbcp -r mydirectory mox1.hyak.uw.edu:/gscratch/comdata/users/YOUR_DIR

From mox to ikt

   mox1$ hyakbbcp myfile ikt1.hyak.uw.edu:/com/users/YOUR_DIR
   mox1$ hyakbbcp -r mydirectory ikt1.hyak.uw.edu:/com/users/YOUR_DIR