CommunityData:Hyak migration (mox to klone): Difference between revisions
Line 20: | Line 20: | ||
$ ssh login2.hyak.uw.edu | $ ssh login2.hyak.uw.edu | ||
$ cd /usr/lusers | $ cd /usr/lusers | ||
$ tar cvf /com/STAGING-bbcp/ | $ tar cvf /com/STAGING-bbcp/<YOURUWNETID>_ikt_homedir.tar <YOURUWNETID> | ||
</syntaxhighlight> | </syntaxhighlight> | ||
Revision as of 00:15, 20 May 2020
This page includes resources that are useful for migration from Ikt to Mox (completed in June 2020) in Hyak.
Home directories
You're responsible for moving your home directories from Ikt to Mox. To do so, follow these instructions:
1. on IKT: prepare your homedirectory
First, go through and delete the things you don't want in your home directory. the program ncdu is installed on ikt and it will show you detailed information of what is taking up space. go through and recursively delete thing you don't want. if you want to archive things on cold storage, you can do that too by putting compressed tar files in /com/STAGING-cold_storage (we're strongly encouarged to ensure that each file is more than 100MB).
There are likely many hidden files as well. You can see those with "ls -a".
2. on IKT: make a tarball of your home directory
You will need to make a tarball of your home directory and store it in /com/STAGING-bbcp
Note: change every instance of "<YOURUWNETID>" to your NetID (e.g., "makohill") before running the instructions below
$ ssh login2.hyak.uw.edu
$ cd /usr/lusers
$ tar cvf /com/STAGING-bbcp/<YOURUWNETID>_ikt_homedir.tar <YOURUWNETID>
= 3. on IKT: copy the file over to your new homedirectory on MOX
$ cd /com/STAGING-bbcp
$ hyakbbcp YOURUWNETID_ikt_homedir.tar mox1.hyak.uw.edu:/usr/lusers/YOURUWNETID
4. on MOX: unpack you new data
Run the following:
$ cd /usr/lusers/YOURUWNETID
$ tar xvf YOURUWNETID_ikt_homedir.tar --transform 's/^YOURUWNETID/ikt_homedir/'
$ rm ~/YOURUWNETID_ikt_homedir.tar
This will create a new directory called ikt_homedir
in my home directory on mox. I'll then go through and move out the things from ikt_homedir
into ../
your new home dirctory.
Or just leave them there if you want.
Moving files from ikt to mox
You can copy files at high speed without a password between the Hyak systems using commands like the ones below (instructions from the Hyak documentation).
From ikt to mox
ikt1$ hyakbbcp myfile mox1.hyak.uw.edu:/gscratch/comdata/users/YOUR_ID/YOUR_DIR ikt1$ hyakbbcp -r mydirectory mox1.hyak.uw.edu:/gscratch/comdata/users/YOUR_DIR
From mox to ikt
mox1$ hyakbbcp myfile ikt1.hyak.uw.edu:/com/users/YOUR_DIR mox1$ hyakbbcp -r mydirectory ikt1.hyak.uw.edu:/com/users/YOUR_DIR