| Latest revision |
Your text |
| Line 2: |
Line 2: |
|
| |
|
| # Copy data (only raw data, data that we are using in current and future projects) | | # Copy data (only raw data, data that we are using in current and future projects) |
| # Backup other data?
| |
| # Copy code (Everyone copy their own user directory) | | # Copy code (Everyone copy their own user directory) |
| # Create a shared .bashrc that everyone will load. This will provide us with a shared environment (python, R, other packages, useful aliases). | | # Create a shared .bashrc that everyone will load. This will provide us with a shared environment (python, R, other packages, useful aliases). |
| | |
|
| |
|
| Hyak Migration Working Group | | Hyak Migration Working Group |
| Line 13: |
Line 13: |
| #Jeremy | | #Jeremy |
| #Jim? | | #Jim? |
|
| |
| == Time Table ==
| |
|
| |
| {|class='wikitable'
| |
| |+ Hyak migration schedule
| |
| |-
| |
| !Date
| |
| !Task to be done
| |
| !Who needs to do it
| |
| |-
| |
| |2020-01-17
| |
| |Collect list of software to install on Mox
| |
| |Everyone
| |
| |-
| |
| |2020-02-01
| |
| |Install software on mox and setup shared .bashrc
| |
| |Nate (possibly with help from Sayamindu + Mako)
| |
| |-
| |
| |2020-02-15
| |
| | Test setup on Mox
| |
| | Everyone (Especially Kaylea)
| |
| |-
| |
| |2020-03-01
| |
| |Start primarily using Mox
| |
| | Everyone
| |
| |-
| |
| |2020-05-01
| |
| |Evacuate Ikt! It's the end!
| |
| | Everyone
| |
| |}
| |
|
| |
|
| == Shared environment design == | | == Shared environment design == |
| Line 54: |
Line 24: |
|
| |
|
| == List of modules we'll maintain on Hyak (WIP) == | | == List of modules we'll maintain on Hyak (WIP) == |
| We can get a list of packages from /gscratch/com/local/bin on Ikt. | | We can get a list of packages from /com/bin on Ikt. |
|
| |
|
| === Add packages you want below! === | | === Add packages you want below! === |
|
| |
|
| [X] zsh
| | * Python 3.7 |
| | | * R 3.5.2 |
| [X] Spark 2.4
| | * moreutils 0.62 |
| | | * emacs 25 |
| [X] Python 3.7
| | * p7zip 16.02 |
| Installed Anoconda and created a minimal anaconda environment to speed up startup time. This seems like the easiest way to get an optimized python installation.
| | * htop 2.2.0 |
| | | * pandoc 2.2.1 |
| [X] R 3.6.2
| |
| | |
| [X] moreutils 0.62 (seems like at least some of the moreutils are broken (i.e. parallel))
| |
| | |
| [X] emacs 25
| |
| | |
| [X] p7zip 16.02
| |
| | |
| [X] htop 2.2.0
| |
| | |
| [X] pandoc 2.2.1
| |
| | |
| [X] gcc 4.9+
| |
| | |
| === RStudio Server ===
| |
| It could be nice to run an RStudio server on the interactive node to provide a nicer IDE for working interactively on hyak compared to Jupyter notebooks or editing in the terminal. If this isn't feasible then we should use kibo for this purpose instead.
| |
| | |
| == Etherpad link ==
| |
| https://etherpad.wikimedia.org/p/cdsc_hyak_migration_todo
| |
| | |
| == Scheduler Options ==
| |
| It might be a good idea to ask the hyak folks to configure the scheduler for our partition so that we can request specific quantities of memory or cpus in our jobs. [https://wiki.cac.washington.edu/display/hyakusers/Mox_scheduler#Mox_scheduler-BatchusageSingleNode: (Hyak Wiki)]
| |
| | |
| This might be particularly useful if we don't get more nodes soon because it allows us to chunk up nodes into smaller pieces.
| |
| | |
| == Getting more nodes ==
| |
| We have funding in the ecology grant (and maybe other sources of funding as well) that we can use to purchase additional Mox capacity. Let's keep track of plans around that to try to minimize the gap from the time we lose Ikt nodes until we get more Mox nodes.
| |
