Editing CommunityData:Kibo
From CommunityData
Warning: You are not logged in. Your IP address will be publicly visible if you make any edits. If you log in or create an account, your edits will be attributed to your username, along with other benefits.
The edit can be undone. Please check the comparison below to verify that this is what you want to do, and then publish the changes below to finish undoing the edit.
Latest revision | Your text | ||
Line 1: | Line 1: | ||
Kibo is a server that CDSC has which can be used for research | Kibo is a server that CDSC has which can be used for research. It's a pretty powerful computer (2x14 core processors, 12x32GB memory, 12x2.4TB storage). To use Kibo, you will need to have a NU NetID and often, the Northwestern VPN. Instructions are below. | ||
== Getting access to Kibo == | == Getting access to Kibo == | ||
Line 16: | Line 16: | ||
# It will prompt you for yourNetID@kibo.soc.northwestern.edu's password. Enter your NU NetID password and you should now be connected. | # It will prompt you for yourNetID@kibo.soc.northwestern.edu's password. Enter your NU NetID password and you should now be connected. | ||
== Navigating Kibo == | == Documentation and Next Steps == | ||
=== Navigating Kibo === | |||
The structure of directory set-up on Kibo is simple. Once you log in, you will be at your home directory which is a directory named your NetID. If you <code>ls ../</code>, you'll see that there are multiple such directories labeled with NetIDs of other people who use Kibo. Generally, you will not have write access on those other directories nor root access, unless that access has been granted. | The structure of directory set-up on Kibo is simple. Once you log in, you will be at your home directory which is a directory named your NetID. If you <code>ls ../</code>, you'll see that there are multiple such directories labeled with NetIDs of other people who use Kibo. Generally, you will not have write access on those other directories nor root access, unless that access has been granted. | ||
== Email forwarding == | === Email forwarding === | ||
Although kibo can send and receive email, it will queue up ''on kibo'' by default. You can read it by using a console-based mail client installed on kibo like <code>mutt</code> but it's almost certainly easier to setup email forwarding. Doing so is as simple as creating a file called <code>~/.forward</code> that contains a single line with the email address you want your email forwarded to. | |||
You can read | |||
For example, Mako just ran: | For example, Mako just ran: | ||
Line 31: | Line 31: | ||
</pre> | </pre> | ||
== Storing Data == | This is important because programs you are running (including any jobs you have running unattended from a cronjob will send their output to the user in question via email). In some cases, these had been queuing up on Kibo for months without anybody knowing about them. | ||
=== Storing Data === | |||
Kibo is set up to retrieve, store, and analyze lots of data. One use case is gathering data from the web, as we are doing for the COVID-19 project. If you are gathering data like that, you shouldn't use your home directory to store it. | Kibo is set up to retrieve, store, and analyze lots of data. One use case is gathering data from the web, as we are doing for the COVID-19 project. If you are gathering data like that, you shouldn't use your home directory to store it. | ||
Line 47: | Line 49: | ||
If you've already been using Kibo and need to move things from your home directory into <code>/data</code>, set up your user directory as above (if you haven't already) and then use <code>mv [current file location] [desired file location]</code> to move the relevant files. | If you've already been using Kibo and need to move things from your home directory into <code>/data</code>, set up your user directory as above (if you haven't already) and then use <code>mv [current file location] [desired file location]</code> to move the relevant files. | ||
== Viewing image files == | === Viewing image files === | ||
We currently don't have anything set up to open and see the image files stored on the remote Kibo machine from the terminal. For now, one easy solution would be to enter <code>scp -T -r yourNetID@kibo.soc.northwestern.edu:pathtofile .</code> in a folder on your local machine. This securely copies the files to the current directory that you are in. You will have to enter your password as if you were logging into kibo. | We currently don't have anything set up to open and see the image files stored on the remote Kibo machine from the terminal. For now, one easy solution would be to enter <code>scp -T -r yourNetID@kibo.soc.northwestern.edu:pathtofile .</code> in a folder on your local machine. This securely copies the files to the current directory that you are in. You will have to enter your password as if you were logging into kibo. | ||
If you use VS Code, there is a very nifty extension that can be used to easily access files (including images!) from the GUI of the editor, instructions and more information for which can be found [https://code.visualstudio.com/docs/remote/ssh here]. | If you use VS Code, there is a very nifty extension that can be used to easily access files (including images!) from the GUI of the editor, instructions and more information for which can be found [https://code.visualstudio.com/docs/remote/ssh here]. | ||