User Tools
connecting
Differences
This shows you the differences between two versions of the page.
| Both sides previous revision Previous revision Next revision | Previous revision | ||
|
connecting [2022/01/14 10:24] root |
connecting [2022/01/26 09:48] (current) root |
||
|---|---|---|---|
| Line 32: | Line 32: | ||
| If you have started a long-running job on the head node from your command line, or are running a job using **srun**, then a network glitch, or forgetting and closing your laptop lid, will drop your connection and kill your job. | If you have started a long-running job on the head node from your command line, or are running a job using **srun**, then a network glitch, or forgetting and closing your laptop lid, will drop your connection and kill your job. | ||
| - | It is best to run jobs using sbatch which detaches the job from the shell, but you can also use a **terminal multiplexer**. The cluster has 3 such programs installed: **screen**, **byobu**, and **tmux**. These programs start up shells that are immune to your network connection to the cluster being dropped (as well as letting you run multiple shells from the one connection). If your network connection drops, you can log in again and re-attach to the shells running under the terminal multiplexer. | + | It is best to run jobs using **sbatch** which detaches the job from the shell, but you can also use a **terminal multiplexer**. The cluster has 3 such programs installed: **screen**, **byobu**, and **tmux**. These programs start up shells that are immune to your network connection to the cluster being dropped (as well as letting you run multiple shells from the one connection). If your network connection drops, you can log in again and re-attach to the shells running under the terminal multiplexer. |
| * Screen: https:// | * Screen: https:// | ||
| * Byobu: https:// | * Byobu: https:// | ||
| * Tmux: man tmux | * Tmux: man tmux | ||
| + | |||
| + | Finally, you can use the bash built-in **disown** command to detach a job from your terminal. | ||
| + | |||
| + | < | ||
| + | ./ | ||
| + | disown | ||
| + | </ | ||
| + | |||
| + | These commands start your program with output redirected to a file, put it in the background, and then tell bash to detach the program from your terminal. | ||
| ==== Copying Files ==== | ==== Copying Files ==== | ||
| Line 70: | Line 79: | ||
| **sshfs** | **sshfs** | ||
| * Allows you to mount a cluster directory as a subdirectory on your local machine. | * Allows you to mount a cluster directory as a subdirectory on your local machine. | ||
| - | * https:// | + | * https:// |
| * win-sshfs (for Windows) | * win-sshfs (for Windows) | ||
| * sshfs-win (for Windows) | * sshfs-win (for Windows) | ||
| * [[https:// | * [[https:// | ||
| + | |||
| + | If you are using sshfs on a Mac and find that you cannot access directories (folders) through sshfs that you can access on the cluster because of supplementary groups that you user belongs to, then you may want to try this option: | ||
| + | |||
| + | < | ||
| + | sshfs -o defer_permissions username@brccluster.cos.ncsu.edu:/ | ||
| + | </ | ||
| **Globus** | **Globus** | ||
| - | You can use Globus Connect Personal to create a Globus endpoint allowing you to copy files to or from the cluster. The instructions for doing so are here: https:// | + | You can use Globus Connect Personal to create a Globus endpoint allowing you to copy files to or from the cluster |
| + | |||
| + | Globus Connect Personal is available as a module on the cluster (with name " | ||
| + | |||
| + | The first time you run **globusconnectpersonal** you will be given a URL (to auth.globus.org) and a prompt for an auth code. Visit the URL on your local machine and log in to Globus to get the authorization code. Copy and paste the auth code into the cluster terminal window. | ||
| + | |||
| + | You can then start globus with: | ||
| + | |||
| + | < | ||
| + | globusconnectpersonal -start & | ||
| + | </ | ||
| + | |||
| + | You should then be able to find your cluster endpoint within your Globus account. | ||
| + | |||
| + | Check status of your Globus connection with: | ||
| + | |||
| + | < | ||
| + | globusconnectpersonal -status | ||
| + | </ | ||
| + | |||
| + | End your Globus session with: | ||
| + | |||
| + | < | ||
| + | globusconnectpersonal -stop | ||
| + | </ | ||
| + | |||
| + | If you want to add directories outside your home directory to your Globus endpoint, take a look at the bottom of the page pointed to by the URL above where the format of the **config-paths** file is described. | ||
| ==== Downloading Files ==== | ==== Downloading Files ==== | ||
connecting.1642173856.txt.gz · Last modified: 2022/01/14 10:24 by root
Page Tools
Except where otherwise noted, content on this wiki is licensed under the following license: Public Domain
