This shows you the differences between two versions of the page.
Both sides previous revision Previous revision Next revision | Previous revision | ||
update_2021_overview [2021/06/08 10:20] root [Connecting to the Updated Cluster] |
update_2021_overview [2021/12/14 17:18] (current) root |
||
---|---|---|---|
Line 1: | Line 1: | ||
===== Update 2021 Overview ===== | ===== Update 2021 Overview ===== | ||
- | The cluster is being updated to Ubuntu 20.04. Along with the OS update comes several changes to the way the cluster works. This page summarizes those changes. Workshops | + | The cluster is being updated to Ubuntu 20.04. Along with the OS update comes several changes to the way the cluster works. This page summarizes those changes. Workshops |
Rather than shutting the cluster down and doing the upgrade in one swell foop, we are providing a new cluster (with a new login node) already upgraded to Ubuntu 20.04 "Focal Fossa" | Rather than shutting the cluster down and doing the upgrade in one swell foop, we are providing a new cluster (with a new login node) already upgraded to Ubuntu 20.04 "Focal Fossa" | ||
- | The new cluster | + | ** From September 6th no new jobs will be allowed on the old cluster. Jobs which are already running on that date will be allowed to continue running, but the old cluster now has a 30-day time limit on all queues. ** |
+ | |||
+ | Most of the old cluster nodes have now been moved to the new cluster. The new cluster includes | ||
Line 13: | Line 15: | ||
**There are some important differences in the slurm submission configuration described below.** | **There are some important differences in the slurm submission configuration described below.** | ||
- | When you log in to the new cluster you will have access to your home directory exactly as on the current head node. Unfortunately that does not mean that all the software you have installed in your home directory will continue to work: the new OS has updated shared libraries that may or may not be compatible with the programs you have installed. So you will need to spend some time testing and/or re-installing the software you need. (See the paragraph below about scratch space that could be used for testing software updates.) | + | When you log in to the new cluster you will have access to your home directory exactly as on the current head node. **Unfortunately that does not mean that all the software you have installed in your home directory will continue to work**: the new OS has updated shared libraries that may or may not be compatible with the programs you have installed. So you will need to spend some time testing and/or re-installing the software you need. (See the paragraph below about scratch space that could be used for testing software updates.) |
The nodes on the old cluster will be slowly disappearing from that cluster and reappearing on the new cluster. The plan is to move one or two nodes per week, so with about 30 nodes to move, after a few months the old cluster will have no nodes left - hence the need for everyone to move. | The nodes on the old cluster will be slowly disappearing from that cluster and reappearing on the new cluster. The plan is to move one or two nodes per week, so with about 30 nodes to move, after a few months the old cluster will have no nodes left - hence the need for everyone to move. | ||
Line 34: | Line 36: | ||
So, you should be more careful in specifying how many cores your job needs. See the " | So, you should be more careful in specifying how many cores your job needs. See the " | ||
+ | |||
+ | See [[Enforcing Core Counts]] for more details. | ||
=== Enforcing Memory Allocation === | === Enforcing Memory Allocation === | ||
Line 44: | Line 48: | ||
You can change the amount of memory your job is allocated using either the " | You can change the amount of memory your job is allocated using either the " | ||
+ | See [[Enforcing Memory Allocation]] for more details. | ||
==== Environment Modules ==== | ==== Environment Modules ==== | ||
- | Environment modules allow you to control which software (and which version of that software) is available in your environment. For instance the new cluster has 4 different | + | Environment modules allow you to control which software (and which version of that software) is available in your environment. For instance the new cluster has 4 different |
, 3.6.3, 4.0.5, 4.1.0. When you first log in and try to run R the OS will respond with " | , 3.6.3, 4.0.5, 4.1.0. When you first log in and try to run R the OS will respond with " | ||
Line 54: | Line 59: | ||
</ | </ | ||
- | That would then give you access to the most recent version of R available (4.1.0 in this case). | + | See [[Environment Modules]] for more details. |
- | + | ||
- | To use a different version you would have typed something like: | + | |
- | + | ||
- | < | + | |
- | module add R/3.6.3 | + | |
- | </ | + | |
- | + | ||
- | To get a list of all available software you can type: | + | |
- | + | ||
- | < | + | |
- | module avail | + | |
- | </ | + | |
- | + | ||
- | To get a full list of module commands: | + | |
- | + | ||
- | < | + | |
- | module --help | + | |
- | </ | + | |
==== Connecting to the Updated Cluster ==== | ==== Connecting to the Updated Cluster ==== |