Suppose you have a program to run and you expect it to use a lot of memory, but are unsure of exactly how much.

• Run it on a node reserved exclusively for you.
  • Use the –exclusive option to get a whole node.

• Run a background program to monitor memory use on that node.

Files: memmon, memlog, leakmem

srun memmon

leakmem allocates 1MB of RAM every second (for up to 10000 seconds).

We use the SLURM_JOB_ID environment variable to get a unique name for the log file.

/proc/PID/smaps provides a detailed view of the memory being used by a specific process. You can parse it (or use some previously written Perl code, Linux::Smaps.pl).

Files: memmon2, memlog2, leakmem.