Suppose you have a program to run and you expect it to use a lot of memory, but are unsure of exactly how much.

• Run it on a node reserved exclusively for you.
  • Use the -c 16 option to get all cores on a (standard) node.

• Run a background program to monitor memory use on that node.

Files: memmon, memlog, leakmem

srun memmon

leakmem allocates 1MB of RAM every second (for up to 10000 seconds).

/proc/PID/smaps provides a detailed view of the memory being used by a specific process. You can parse it (or use some previously written Perl code, Linux::Smaps.pl).