= Compute Resources = <> * In general, the offers are limited to members of I-MATH & DM3L and their students. * Other UZH members are welcome to contact support@math.uz.ch . * First time user: contact support@math.uzh.ch first. == Reservations == * Short (<1day) computations don't need a reservation, * Longer (>1day) are reccomended to be done with a reservation. * With reservation: In case of maintenance need, we typically schedule the maintenance according to the needs of the user. * Without reservation: We try to contact the user and wait several hours for an answer. * General: if we see running computations, we always contact the user first (independent of whether or not a reservation exists). If the user doesn't answer (weekend, holiday, ...) we decide on our own what to do. == Offers == * For small / ad hoc computations, just start the compute software via the thinlinc environment. * For medium computations, please contact support@math.uzh.ch to ask for the best fitting possibilty and to reserve nodes. * For large computations and professional support please check http://www.s3it.uzh.ch/. == Resources at IMATH & DM3L == ||<|2: rowbgcolor="#dddddd">'''Host'''||<|2 style="width: 6em">'''Purpose'''||<-3:>'''CPU''' ||<-2:>'''GPU''' ||<|2:>'''RAM'''||<|2:>'''Local disks'''||<|2:>'''Purchase'''||<|2:>'''OS'''|| ||<: rowbgcolor="#dddddd"> Model ||<:>Speed ||<:>Cores ||<:>Model ||<:>VRAM || ||aroca || research || [[https://www.amd.com/de/products/processors/server/epyc/4th-generation-9004-and-8004-series/amd-epyc-9334.html|AMD EPYC 9334]]^1^ x2 || 2.70 GHz || 64 (HT) || [[https://www.nvidia.com/en-us/products/workstations/rtx-6000/|NVIDIA RTX 6000 Ada]] || 48 GB || 512 GB || 2x 240 GB, 8TB NVMe || 12/2024 || Ubuntu 24.04 || ||bellow || research || [[https://www.amd.com/de/products/processors/server/epyc/4th-generation-9004-and-8004-series/amd-epyc-9334.html|AMD EPYC 9334]]^1^ x2 || 2.70 GHz || 64 (HT) || [[https://www.nvidia.com/de-de/data-center/l40s/|NVIDIA L40S]] x4 || 48 GB || 512 GB || 2x 240 GB, 8TB NVMe || 12/2024 || Ubuntu 24.04 || ||sulem || research || [[https://www.amd.com/de/products/processors/server/epyc/4th-generation-9004-and-8004-series/amd-epyc-9334.html|AMD EPYC 9334]]^1^ x2 || 2.70 GHz || 64 (HT) || [[https://www.nvidia.com/de-de/data-center/a40/|NVIDIA A40 ]] x2 (stacked) || 96 GB || 512 GB || 2x 240 GB, 8TB NVMe || 12/2024 || Ubuntu 24.04 || ||zahedi || research || [[https://www.amd.com/de/products/processors/server/epyc/4th-generation-9004-and-8004-series/amd-epyc-9334.html|AMD EPYC 9334]]^1^ x2 || 2.70 GHz || 64 (HT) || [[https://www.nvidia.com/de-de/data-center/l40s/|NVIDIA L40S]] || 48 GB || 512 GB || 2x 240 GB, 8TB NVMe || 12/2024 || Ubuntu 24.04 || ||ribeiro || research || [[https://www.amd.com/de/products/processors/server/epyc/7003-series/amd-epyc-7763.html|AMD EPYC 7763]]^2^ || 2,45 GHz || 64 (HT) || [[https://www.nvidia.com/de-de/data-center/l40s/|NVIDIA L40S]] || 48 GB || 512 GB || 2x240 GB, 8TB NVMe || 12/2024 || Ubuntu 24.04 || ||sushko || research || [[https://www.amd.com/de/products/processors/server/epyc/7003-series/amd-epyc-7763.html|AMD EPYC 7763]]^2^ || 2,45 GHz || 64 (HT) || [[https://www.nvidia.com/de-de/data-center/l40s/|NVIDIA L40S]] || 48 GB || 512 GB || 2x240 GB, 8TB NVMe || 12/2024 || Ubuntu 24.04 || ||swart || research || [[https://www.amd.com/de/products/processors/server/epyc/7003-series/amd-epyc-7763.html|AMD EPYC 7763]]^2^ || 2,45 GHz || 64 (HT) || [[https://www.nvidia.com/de-de/data-center/l40s/|NVIDIA L40S]] || 48 GB || 512 GB || 2x240 GB, 8TB NVMe || 12/2024 || Ubuntu 24.04 || ||vernon || research || [[https://www.amd.com/de/products/processors/server/epyc/7003-series/amd-epyc-7763.html|AMD EPYC 7763]]^2^ || 2,45 GHz || 64 (HT) || [[https://www.nvidia.com/de-de/data-center/l40s/|NVIDIA L40S]] || 48 GB || 512 GB || 2x240 GB, 8TB NVMe || 12/2024 || Ubuntu 24.04 || ||vinzant || research || [[https://www.amd.com/de/products/processors/server/epyc/7003-series/amd-epyc-7763.html|AMD EPYC 7763]]^2^ || 2,45 GHz || 64 (HT) || [[https://www.nvidia.com/de-de/data-center/l40s/|NVIDIA L40S]] || 48 GB || 512 GB || 2x240 GB, 8TB NVMe || 12/2024 || Ubuntu 24.04 || ||wheeler || research || [[https://www.amd.com/de/products/processors/server/epyc/7003-series/amd-epyc-7763.html|AMD EPYC 7763]]^2^ || 2,45 GHz || 64 (HT) || [[https://www.nvidia.com/de-de/data-center/l40s/|NVIDIA L40S]] || 48 GB || 512 GB || 2x240 GB, 8TB NVMe || 12/2024 || Ubuntu 24.04 || ||willbanks|| research || [[https://www.amd.com/de/products/processors/server/epyc/7003-series/amd-epyc-7763.html|AMD EPYC 7763]]^2^ || 2,45 GHz || 64 (HT) ||<-2:> --- || 512 GB || 2x 240 GB, 8TB NVMe || 12/2024 || Ubuntu 24.04 || ||terracini|| research || [[https://www.amd.com/de/products/processors/server/epyc/7003-series/amd-epyc-7763.html|AMD EPYC 7763]]^2^ || 2,45 GHz || 64 (HT) ||<-2:> --- || 512 GB || 2x 240 GB, 8TB NVMe || 12/2024 || Ubuntu 24.04 || ||rambo || research || [[https://www.amd.com/de/products/cpu/amd-epyc-7742|AMD-EPYC-7742]] || 2,25 GHz || 64 (HT) ||<-2:> --- || 512 GB || 240GB, 2TB || 08/2021 || Ubuntu 24.04 || ||olive || research || [[https://www.amd.com/de/products/cpu/amd-epyc-7502p|AMD-EPYC-7502P]] || 2,50 GHz || 32 (HT) ||<-2:> --- || 512 GB || 240GB || 04/2022 || Ubuntu 24.04 || ||oja || research || [[https://www.amd.com/de/products/cpu/amd-epyc-7502p|AMD-EPYC-7502P]] || 2,50 GHz || 32 (HT) ||<-2:> --- || 512 GB || 240GB || 04/2022 || Ubuntu 20.04 || ||stokes|| research || [[https://www.amd.com/de/products/cpu/amd-epyc-7502p|AMD-EPYC-7502P]] || 2,50 GHz || 32 (HT) ||<-2:> --- || 512 GB || 240GB || 04/2022 || Ubuntu 24.04 || ||walker|| student || [[https://www.amd.com/de/products/cpu/amd-epyc-7502p|AMD-EPYC-7502P]] || 2,50 GHz || 32 (HT) ||<-2:> --- || 512 GB || 240GB || 04/2022 || Ubuntu 24.04 || ||<-11: rowbgcolor="#dddddd"> Old servers || ||brady || research || [[https://www.intel.com/content/www/us/en/products/processors/core/i7-processors/i7-8700k.html|Intel Core 6C i7-8700K]] || 3,70 GHz || 12 (HT) || [[https://www.gigabyte.com/ch/Graphics-Card/GV-N1070G1-GAMING-8GD-rev-10|GigaByte GeForce GTX 1070 G1]] || 8 GB || 64 GB || 80GB, 2TB || 02/2018 || Ubuntu 24.04 || ||david || research || [[https://www.intel.com/content/www/us/en/products/sku/53573/intel-xeon-processor-e72850-24m-cache-2-00-ghz-6-40-gts-intel-qpi/specifications.html|Intel Xeon 10C E7-2850]] x 8 || 2,00 GHz || 80 (no HT) || [[https://www.gigabyte.com/ch/Graphics-Card/GV-N1070G1-GAMING-8GD-rev-10|GigaByte GeForce GTX 1070 G1]] || 8 GB || 512 GB || 240GB || 05/2013 || Ubuntu 24.04 || ||estonia0|| research || [[https://www.intel.com/content/www/us/en/products/sku/64591/intel-xeon-processor-e52640-15m-cache-2-50-ghz-7-20-gts-intel-qpi/specifications.html|Intel Xeon 6C E5-2640]] || 2.50 GHz || 12 (no HT) ||<-2:> --- || 256 GB || 2 TB || 05/2012 || Ubuntu 24.04 || ||estonia1|| research || [[https://www.intel.com/content/www/us/en/products/sku/64591/intel-xeon-processor-e52640-15m-cache-2-50-ghz-7-20-gts-intel-qpi/specifications.html|Intel Xeon 6C E5-2640]] || 2.50 GHz || 12 (no HT) ||<-2:> --- || 256 GB || 2 TB || 05/2012 || Ubuntu 24.04 || ||estonia2|| research || [[https://www.intel.com/content/www/us/en/products/sku/64591/intel-xeon-processor-e52640-15m-cache-2-50-ghz-7-20-gts-intel-qpi/specifications.html|Intel Xeon 6C E5-2640]] || 2.50 GHz || 12 (no HT) ||<-2:> --- || 256 GB || 2 TB || 05/2012 || Ubuntu 24.04 || ||estonia3|| research || [[https://www.intel.com/content/www/us/en/products/sku/64591/intel-xeon-processor-e52640-15m-cache-2-50-ghz-7-20-gts-intel-qpi/specifications.html|Intel Xeon 6C E5-2640]] || 2.50 GHz || 12 (no HT) ||<-2:> --- || 256 GB || 2 TB || 05/2012 || Ubuntu 24.04 || ||georgia0|| research || [[https://www.intel.com/content/www/us/en/products/sku/64591/intel-xeon-processor-e52640-15m-cache-2-50-ghz-7-20-gts-intel-qpi/specifications.html|Intel Xeon 6C E5-2640]] || 2.50 GHz || 12 (no HT) ||<-2:> --- || 256 GB || 2 TB || 05/2012 || Ubuntu 24.04 || ||georgia1|| research || [[https://www.intel.com/content/www/us/en/products/sku/64591/intel-xeon-processor-e52640-15m-cache-2-50-ghz-7-20-gts-intel-qpi/specifications.html|Intel Xeon 6C E5-2640]] || 2.50 GHz || 12 (no HT) ||<-2:> --- || 256 GB || 2 TB || 05/2012 || Ubuntu 24.04 || ||georgia2|| research || [[https://www.intel.com/content/www/us/en/products/sku/64591/intel-xeon-processor-e52640-15m-cache-2-50-ghz-7-20-gts-intel-qpi/specifications.html|Intel Xeon 6C E5-2640]] || 2.50 GHz || 12 (no HT) ||<-2:> --- || 256 GB || 2 TB || 05/2012 || Ubuntu 24.04 || ||georgia3|| research || [[https://www.intel.com/content/www/us/en/products/sku/64591/intel-xeon-processor-e52640-15m-cache-2-50-ghz-7-20-gts-intel-qpi/specifications.html|Intel Xeon 6C E5-2640]] || 2.50 GHz || 12 (no HT) ||<-2:> --- || 256 GB || 2 TB || 05/2012 || Ubuntu 24.04 || ||iran0 || research || [[https://www.intel.com/content/www/us/en/products/sku/64591/intel-xeon-processor-e52640-15m-cache-2-50-ghz-7-20-gts-intel-qpi/specifications.html|Intel Xeon 6C E5-2640]] || 2.50 GHz || 12 (no HT) ||<-2:> --- || 256 GB || 2 TB || 05/2012 || Ubuntu 24.04 || ||iran1 || research || [[https://www.intel.com/content/www/us/en/products/sku/64591/intel-xeon-processor-e52640-15m-cache-2-50-ghz-7-20-gts-intel-qpi/specifications.html|Intel Xeon 6C E5-2640]] || 2.50 GHz || 12 (no HT) ||<-2:> --- || 256 GB || 2 TB || 05/2012 || Ubuntu 24.04 || ||iran2 || research || [[https://www.intel.com/content/www/us/en/products/sku/64591/intel-xeon-processor-e52640-15m-cache-2-50-ghz-7-20-gts-intel-qpi/specifications.html|Intel Xeon 6C E5-2640]] || 2.50 GHz || 12 (no HT) ||<-2:> --- || 256 GB || 2 TB || 05/2012 || Ubuntu 24.04 || ||iran3 || research || [[https://www.intel.com/content/www/us/en/products/sku/64591/intel-xeon-processor-e52640-15m-cache-2-50-ghz-7-20-gts-intel-qpi/specifications.html|Intel Xeon 6C E5-2640]] || 2.50 GHz || 12 (no HT) ||<-2:> --- || 256 GB || 2 TB || 05/2012 || Ubuntu 24.04 || ||jordan0 || professors & assistants: matlab, mathematica, maple, R || [[https://www.intel.com/content/www/us/en/products/sku/64591/intel-xeon-processor-e52640-15m-cache-2-50-ghz-7-20-gts-intel-qpi/specifications.html|Intel Xeon 6C E5-2640]] || 2.50 GHz || 12 (no HT) ||<-2:> --- || 256 GB || 2 TB || 05/2012 || Ubuntu 24.04 || ||jordan1 || research || [[https://www.intel.com/content/www/us/en/products/sku/64591/intel-xeon-processor-e52640-15m-cache-2-50-ghz-7-20-gts-intel-qpi/specifications.html|Intel Xeon 6C E5-2640]] || 2.50 GHz || 12 (no HT) ||<-2:> --- || 256 GB || 2 TB || 05/2012 || Ubuntu 24.04 || ||jordan2 || courses || [[https://www.intel.com/content/www/us/en/products/sku/64591/intel-xeon-processor-e52640-15m-cache-2-50-ghz-7-20-gts-intel-qpi/specifications.html|Intel Xeon 6C E5-2640]] || 2.50 GHz || 12 (no HT) ||<-2:> --- || 256 GB || 2 TB || 05/2012 || Ubuntu 24.04 || ||jordan3 || courses || [[https://www.intel.com/content/www/us/en/products/sku/64591/intel-xeon-processor-e52640-15m-cache-2-50-ghz-7-20-gts-intel-qpi/specifications.html|Intel Xeon 6C E5-2640]] || 2.50 GHz || 12 (no HT) ||<-2:> --- || 256 GB || 2 TB || 05/2012 || Ubuntu 24.04 || Mainboard: * ^1^ [[https://servers.asus.com/products/servers/rack-servers/RS720A-E12-RS12#Specifications|ASUS RS720A-E12-RS12]] * ^2^ [[https://www.supermicro.com/en/products/motherboard/H12SSL-CT|Supermicro H12SSL-CT]] = Concept = == Access == * The compute nodes can be accessed by SSH only from '''inside''' I-MATH/DM3L. * Use [[thinlinc]] * matlab, mathematica, maple, R, rstudio: just start the application via menu 'Applications > Science > ...' - you'll automatically be redirected to the appropriate compute server. * For non standard compute software please first log on the compute node via 'ssh', then start the program. * SSH: Log onto 'ssh.math.uzh.ch' and jump to the compute node again via 'ssh'. == Operating System == * Ubuntu LTS (Linux) - all compute servers. * Very very limited software might be installed on some Windows virtual machines. == Storage == * If you need more disk space, please contact support@math.uzh.ch . * Remote (NFS) * Personal Home directory * `/compute/` * Local * `/export/user/` == Programs / Software == * All compute servers use the same applications and versions as installed on the thinlinc terminals. * Please report missing or outdated software or wishes to support@math.uzh.ch . * There is no Intel C or Intel Fortran Compiler. * If you need other program versions than the default one: open a terminal, type the program name followed by two 'TAB' presses: this will show all available installed versions of the specified program. == Parallel computing == * Cluster software * Not installed / offered at I-MATH/DM3L. * Various MPI packages and libs are installed. Compiling and preparation to run programs later on a distributed compute cluster are possible. * Some programs, like `matlab`, offer limited built-in auto parallelization. * All of the compute nodes are shared memory machines. It's reasonable to start as many programs in parallel as long the `load` is less or equal the number of cores. * Determine the load by using the command `uptime` via a terminal. The last three numbers are the average number of jobs (=load) in the run queue over the last 1, 5 and 15 minutes. {{{ $ uptime 15:55:20 up 22 days, 24 min, 1 user, load average: 11.97, 11.73, 11.62 }}} === Monitoring === * List GPUs {{{ nvidia-smi }}} * Show GPU-Usage (Load, Temparature, Watts-Usage etc.) {{{ nvtop -d 2 }}} * Fan status (Rounds per Minute etc.) {{{ fanstatus }}} == Limitations == * Memory * Soft: 64GB * Hard: unlimited * Number of processes per user * Soft: 2048 * Hard: 4096 * Change limitations {{{ $ ulimit -m unlimited $ ulimit -u 4096 }}} * Make sure to increase a hard limit only one time. If you try to increase it a second time, you'll get an error. You have to log out and log in again to get a new chance.