location: Diff for "compute_resources"

Institute of Mathematics - PublicMathWiki:

Differences between revisions 21 and 54 (spanning 33 versions)
Revision 21 as of 2015-04-28 07:53:19
Size: 6538
Editor: crose
Comment:
Revision 54 as of 2024-01-24 14:32:47
Size: 6550
Editor: alrutz
Comment:
Deletions are marked like this. Additions are marked like this.
Line 2: Line 2:
<<TableOfContents>>
Line 3: Line 5:
 * Other UZH members are welcome to contact support@math.uz.ch.  * Other UZH members are welcome to contact support@math.uz.ch .
Line 8: Line 10:
 * Longer (>1day) are reccomended to do reservation.  * Longer (>1day) are reccomended to be done with a reservation.
Line 10: Line 12:
 * With reservation: In case of maintenance need, we typically schedule the maintenance according the needs of the user.  * With reservation: In case of maintenance need, we typically schedule the maintenance according to the needs of the user.
Line 12: Line 14:
 * General: if we see running computations, we always contact the user first (independent if a reservation exist). If the user doesn't answer (weekend, holiday, ...) we decide by our own what to do.
 
 * General: if we see running computations, we always contact the user first (independent of whether or not a reservation exists). If the user doesn't answer (weekend, holiday, ...) we decide on our own what to do.
Line 21: Line 23:
||<rowbgcolor="#dddddd"> host || CPU type || cores || RAM || local disk || date || purpose || CPU specs ||
|| asprey || 2 x Intel Xeon 4C E5-2643 3.30 GHz || 16 (HT enabled) || 128 GB || 73 GB || 12/2012 || student: matlab, mathematica, maple, R || [[http://ark.intel.com/products/64587/Intel-Xeon-Processor-E5-2643-10M-Cache-3_30-GHz-8_00-GTs-Intel-QPI|E5-2643]] ||
|| baxter || 8 x Intel Xeon 8C X7550 2.00 GHz || 64 (HT disabled) || 512 GB || 300 GB || 10/2010 || research, magma || [[http://ark.intel.com/products/46498/Intel-Xeon-Processor-X7550-18M-Cache-2_00-GHz-6_40-GTs-Intel-QPI?wapkw=x7550|x7550]] ||
|| crous || 8 x Intel Xeon 10C E7-2850 2.0 GHz || 80 (HT disabled) || 2 TB || 300 GB || 05/2013 || research || [[http://ark.intel.com/products/53573/Intel-Xeon-Processor-E7-2850-24M-Cache-2_00-GHz-6_40-GTs-Intel-QPI?wapkw=e7-2850|E7-2850]] ||
|| david || " || " || " || " || " || " ||
|| estonia0 || 2 x Intel Xeon 6C E5-2640 2.50 GHz || 12 (HT disabled) || 256 GB || 2TB || 05/2013 || research || [[http://www.intel.com/buy/us/en/product/components/intel-xeon-processor-e5-2640-15m-cache-250-ghz-720-gts-intel-qpi-250678?wapkw=e5-2640#tech_specs|E5-2640]] ||
|| estonia1 || " ||" || " || " || " || " ||
|| estonia2 || " || " || " || " || " || " ||
|| estonia3 || " || " || " || " || " || " ||
|| georgia0 || " || " || " || " || " || " ||
|| georgia1 || " || " || " || " || " || " ||
|| georgia2 || " || " || " || " || " || " ||
|| georgia3 || " || " || " || " || " || " ||
|| iran0 || " || " || " || " || " || " ||
|| iran1 || " || " || " || " || " || " ||
|| iran2 || " || " || " || " || " || " ||
|| iran3 || " || " || " || " || " || " ||
|| jordan0 || " || " || " || " || " || professor & assistant: matlab, mathematica, maple, R ||
|| jordan1 || " || " || " || " || " || " ||
|| jordan2 || " || " || " || " || " || courses ||
|| jordan3 || " || " || " || " || " || courses ||
||<rowbgcolor="#dddddd">Host ||CPU type ||Cores ||RAM ||Local disk ||Purchase || Purpose ||CPU specs || OS ||
||rambo|| 1 x AMD EPYC 7742 2,25GHz ||64 (HT enabled ) || 512GB || 240GB, 2TB || 08/2021 ||research ||[[https://www.amd.com/de/products/cpu/amd-epyc-7742|AMD-EPYC-7742]] || Ubuntu 22.04 ||
||olive|| 1 x AMD EPYC 7502P 2,5GHz ||32 (HT enabled ) || 512GB || 240GB || 04/2022 ||research ||[[https://www.amd.com/de/products/cpu/amd-epyc-7502p|AMD-EPYC-7502P]] || Ubuntu 22.04 ||
||oja|| " ||" || " || " || " ||" ||" || Ubuntu 20.04 ||
||stokes|| " ||" || " || " || " ||" ||" || Ubuntu 22.04 ||
||walker|| " ||" || " || " || " ||student ||" || Ubuntu 22.04 ||

=== CPU ===

||<rowbgcolor="#dddddd">Host ||CPU type ||Cores ||RAM ||Local disk ||Purchase || Purpose ||CPU specs || OS ||
||brady ||1 x Intel Core 6C i7-8700K 3.70GHz ||12 (HT enabled) ||64GB ||80GB,2TB ||02/2018 || research ||[[https://www.intel.com/content/www/us/en/products/processors/core/i7-processors/i7-8700k.html|i7-8700K]] || Ubuntu 22.04 ||


=== GPU ===

||<rowbgcolor="#dddddd">Host ||GPU model ||VRAM ||Recommended PSU ||Purchase || Purpose ||GPU Specs || OS ||
||david ||Gigabyte GeForce GTX 1070 G1 Gaming ||8GB ||500W ||" || research ||[[https://www.gigabyte.com/de/Graphics-Card/GV-N1070G1-GAMING-8GD-rev-10/sp#sp|GTX-1070]] || Ubuntu 22.04 ||
=== Old ===

||<rowbgcolor="#dddddd">Host ||CPU type ||Cores ||RAM ||Local disk ||Purchase || Purpose ||CPU specs || OS ||
||david ||8 x Intel Xeon 10C E7-2850 2.0 GHz ||80 (HT disabled) ||2 TB ||300 GB ||05/2013 ||research ||[[http://ark.intel.com/products/53573/Intel-Xeon-Processor-E7-2850-24M-Cache-2_00-GHz-6_40-GTs-Intel-QPI?wapkw=e7-2850|E7-2850]] || Ubuntu 22.04 ||
||estonia0 ||2 x Intel Xeon 6C E5-2640 2.50 GHz ||12 (HT disabled) ||256 GB ||2TB ||05/2013 ||research ||[[http://www.intel.com/buy/us/en/product/components/intel-xeon-processor-e5-2640-15m-cache-250-ghz-720-gts-intel-qpi-250678?wapkw=e5-2640#tech_specs|E5-2640]] || Ubuntu 22.04 ||
||estonia1 ||" ||" ||" ||" ||" ||" ||" || Ubuntu 22.04 ||
||estonia2 ||" ||" ||" ||" ||" ||" ||" || Ubuntu 22.04 ||
||estonia3 ||" ||" ||" ||" ||" ||" ||" || Ubuntu 22.04 ||
||georgia0 ||" ||" ||" ||" ||" ||" ||" || Ubuntu 22.04 ||
||georgia1 ||" ||" ||" ||" ||" ||" ||" || Ubuntu 22.04 ||
||georgia3 ||" ||" ||" ||" ||" ||" ||" || Ubuntu 22.04 ||
||iran0 ||" ||" ||" ||" ||" ||" ||" || Ubuntu 22.04 ||
||iran1 ||" ||" ||" ||" ||" ||" ||" || Ubuntu 22.04 ||
||iran2 ||" ||" ||" ||" ||" ||" ||" || Ubuntu 22.04 ||
||iran3 ||" ||" ||" ||" ||" ||" ||" || Ubuntu 22.04 ||
||jordan0 ||" ||" ||" ||" ||" ||professor & assistant: matlab, mathematica, maple, R ||" || Ubuntu 22.04 ||
||jordan1 ||" ||" ||" ||" ||" ||" ||" || Ubuntu 22.04 ||
||jordan2 ||" ||" ||" ||" ||" ||courses ||" || Ubuntu 22.04 ||
||jordan3 ||" ||" ||" ||" ||" ||courses ||" || Ubuntu 22.04 ||
Line 45: Line 62:
Line 48: Line 64:
 * Use [[thinlinc]] 
  * matlab, mathematica, maple, R, rstudio: just start the application via menu 'Applications > Science > ...' - you'll automatically redirected to the appropriate compute server.
  * For non standard compute software please first log on the compute node via 'ssh', than start the program.
 * SSH: Log on 'ssh.math.uzh.ch' and jump to the compute node again via 'ssh'.
 * Use [[thinlinc]]
  * matlab, mathematica, maple, R, rstudio: just start the application via menu 'Applications > Science > ...' - you'll automatically be redirected to the appropriate compute server.
  * For non standard compute software please first log on the compute node via 'ssh', then start the program.
 * SSH: Log onto 'ssh.math.uzh.ch' and jump to the compute node again via 'ssh'.
Line 55: Line 71:
 * Very very limited software might be installed on some Windows virtual machines.   * Very very limited software might be installed on some Windows virtual machines.
Line 58: Line 74:
 * If you need more than 1GB disk space, please contact support@math.uzh.ch.  * If you need more disk space, please contact support@math.uzh.ch .
Line 60: Line 76:
  * <1GB disk space: Personal Home directory
  * >1GB disk space: `/compute/<account>`
  * Personal Home directory
  * `/compute/<account>`
Line 67: Line 83:
 * Please report missing or outdated software or wishes to support@math.uzh.ch.
 * There is no Intel C or Fortran Compiler.
 * If you need other program versions than the default one: open a terminal, type the program name followed by two 'TAB' presses: this will show all available versions of the specified program.
 * Please report missing or outdated software or wishes to support@math.uzh.ch .
 * There is no Intel C or Intel Fortran Compiler.
 * If you need other program versions than the default one: open a terminal, type the program name followed by two 'TAB' presses: this will show all available installed versions of the specified program.
Line 75: Line 91:
 * Some programs, like `matlab`, offers limited builtin auto parallelization.
 * All of the compute nodes are shared memory machines. It's reasonable to start as many programs in parallel as long the `load` is less or equal the number of cores. 
  * Determine the load by using the command `uptime` via a terminal. The last three numbers are the average number of jobs (=load) in the run queue over the last 1, 5 and 15 minutes. {{{
 * Some programs, like `matlab`, offer limited built-in auto parallelization.
 * All of the compute nodes are shared memory machines. It's reasonable to start as many programs in parallel as long the `load` is less or equal the number of cores.
  * Determine the load by using the command `uptime` via a terminal. The last three numbers are the average number of jobs (=load) in the run queue over the last 1, 5 and 15 minutes.
 
{{{
Line 81: Line 98:

== Limitations ==
 * Memory
  * Soft: 64GB
  * Hard: unlimited
 * Number of processes per user
  * Soft: 2048
  * Hard: 4096

 * Change limitations

{{{
$ ulimit -m unlimited
$ ulimit -u 4096
}}}
 * Make sure to increase a hard limit only one time. If you try to increase it a second time, you'll get an error. You have to log out and log in again to get a new chance.

Compute Resources

  • In general, the offers are limited to members of I-MATH and their students.
  • Other UZH members are welcome to contact support@math.uz.ch .

  • First time user: contact support@math.uzh.ch first.

Reservations

  • Short (<1day) computations don't need a reservation,

  • Longer (>1day) are reccomended to be done with a reservation.

  • With reservation: In case of maintenance need, we typically schedule the maintenance according to the needs of the user.
  • Without reservation: We try to contact the user and wait several hours for an answer.
  • General: if we see running computations, we always contact the user first (independent of whether or not a reservation exists). If the user doesn't answer (weekend, holiday, ...) we decide on our own what to do.

Offers

  • For small / ad hoc computations, just start the compute software via the thinlinc environment.
  • For medium computations, please contact support@math.uzh.ch to ask for the best fitting possibilty and to reserve nodes.

  • For large computations and professional support please check http://www.s3it.uzh.ch/.

Resources at IMATH

Host

CPU type

Cores

RAM

Local disk

Purchase

Purpose

CPU specs

OS

rambo

1 x AMD EPYC 7742 2,25GHz

64 (HT enabled )

512GB

240GB, 2TB

08/2021

research

AMD-EPYC-7742

Ubuntu 22.04

olive

1 x AMD EPYC 7502P 2,5GHz

32 (HT enabled )

512GB

240GB

04/2022

research

AMD-EPYC-7502P

Ubuntu 22.04

oja

"

"

"

"

"

"

"

Ubuntu 20.04

stokes

"

"

"

"

"

"

"

Ubuntu 22.04

walker

"

"

"

"

"

student

"

Ubuntu 22.04

CPU

Host

CPU type

Cores

RAM

Local disk

Purchase

Purpose

CPU specs

OS

brady

1 x Intel Core 6C i7-8700K 3.70GHz

12 (HT enabled)

64GB

80GB,2TB

02/2018

research

i7-8700K

Ubuntu 22.04

GPU

Host

GPU model

VRAM

Recommended PSU

Purchase

Purpose

GPU Specs

OS

david

Gigabyte GeForce GTX 1070 G1 Gaming

8GB

500W

"

research

GTX-1070

Ubuntu 22.04

Old

Host

CPU type

Cores

RAM

Local disk

Purchase

Purpose

CPU specs

OS

david

8 x Intel Xeon 10C E7-2850 2.0 GHz

80 (HT disabled)

2 TB

300 GB

05/2013

research

E7-2850

Ubuntu 22.04

estonia0

2 x Intel Xeon 6C E5-2640 2.50 GHz

12 (HT disabled)

256 GB

2TB

05/2013

research

E5-2640

Ubuntu 22.04

estonia1

"

"

"

"

"

"

"

Ubuntu 22.04

estonia2

"

"

"

"

"

"

"

Ubuntu 22.04

estonia3

"

"

"

"

"

"

"

Ubuntu 22.04

georgia0

"

"

"

"

"

"

"

Ubuntu 22.04

georgia1

"

"

"

"

"

"

"

Ubuntu 22.04

georgia3

"

"

"

"

"

"

"

Ubuntu 22.04

iran0

"

"

"

"

"

"

"

Ubuntu 22.04

iran1

"

"

"

"

"

"

"

Ubuntu 22.04

iran2

"

"

"

"

"

"

"

Ubuntu 22.04

iran3

"

"

"

"

"

"

"

Ubuntu 22.04

jordan0

"

"

"

"

"

professor & assistant: matlab, mathematica, maple, R

"

Ubuntu 22.04

jordan1

"

"

"

"

"

"

"

Ubuntu 22.04

jordan2

"

"

"

"

"

courses

"

Ubuntu 22.04

jordan3

"

"

"

"

"

courses

"

Ubuntu 22.04

Concept

Access

  • The compute nodes can be accessed by SSH only from inside I-MATH.

  • Use thinlinc

    • matlab, mathematica, maple, R, rstudio: just start the application via menu 'Applications > Science > ...' - you'll automatically be redirected to the appropriate compute server.

    • For non standard compute software please first log on the compute node via 'ssh', then start the program.
  • SSH: Log onto 'ssh.math.uzh.ch' and jump to the compute node again via 'ssh'.

Operating System

  • Ubuntu LTS (Linux) - all compute servers.
  • Very very limited software might be installed on some Windows virtual machines.

Storage

  • If you need more disk space, please contact support@math.uzh.ch .

  • Remote (NFS)
    • Personal Home directory
    • /compute/<account>

  • Local
    • /export/user/<account>

Programs / Software

  • All compute servers use the same applications and versions as installed on the thinlinc terminals.
  • Please report missing or outdated software or wishes to support@math.uzh.ch .

  • There is no Intel C or Intel Fortran Compiler.
  • If you need other program versions than the default one: open a terminal, type the program name followed by two 'TAB' presses: this will show all available installed versions of the specified program.

Parallel computing

  • Cluster software
    • Not installed / offered at I-MATH.
    • Various MPI packages and libs are installed. Compiling and preparation to run programs later on a distributed compute cluster are possible.
  • Some programs, like matlab, offer limited built-in auto parallelization.

  • All of the compute nodes are shared memory machines. It's reasonable to start as many programs in parallel as long the load is less or equal the number of cores.

    • Determine the load by using the command uptime via a terminal. The last three numbers are the average number of jobs (=load) in the run queue over the last 1, 5 and 15 minutes.

      $ uptime
       15:55:20 up 22 days, 24 min,  1 user,  load average: 11.97, 11.73, 11.62

Limitations

  • Memory
    • Soft: 64GB
    • Hard: unlimited
  • Number of processes per user
    • Soft: 2048
    • Hard: 4096
  • Change limitations

$ ulimit -m unlimited
$ ulimit -u 4096
  • Make sure to increase a hard limit only one time. If you try to increase it a second time, you'll get an error. You have to log out and log in again to get a new chance.

PublicMathWiki: compute_resources (last edited 2024-04-11 09:31:49 by crose)