Euler for D-MATH users

The D-MATH is shareholder of the following 2 shares on the Euler HPC cluster:

• es_math
• ls_math

CPU Nodes (es_math)

The share es_math contains 640 cores, 1280 GB of system memory and no GPUs. It consists of:

• 5 medium-memory high-throughput Euler VII nodes; each node comes with 128 cores and 256 GB of system memory valid until 2028-01-31.

All D-MATH users have automatically access to this share.

All others (ex. students, members of other departments and guests) need to request the access supported by a member (Professor, Senior Scientist) of D-MATH.

GPU Nodes (ls_math)

The share ls_math contains 288 cores, 1’088 GB of system memory and 36 GPUs. It consists of:

• 32 high-end GPUs units (NVIDIA RTX 3090 with 24 GB); each unit comes with 8 cores and 24 GB of system memory) valid until 2026-10-31.
• 4 professional GPUs units (NVIDIA Tesla A100 with 80 GB); each unit comes with 8 cores and 80 GB of system memory valid until 2026-10-31.

All users need to request the access supported by a member (Professor, Senior Scientist) of D-MATH.

Storage

On Euler there are different types of storage (see personal storage, global scratch or local scratch, …). If you need storage of type work (optimised for large files, 10 MB to 10 TB and beyond) or of type project (very fast, optimised for a lot of small files, ex. AI, Machine Learning), please let us know with the request form below.

Note that current shared size of our work storage is 100 TB and of our project storage 1 TB (if you need more, contact us).

Please check the current free space with the lquota command, ex.:

$ lquota /cluster/work/math
+----------------------+-------------+--------------+--------------+-------------+
| Storage location:    | Quota type: | Used:        | Soft quota:  | Hardquota:  |
+----------------------+-------------+--------------+--------------+-------------+
| /cluster/work/math   | space       |     55.13 TB |    100.00 TB |   110.00 TB |
| /cluster/work/math   | files       |      6154338 |     25000000 |    27500000 |
+----------------------+-------------+--------------+--------------+-------------+​

Request access

If you need access to one of our shares please submit the following form:

Using the share

List the shares you are allowed to use with the command my_share_info, ex.:

$ my_share_info
You are a member of the following shareholder groups on Euler:
es_math
ls_math

If you have more than one share available, select the desired one while submitting your computation to the batch system (old batch system wish LSF) as follow:

$ # new
$ sbatch -A <share_name> [other options] --wrap "command"

$ # old
$ bsub -G <share_name> [other options] command [argument]

For example:

$ # new
$ sbatch -A ls_math -G 1 ./my_cuda_program

$ # old
$ bsub -G ls_math -R "rusage[ngpus_excl_p=1]" ./my_cuda_program

Help and support

Read the PDF Slides “First Steps on Euler” (courtesy of Dr. Roger Käppeli).

Students of D-MATH and CSE may also contact Dr. Roger Käppeli of SAM for Help (but first please read the slides! ;-). For more detailed information or for technical problems, see the official documentation of the HPC cluster or contact the cluster support team:

URL: https://scicomp.ethz.ch
E-mail: cluster-support@id.ethz.ch

Useful links

• Getting started with clusters
• Accessing the clusters
• LSF to Slurm quick reference
• R on Euler
• Python on Euler

Posted on 3-Apr-2024 by ISG D-MATH
in Computing