Cluster Storage
User Storage
Home directory (/ist/users/USER, ~ ) is a directory which all nodes in cluster can access. Which is limited to 256 GB for each user. More stroage policy
Check quota
- command
checkquota
[songpon@ist-frontend-001 ~]$ checkquota Block Limits | File Limits Filesystem Fileset type blocks quota limit in_doubt grace | files quota limit in_doubt grace Remarks istfs home USR 19.23M 127G 128G 0 none | 1778 0 0 0 none istfs apps USR no limits
Shared directory
A shared directory (/ist/ist-share/LABS) that all users allow to create and store their files for each laboratory.
Local Scratch
A scratch directory is a temporay directory in each node that can use to read/write files (/scratch). Scratch is a shared directory for all users but each file will be deleted in 60 days start from created time.
This directory can be access by Slurm job only. We recommended to write a command to transfer the result back in job script.
View files size command
- command:
du -shc $FILENAME
[songpon@ist-frontend-001 docs-utils]$ du -shc * 16K tensorflow2.py 16K total