Home directories have a soft limit of 100GB and a hard limit of 200GB. Once you exceed the soft limit we will ask you to reduce your usage. You will not be able to write data beyond the hard limit. Project space is limited to 250 GB. Scratch storage is limited to 1 TB (2 TB on Xena). Center-wide project scratch space is limited to 1 TB and user scratch is limited to 100G (/carc/scratch). To purchase additional storage please see our pricing spreadsheet.
The 'quotas' command shows your quota usage.
To ensure that all research and class projects get their fair share of the clusters and to prevent any one group from using a disproportionate amount of resources, we utilize Slurm’s built-in job accounting and fairshare system. The cluster is a limited resource and Fairshare allows us to ensure everyone gets a fair opportunity to use it regardless of how big or small the group is. Your compute resource allocation is shared among everyone in the slurm account you select.
For more on slurm accounts see this quickbyte: https://github.com/UNM-CARC/QuickBytes/blob/master/slurm_accounting.md Note that your slurm account is not the same as your CARC login account.
To see the predicted start time of your job based on your fairshare score, use the following command:
squeue --start --job <job_id>
| Queue | GPU | Bigmem | Debug |
|---|---|---|---|
| Number of Processors | 192 | 128 | 8 |
| Number of Nodes | 12 (singleGPU) 4 (dualGPU) |
1 | 2 |
| Processors per Node | 16 | 32 | 4 |
| Walltime(H:M:S) | 48:00:00 | 48:00:00 | 04:00:00 |
| Memory Limit | 60 Gb (singleGPU and dualGPU) | 1 Tb (bigmem-1TB) 3 Tb (bigmem-3TB) |
60 Gb |
| Queue: | Default | Debug |
|---|---|---|
| Number of Processors | 400 | 32 |
| Number of Nodes | 50 | 4 |
| Processors per Node | 8 | 8 |
| Walltime(H:M:S) | 48:00:00 | 04:00:00 |
| Memory Limit | 44 Gb | 44 Gb |
| Queue: | General | Debug | Condo | Private |
|---|---|---|---|---|
| Number of Processors | 64 | 8 | 192 | Determined by queue owner |
| Number of Nodes | 2 | 2 | 6 | |
| Processors per Node | 32 | 8 | 32 | |
| Walltime(H:M:S) | 48:00:00 | 04:00:00 | 48:00:00 | |
| Memory Limits | 90 Gb | 90 Gb |