Storage
Overview
Kamiak provides several types of storage that is available for users and lab groups.
Name | Location | Snapshots? | Backed up? | Description |
---|---|---|---|---|
Home | /home | Yes | Yes, semiannually | Storage provided to all users (100GB per user). |
Lab | /data/lab | Yes | Yes, semiannually | Storage provided to all PI's (500GB per PI). Additional lab storage is available for annual rental in 500GB units. |
Scratch | /scratch | No | No | Scratch storage, with 2 week folder lifetime, limited to 10TB per user. |
Local Scratch | /local | No | No | Scratch storage on each compute node, with 2 week folder lifetime. |
All storage is a shared resource that can be accessed on every login and compute node (except for local scratch). If you create a file in your home, lab, or scratch directories on a login or compute node, that same file is also available on all other login and compute nodes.
The shared storage system is implemented using the WekaIO parallel file system and all-flash commodity hardware, with a total usable size of approximately 1TB. There is no difference in speed of access to home, lab, and scratch storage. In particular scratch performance is no different than home or lab storage, it is intended strictly as a temporary large storage area for the duration of a job.
Data on home and lab folders is protected through daily snapshots retained for 3 days. In addition, home and lab data is backed up twice a year. Beyond that, the data owners (you) are responsible for protecting their own data by copying it as warranted out of Kamiak onto another system.
Please note that the above storage sizes are in gigabytes (GB) which are 10003 bytes, not gibibytes (GiB) which are 10243 bytes and thus slightly larger. Terabytes (TB) are similarly 10004 bytes, as opposed to tebibytes which are 10244 bytes. To see your storage usage be sure to use df -H
or du -h --si
which shows gigabytes and terabytes, otherwise it will show gibibytes and tebibytes.