File Management

Filesystem

Illinois HTC filesystem summary

Name

Mount Path

Quota Policy

Purge Policy

Snapshots

home

/home

5GB Soft/7GB Hard; 7 Day Grace;

No inode quota

No purge

Yes; Daily for 30 days

project

/projects

Based on investment; 20 million

inodes per user

No purge

Yes; Daily for 30 days

scratch

/scratch

10TB/User; No inode quota

Daily Purge of Files Older than

30 days

No

Home

The /home area of the filesystem is where you land when you log into the head node (htc-hn02). This area has a fairly small quota and is meant to contain your configuration files, job output/error files, and smaller software installations. Your /home area of the filesystem is automatically provisioned during the account provisioning process. It is not possible to request an expansion of home directory quota.

The 7-day grace period on /home means that if the usage in your home directory is over 5GB for a 7-day period, your home directory will stop accepting new writes until data has been cleared to get below the 5GB threshold.

Project

The /projects area of the filesystem is where a group’s (single faculty member, a lab group, a department, or an entire college) storage capacity resides. You can have access to multiple project subdirectories if you are a member of multiple investment groups and have been granted access to the space by the group’s PI or Tech Rep. This storage area is where the bulk of the filesystem’s capacity is allocated.

Project location: /projects/illinois/<$college>/<$department>/<$pi_netid> (example: /projects/illinois/eng/physics/bobsmith)

Scratch

The /scratch area of the filesystem is where you can place data while it is under active work. The scratch area is provisioned by the Campus Cluster program for all users to have access to.

As noted in the summary table, files older than 30 days are purged from this space, based on a file’s last access time. The admin team maintains various tools to detect and monitor for users abusing the scratch area (such as by artificially modifying file access times) to attempt to circumvent the purge policy. Doing so is a violation of the cluster’s policy and is not allowed. If you believe you have a legitimate need to retain data in scratch for longer than 30 days, please submit a support request.

Scratch location: /scratch/users/<$your_netid>