System Allocations

Access to Taiga is granted via:

  • An allocation through the Illinois Computes program.

  • Direct investment in Taiga (for costs, refer to Taiga Pricing).

  • An allocation on another system that itself is paying for capacity storage from Taiga (denoted by *)

The following systems leverage Taiga:

  • Delta*

  • DeltaAI*

  • Illionis Campus Cluster

  • Radiant

  • NCSA Industry

  • HAL

  • ISL Cluster

Note: HAL users have access to the Taiga filesystem on HAL head nodes and DTN. Users can access an allocation from another cluster or investment.

Check Allocation Utilization

The quota command on Illinois Campus Cluster will show all of your allocation usage on Taiga (via the /projects section of the output). The Delta and DeltaAI systems have the taigaquota command which looks like the following:

[username@dt-login01 ~]$ taigaquota
Quota usage for user yourusername:
---------------------------------------------------------------------------------------------------------------------
|              Directory Path               |  Block  |  Soft   |  Hard   |    Files    |    Soft     |    Hard     |
|                                           |  Used   |  Quota  |  Limit  |    Used     |    Quota    |    Limit    |
---------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------------------------------------------------
| /taiga/nsf/delta/xxxx                     | 1.692T  | 1.953T  | 2.002T  | 1821185     | 3000000     | 3300000     |
| /taiga/industry/yy/yyy                    | 6.033P  | 6.348P  | 6.348P  | 794314501   | 9750000000  | 9750000000  |
| /taiga/illinois/ovcri/ncsa/shared         | 36.71T  | 62T     | 62T     | 17242328    | 93000000    | 93000000    |
| /taiga/illinois/eng/cs/pinetid            | 5.109T  | 10T     | 10T     | 2516541     | 15000000    | 15000000    |
| /taiga/illinois/las/stat/pinetid          | 59.43G  | 1T      | 1T      | 56009       | 1500000     | 1500000     |
---------------------------------------------------------------------------------------------------------------------

Another method for checking your quota is to leverage the fact that Lustre informs the df utility of project quotas, which is how Taiga partitions capacity. This is especially useful to users who mount Taiga via NFS to their Radiant VMs. To see your usage vs. your quota, change into your allocation directory and run df with the -h and -i flags to check block and file utilization, respectively, like the below:

[user@client]$ cd /taiga/illinois/eng/ece/bobsmith
[user@client]$ df -h .
Filesystem                                                                    Size  Used Avail Use% Mounted on
172.30.32.2@o2ib,172.30.32.3@o2ib:..172.30.32.8@o2ib,172.30.32.9@o2ib:/taiga  5.0T  489G  4.6T  10% /taiga

[user@client]$ cd /taiga/illinois/eng/ece/bobsmith
[user@client]$ df -i .
Filesystem                                                                    Inodes  IUsed IFree   IUse% Mounted on
172.30.32.2@o2ib,172.30.32.3@o2ib:..172.30.32.8@o2ib,172.30.32.9@o2ib:/taiga  7500000 90212 7409788    2% /taiga

To retrieve your current quota utilization on Taiga if you don’t had SSH to an NCSA system (eg. you only use Taiga via Globus/S3) you can SSH to: $your_ncsa_username@storagequota.ncsa.illinois.edu. After successfully authenticating it will print out your quota information for NCSA Taiga and Granite global file systems and then exit. An example output is below:

[you@your_host ~]$ ssh [email protected]
([email protected]) Password:
([email protected]) Duo two-factor login for your_ncsa_username

Enter a passcode or select one of the following options:

 1. Duo Push to XXX-XXX-1234

Passcode or option (1-1): 1
Success. Logging you in...

Quota usage for Taiga allocations:
---------------------------------------------------------------------------------------------------------------------
|              Directory Path               |  Block  |  Soft   |  Hard   |    Files    |    Soft     |    Hard     |
|                                           |  Used   |  Quota  |  Limit  |    Used     |    Quota    |    Limit    |
---------------------------------------------------------------------------------------------------------------------
| /taiga/nsf/delta/bXZX                     | 16k     | 500G    | 550G    | 4           | 375000      | 412500      |
| /taiga/nsf/delta/bXXY                     | 1.823T  | 1.953T  | 2.002T  | 2329496     | 3000000     | 3300000     |
| /taiga/nsf/delta/bXXZ                     | 259.2G  | 500G    | 550G    | 489         | 375000      | 412500      |
| /taiga/industry/XY                        | 6.649P  | 6.738P  | 6.738P  | 971159501   | 10350000000 | 10350000000 |
| /taiga/illinois/XXXXXXX/YYYYY/ZZZ         | 18.19T  | 60T     | 60T     | 13588028    | 90000000    | 90000000    |
---------------------------------------------------------------------------------------------------------------------

Quota usage for Granite allocations:
---------------------------------------------------------------------------------------------------------------------
|              Directory Path               |  Block  |  Soft   |  Hard   |    Files    |    Soft     |    Hard     |
|                                           |  Used   |  Quota  |  Limit  |    Used     |    Quota    |    Limit    |
---------------------------------------------------------------------------------------------------------------------
| /granite/industry/XXXXXX                  | 53.8T   | 90.0T   | 90.0T   | 159         | 900000      | 900000      |
| /granite/nsf/access/bXXX                  | 25M     | 10.0T   | 10.0T   | 3           | 100000      | 100000      |
---------------------------------------------------------------------------------------------------------------------
Connection to storagequota.ncsa.illinois.edu closed.
[you@your_host ~]$

How to Request an Allocation

Note

If you don’t already one, create an NCSA Kerberos account. Once requested, Kerberos account creation may take up to 24 hours.

Illinois Computes Program

Illinois Computes is targeted at providing computing for all. A base level of services and resources are available to Illinois researchers, through Illinois Computes, at no cost.

Follow these steps to request a Taiga allocation through Illinois Computes:

  1. Log into the NCSA XRAS portal with your NCSA account username and Kerberos password.

  2. In the Start New Submission tab, click Start a New Illinois Computes Program Submission.

  3. Fill out the submission form, providing as much detail as possible.

  4. Click Submit.

    The Illinois Computes/Taiga admins will review your submission and follow up via email if they have questions or need additional information.

    You can expect to hear back with a decision on your allocation request within 10 business days of submission (this may be longer if you have been asked to provide additional information).

Direct Investment

You can initiate a direct investment request through one of the following two methods:

Request via Email

Copy the following questions into an email and send to malone12@illinois.edu:

  • Project name:

  • Contact name:

  • Contact email:

  • Allocation Capacity (in TB):

  • CFOP (for billing):

  • Desired Allocation Start Date:

  • Primary resource from which data will be accessed:

  • Do you agree to the Taiga service level agreement (SLA) (Y/N):

  • Are there other contracts required? (Y/N) If so, what are they?

    • Contract # (if applicable):

  • Moving data from elsewhere? Where? How much? Will you need assistance?

Request via the NCSA XRAS Portal

  1. Log into the NCSA XRAS portal with your NCSA account username and Kerberos password.

  2. In the Start New Submission tab, click Start a New Taiga Submission.

  3. Fill out the submission form, providing as much detail as possible.

    Here is the Taiga service level agreement (SLA).

    In the Documents section, if you do not want to submit any supporting documents, click Remove and any required document fields will no longer be required to submit the form.

  4. Click Submit.

    The Taiga admin group will review your submission and follow up via email if they have questions or need additional information.

    You can expect to hear back with a decision on your allocation request within 10 business days of submission (this may be longer if you have been asked to provide additional information).