Difference between revisions of "File System Quotas"

From UFRC
Jump to navigation Jump to search
m (Text replacement - "/ufrc" to "/blue")
 
Line 1: Line 1:
 
[[Category:Storage]]
 
[[Category:Storage]]
==/blue filesystems==
+
=Main Filesystems=
The <code>/blue</code> filesystem is intended to support all job-related I/O to or from both the interactive and batch servers. You should perform all interactive processes and batch jobs on <code>/blue</code>, not on any other filesystems (especially not <code>/home</code>). Using other filesystems for this purpose is in violation of Research Computing policy and will result in '''suspension''' of your account.
+
UFRC has two main storage systems - blue and orange storage. See [[Storage]] for more details on their purpose and appropriate usage.
 
+
==Reason for Quotas==
The <code>/blue</code> filesystem is essential to the overall performance of HiPerGator. It is not intended for long-term storage and should only be used for current computational projects. Once a project is finished, data should be moved to your personal, invested long-term, group, or department storage.
+
Quotas are implemented to ensure that there is always some free space available on a filesystem. This is necessary to avoid users inadvertently filling the filesystem, which could result in job failures for all Research Computing users.
 
 
==Quotas==
 
Quotas have been implemented on <code>/blue</code> to ensure that there is always some free space available. This is necessary to avoid users inadvertently filling the filesystem, which could result in job failure for Research Computing users.
 
  
 
Filesystem quotas are not intended to be a barrier to your productivity. If you need space beyond what is initially allocated, it is possible to [[#Temporary quota increase | request a temporary quota increase]] or to [http://www.rc.ufl.edu/services/rates/ purchase additional storage].
 
Filesystem quotas are not intended to be a barrier to your productivity. If you need space beyond what is initially allocated, it is possible to [[#Temporary quota increase | request a temporary quota increase]] or to [http://www.rc.ufl.edu/services/rates/ purchase additional storage].
  
==Check your quota==
+
==Checking Quotas==
Log in to your Research Computing account using SSH and use the following command. This will return quota information for both your user account and primary group.  
+
Log in to your Research Computing account using SSH and use the blue_quota or orange_quota command to see the quota information for both your user account and primary group.  
  
<pre>$ lfs quota /blue </pre>
+
<pre>
 +
$ blue_quota
 +
Disk quotas for group 'mygroup' on /blue filesystem
 +
Filesystem    used  quota  limit  grace  files  quota   limit  grace
 +
    /blue  28.91T    60T    60T      - 20176380      0      0      -
 +
Disk quotas for user 'rcuser' on /blue filesystem
 +
Filesystem    used  quota  limit  grace  files  quota  limit  grace
 +
    /blue  3.92T      0k      0k      - 7846854      0      0      -
 +
Note: you do not have permission to view data for other users in your group.
  
To check the quota of a group that you have secondary membership to:
+
See additional options with 'blue_quota -h'
<pre>$ lfs quota -g <groupname> /blue </pre>
+
</pre>
  
 
Currently, a user can check their own quota and the quota of their group(s). Users cannot check the quotas of other group members or other groups.
 
Currently, a user can check their own quota and the quota of their group(s). Users cannot check the quotas of other group members or other groups.
 
===Example===
 
In this example, the output returned represents quota information for the "farmerie" group.
 
 
<pre>
 
$ lfs quota -g farmerie /blue
 
Disk quotas for group farmerie (gid 3310):
 
    Filesystem  kbytes      quota      limit      grace  files      quota  limit  grace
 
      /blue  5678801848  6442450944  6442450944      -    204483      0      0      -
 
</pre>
 
 
===Explanation of output===
 
As you can see, the output includes a number of columns. The first six columns of output all contain useful information. Keep in mind that all numbers are in kilobytes.
 
 
{| class="wikitable" style="width:75%; text-align:center;"
 
|-
 
|- style="background-color:#DEEAF6;"
 
|
 
| style="text-align:center; font-weight:bold;" | 1
 
| style="text-align:center; font-weight:bold;" | 2
 
| style="text-align:center; font-weight:bold;" | 3
 
| style="text-align:center; font-weight:bold;" | 4
 
| style="text-align:center; font-weight:bold;" | 5
 
| style="text-align:center; font-weight:bold;" | 6
 
| style="text-align:center; font-weight:bold;" | 7
 
| style="text-align:center; font-weight:bold;" | 8
 
| style="text-align:center; font-weight:bold;" | 9
 
|-
 
| style="padding:10px; background-color:#DEEAF6; font-weight:bold;" rowspan="2" | '''Output'''
 
| style="padding:10px;" | <code>Filesystem</code>
 
| style="padding:10px;" | <code>kbytes</code>
 
| style="padding:10px;" | <code>quota</code>
 
| style="padding:10px;" | <code>limit</code>
 
| style="padding:10px;" | <code>grace</code>
 
| style="padding:10px;" | <code>files</code>
 
| style="padding:10px;" | <code>quota</code>
 
| style="padding:10px;" | <code>limit</code>
 
| style="padding:10px;" | <code>grace</code>
 
|-
 
| style="padding:10px;" | <code>/blue</code>
 
| style="padding:10px;" | <code>5678801848</code>
 
| style="padding:10px;" | <code>6442450944</code>
 
| style="padding:10px;" | <code>6442450944</code>
 
| style="padding:10px;" | <code>-</code>
 
| style="padding:10px;" | <code>204483</code>
 
| style="padding:10px;" | <code>0</code>
 
| style="padding:10px;" | <code>0</code>
 
| style="padding:10px;" | <code>-</code>
 
|-
 
| style="padding:5px; font-weight:bold; background-color:#DEEAF6;" | Description
 
| style="font-size:12px; padding:10px;" | name of the file system
 
| style="font-size:12px; padding:10px;" | amount of space used by group
 
| style="font-size:12px; padding:10px;" | amount of space assigned to group
 
| style="font-size:12px; padding:10px;" | maximum amount of space accessible by group
 
| style="font-size:12px; padding:10px;" | grace period for exceeding quota
 
| style="font-size:12px; padding:10px;" | number of files owned by group
 
| style="font-size:12px; padding:10px;" | soft limit of files allowed
 
| style="font-size:12px; padding:10px;" | hard limit of files allowed
 
| style="font-size:12px; padding:10px;" | grace period for files
 
|-
 
| style="padding:5px; font-weight:bold; background-color:#DEEAF6;" | Notes
 
| style="font-size:12px; padding:10px;" |
 
| style="font-size:12px; padding:10px;" | approx. 5.7 TB
 
| style="font-size:12px; padding:10px;" | approx. 6.4 TB
 
| style="font-size:12px; padding:10px;" | approx. 6.4 TB
 
| style="font-size:12px; padding:10px;" | '-' denotes the default (7 days)
 
| style="font-size:12px; padding:10px;" |
 
| style="font-size:12px; padding:10px;" | 0 means no limit
 
| style="font-size:12px; padding:10px;" | 0 means no limit
 
| style="font-size:12px; padding:10px;" | '-' denotes the default (7 days)
 
|}
 
  
 
==Exceeded quota==
 
==Exceeded quota==

Latest revision as of 18:50, 15 February 2021

Main Filesystems

UFRC has two main storage systems - blue and orange storage. See Storage for more details on their purpose and appropriate usage.

Reason for Quotas

Quotas are implemented to ensure that there is always some free space available on a filesystem. This is necessary to avoid users inadvertently filling the filesystem, which could result in job failures for all Research Computing users.

Filesystem quotas are not intended to be a barrier to your productivity. If you need space beyond what is initially allocated, it is possible to request a temporary quota increase or to purchase additional storage.

Checking Quotas

Log in to your Research Computing account using SSH and use the blue_quota or orange_quota command to see the quota information for both your user account and primary group.

$ blue_quota
Disk quotas for group 'mygroup' on /blue filesystem
Filesystem    used   quota   limit   grace   files   quota   limit   grace
     /blue  28.91T     60T     60T       - 20176380       0       0       -
Disk quotas for user 'rcuser' on /blue filesystem
Filesystem    used   quota   limit   grace   files   quota   limit   grace
     /blue   3.92T      0k      0k       - 7846854       0       0       -
Note: you do not have permission to view data for other users in your group.

See additional options with 'blue_quota -h'

Currently, a user can check their own quota and the quota of their group(s). Users cannot check the quotas of other group members or other groups.

Exceeded quota

If you exceed your quota, your applications will receive a quota violation error (i.e., “Disk quota exceeded.”). In most cases, the quota and limit (columns 3 and 4) are the same, so the grace period is irrelevant.

Temporary quota increase

Each group may request one temporary quota increase per twelve month period. Such increases will be granted for up to three months.

To request an increase, please open a support request. In your request, please indicate:

  1. How much additional space you need
  2. The filesystem on which you need it
  3. How long you will need it (up to 3 months)

Temporary quota increases are granted at the discretion of Researching Computing on an “as available” basis. If your needs do not fit into the parameters outlined above, please contact us with a description of your situation so we can review it and recommend an appropriate solution. For more space on a long-term basis, you may want to consider making a storage investment. Please see our website for more information about storage options.