Projects
On this Page
- What is the Projects data storage area
- When to use the Projects area
Projects storage is allocated and organised per department and group /projects/<division>/<department>/<Research_Group>. The principle investigator for the group is responsible for the data contained within the project directory.
Project quotas are set upon initial set-up and can be revised upon request.
The projects storage is high-performance and is ideal for temporarily storing data that is in use for individuals and sharing within groups using the research infrastructure.
We recommend having a copy of your source data on HCS, and transferring a copy to /projects/ for working on, then removing this working copy once finished and transferring results back to HCS.
To apply for a projects directory, please fill out the storage-signup-form form.
When to use /projects/ storageΒΆ
Intermediate Data Storage:
- During complex computations, intermediate data or temporary results are often generated.
Checkpointing:
- In long-running computations, checkpointing is used to save the state of a job at regular intervals.
Data Staging:
- Before running a job, input data can be staged (preloaded) into
/projects/from HCS (or other sources) to ensure that the computation starts immediately without waiting for data transfers from slower storage systems.
Temporary Data Processing:
- For tasks that generate large amounts of temporary data, such as sorting, indexing, or image processing.
Warning
Note that the Research storage is not backed up and it is the responsibility of the user to ensure their important data is safe. See data transfer for options to move data you want to retain. If you need assistance with backing up your data, please email rtis.support@otago.ac.nz.