Data Transfer Overview

On this Page

• Available storage locations
• Choosing a transfer method
• Transfer tools for different file sizes

To use the research cluster, you'll need to transfer data from your local machine to storage accessible by the cluster. There are two main storage locations:

• Otago High Capacity Storage (HCS) - for long-term, backed-up data storage
• Cluster research storage (Ohau and WEKA) - for temporary working data during jobs

Choose your transfer method based on how much data you need to move and your file size. For details on storage options, see Storage overview.

Small Files (Upload via Web Interface)

For uploading a single file or a few small files, use the file browser in Open OnDemand.

The file browser within Open OnDemand can be used to upload files directly into either your home or a project directory. It can't be used for accessing data on the Otago HCS.

What's next?

• Open OnDemand file browser
• Storage locations

Large or Multiple Files (Command Line Tools)

For transferring many files or large files, use command-line tools via SSH connection:

• scp or rsync - for direct transfers via SSH
• Globus - for high-volume data transfers and automated workflows

What's next?

• Using rsync and scp for file transfer
• Using Globus for large data transfers