Data Movement

From UABgrid Documentation
Revision as of 14:46, 13 December 2016 by Ravi89@uab.edu (Talk | contribs)

(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)
Jump to: navigation, search

There are various tools which you can utilize to help you move data within the HPC cluster, such as mv, cp, scp etc. One of the most powerful tools for data movement on Linux is rsync, which we'll be using in our example scripts below.

Contents

Procedure

rr

Job Scripts

If the data that you are moving is large, then you should always use an interactive session or a job script for your data movement. This ensures that the process for your data movement isn't occupying login nodes for a long time, and instead is performing these operations on a compute node.

Interactive session

Job Script

Personal tools
Namespaces

Variants
Actions
Navigation
Toolbox