UploadLargeData

From UABgrid Documentation
(Difference between revisions)
Jump to: navigation, search
(Created page with "= Load and Link approach = == transfer and uncompress (slow) == # login to cheaha.uabgrid.uab.edu (linux), # create directory for this data set in your scratch dir ## mkdir /l...")
 
(removed page. Left links to other related pages. It was redundent.)
 
(5 intermediate revisions by 2 users not shown)
Line 1: Line 1:
= Load and Link approach =
+
= Page removed =
  
 
+
Please see [[Galaxy_File_Uploads]] for an overview and [[Galaxy_Data_Import]] for large datasets.
== transfer and uncompress (slow) ==
+
# login to cheaha.uabgrid.uab.edu (linux),
+
# create directory for this data set in your scratch dir
+
## mkdir /lustre/scratch/''user''/proj1
+
## make sure that directory is readable by galaxy user
+
### Chmod og+x /lustre/scratch/''user''
+
### Chmod og+x /lustre/scratch/''user''/proj1
+
# transfer the files with SCP
+
## I used "Secure Shell Client" for windows, available at [http://www.uab.edu/it/software/displaytitle.php?ItemID=34 UABIT]
+
## UNCOMPRESSED fastq.gz files!!
+
### gzip -d ''filename''
+
# make sure the files are readable by galaxy user
+
##  Chmod og+r /lustre/scratch/''user''/proj1/*
+
 
+
== link into galaxy dataset (fast) ==
+
# get Admin privileges on galaxy
+
## either get Shantanu to make you admin in Galaxy
+
## or grab someone who is (John, Curtis)
+
# In Galaxy GUI:
+
## admin > Manage Data Libraries > create new library
+
### add Datasets
+
#### Upload option: Upload files from system path
+
##### Using ssh run {find `pwd`} in /lustrate/scratch/''user''/proj1/*
+
##### paste list of absolute path names into URL/Text box in Web Admin GUI
+
#### Change "Copy data into Galaxy?" to "Link to files without copying into Galaxy"
+
#### Put something mnemonic in Message box.
+
 
+
== link data into a history (fast) ==
+
 
+
I could then select the datasets and, at bottom of page "For selected datasets: <Import to histories>" and get them into a history so I can compute on them.
+

Latest revision as of 13:37, 7 March 2013

[edit] Page removed

Please see Galaxy_File_Uploads for an overview and Galaxy_Data_Import for large datasets.

Personal tools
Namespaces

Variants
Actions
Navigation
Toolbox