UploadLargeData: Difference between revisions

From Cheaha
Jump to navigation Jump to search
(Created page with "= Load and Link approach = == transfer and uncompress (slow) == # login to cheaha.uabgrid.uab.edu (linux), # create directory for this data set in your scratch dir ## mkdir /l...")
 
(removed page. Left links to other related pages. It was redundent.)
 
(5 intermediate revisions by 2 users not shown)
Line 1: Line 1:
= Load and Link approach =
= Page removed =


 
Please see [[Galaxy_File_Uploads]] for an overview and [[Galaxy_Data_Import]] for large datasets.
== transfer and uncompress (slow) ==
# login to cheaha.uabgrid.uab.edu (linux),
# create directory for this data set in your scratch dir
## mkdir /lustre/scratch/''user''/proj1
## make sure that directory is readable by galaxy user
### Chmod og+x /lustre/scratch/''user''
### Chmod og+x /lustre/scratch/''user''/proj1
# transfer the files with SCP
## I used "Secure Shell Client" for windows, available at [http://www.uab.edu/it/software/displaytitle.php?ItemID=34 UABIT]
## UNCOMPRESSED fastq.gz files!!
### gzip -d ''filename''
# make sure the files are readable by galaxy user
##  Chmod og+r /lustre/scratch/''user''/proj1/*
 
== link into galaxy dataset (fast) ==
# get Admin privileges on galaxy
## either get Shantanu to make you admin in Galaxy
## or grab someone who is (John, Curtis)
# In Galaxy GUI:
## admin > Manage Data Libraries > create new library
### add Datasets
#### Upload option: Upload files from system path
##### Using ssh run {find `pwd`} in /lustrate/scratch/''user''/proj1/*
##### paste list of absolute path names into URL/Text box in Web Admin GUI
#### Change "Copy data into Galaxy?" to "Link to files without copying into Galaxy"
#### Put something mnemonic in Message box.
 
== link data into a history (fast) ==
 
I could then select the datasets and, at bottom of page "For selected datasets: <Import to histories>" and get them into a history so I can compute on them.

Latest revision as of 19:37, 7 March 2013

Page removed

Please see Galaxy_File_Uploads for an overview and Galaxy_Data_Import for large datasets.

Retrieved from "https://docs.uabgrid.uab.edu/w/index.php?title=UploadLargeData&oldid=4404"