Condor week summary: Difference between revisions

From Cheaha
Jump to navigation Jump to search
No edit summary
(uploaded talk 1 draft)
Line 14: Line 14:


==Day 1: Tutorials ==
==Day 1: Tutorials ==
===1: Basic Introduction to using Condor: Karen Miller===
Background HTC
Definitions: Job, Class Ads, Match Making, Central Manager, Submit host, Execute Host
What Condor does: submit- condor bundles up the executable and input files, condor locates a machine, runs the job, and gets the output back to the submit host.
Requirements (needs), Rank( preferences)
Condor Class Ads: used to describe aspects of each item outside condor.
job Class ad:
machine class ad:
Match making:  requirement, rank and priorities (fair share allocation)
Getting started:
universe, make job batch -ready, submit file, condor_submit
Universe-environment
batch ready- run w/o interaction (as if in the background), make input, output available, data files
submit description file- # comments, commands on left are not case sensitive, filenames are
'''Good advice: always have a log file'''
file transfer; Transfer_Input_Files, Transfer_Output_Files
Should_transfer_Files: Yes (no shared files system), NO (use shared FS) IF_NEEDED
emails: NOTIFICATION = complete, never, error, error, always.
Job Identifier: cluster.process  eg. 20.1, 20.2 etc..
Multiple jobs : to create directories (based on the process id)
InitialDir=run_0,run_1 etc…
Queue all 1,000,000 jobs
Queue 100000
$(Process)
use macro subs: %this gives the process id..
InitialDir=run_$(Process)     





Revision as of 14:49, 8 May 2012

Condor week 2012, UW-Madison, May 1 - May 5, 2012

Attendees: John-Paul Robinson, Poornima Pochana, Thomas Anthony

Website: http://research.cs.wisc.edu/condor/CondorWeek2012/

Condor Week is a four day annual event that gives collaborators and users the chance to exchange ideas and experiences, to learn about latest research, and to influence our short and long term research and development directions.


Day 1: Tutorials

1: Basic Introduction to using Condor: Karen Miller

Background HTC Definitions: Job, Class Ads, Match Making, Central Manager, Submit host, Execute Host

What Condor does: submit- condor bundles up the executable and input files, condor locates a machine, runs the job, and gets the output back to the submit host.

Requirements (needs), Rank( preferences)

Condor Class Ads: used to describe aspects of each item outside condor. job Class ad: machine class ad:

Match making: requirement, rank and priorities (fair share allocation)

Getting started: universe, make job batch -ready, submit file, condor_submit

Universe-environment batch ready- run w/o interaction (as if in the background), make input, output available, data files submit description file- # comments, commands on left are not case sensitive, filenames are

Good advice: always have a log file

file transfer; Transfer_Input_Files, Transfer_Output_Files

Should_transfer_Files: Yes (no shared files system), NO (use shared FS) IF_NEEDED

emails: NOTIFICATION = complete, never, error, error, always.

Job Identifier: cluster.process eg. 20.1, 20.2 etc..

Multiple jobs : to create directories (based on the process id) InitialDir=run_0,run_1 etc… Queue all 1,000,000 jobs

Queue 100000 $(Process)

use macro subs: %this gives the process id.. InitialDir=run_$(Process)



Day 2: Talks

Day 3: Talks

Day 4: Discussion Panels