MatLab DCS R2013a - Revision history

Tanthony@uab.edu: deprecated Banner

2017-03-10T00:36:58Z

deprecated Banner

← Older revision		Revision as of 00:36, 10 March 2017
Line 1:		Line 1:
			{{Matlab_deprecated}}

	== Overview ==		== Overview ==

Tanthony@uab.edu: /* Validate the "cheaha" PCT Configuration */ added note about the qalter

2013-09-09T14:39:30Z

Validate the "cheaha" PCT Configuration: added note about the qalter

← Older revision		Revision as of 14:39, 9 September 2013
Line 83:		Line 83:
	[[Image:MATLAB_R2012a_configuration.png \| 800px]]		[[Image:MATLAB_R2012a_configuration.png \| 800px]]

	===== Validate the "cheaha" PCT Configuration =====		===== Validate the "cheaha" PCT Configuration =====
			<pre>
			Currently our validations need to manually specify the vf and h_rt
			options for each job. The job will wait in qw state till these options
			are added with the following qalter command

			qalter -l vf=1G,h_rt=1:00:00 jobid
			</pre>



	# Before starting validation please make sure the directory '/scratch/user/YOURUSERID/matlab' exists on the scratch space on the Cheaha. If it does not please SSH into Cheaha and create the directory before proceeding.		# Before starting validation please make sure the directory '/scratch/user/YOURUSERID/matlab' exists on the scratch space on the Cheaha. If it does not please SSH into Cheaha and create the directory before proceeding.

Tanthony@uab.edu: /* Parallel Computing Toolbox Configuration */ cheanged to R2013a

2013-09-09T14:33:18Z

Parallel Computing Toolbox Configuration: cheanged to R2013a

← Older revision		Revision as of 14:33, 9 September 2013
Line 59:		Line 59:
	* have followed the steps in the previous section		* have followed the steps in the previous section

	# ~~[http://projects.uabgrid.uab.edu/matlab/browser/trunk/parallel~~-~~configs/cheaha-R2012a~~.settings~~?format=raw R2012a] cluster configuration file~~		# The R2013a cluster configuration file available with the Submit functions as Cheaha-R2013a.settings
	#* Start MATLAB ~~R2012a~~ on your workstation		#* Start MATLAB R2013a on your workstation
	#* Click the "Parallel" menu		#* Click the "Parallel" menu
	#* Click "Manage Cluster Profiles"		#* Click "Manage Cluster Profiles"
	#* In the "Cluster Profile Manager" window, click the "Import" button on the toolbar		#* In the "Cluster Profile Manager" window, click the "Import" button on the toolbar
	#* Browse to the location where you saved the '''cheaha-~~R2012a~~.settings''' file, select it, and click "Open"		#* Browse to the location where you saved the '''cheaha-R2013a.settings''' file, select it, and click "Open"

	[[Image:Screen_shot_2012-03-08_at_11.13.59_AM.png]]		[[Image:Screen_shot_2012-03-08_at_11.13.59_AM.png]]

Tanthony@uab.edu: changes for direct download

2013-09-09T14:31:20Z

changes for direct download

← Older revision		Revision as of 14:31, 9 September 2013
Line 39:		Line 39:

	# Download the MATLAB submit functions		# Download the MATLAB submit functions
	#* [https://projects.uabgrid.uab.edu/matlab/browser/trunk/distributables/matlab-R2013a-nonshared.zip Submit Functions for MATLAB R2013a] -(updated 09/03/2013)		#* [https://projects.uabgrid.uab.edu/matlab/browser/trunk/distributables/matlab-R2013a-nonshared.zip?format=raw Submit Functions for MATLAB R2013a] -(updated 09/03/2013)
	# Unzip the files to a directory included in your MATLAB PATH setting. Recommended locations are:		# Unzip the files to a directory included in your MATLAB PATH setting. Recommended locations are:
	#* Windows: <pre>My Documents\MATLAB</pre>		#* Windows: <pre>My Documents\MATLAB</pre>

Tanthony@uab.edu: /* MATLAB Submit Functions */ changed link to new submit functions

2013-09-09T14:29:55Z

MATLAB Submit Functions: changed link to new submit functions

← Older revision		Revision as of 14:29, 9 September 2013
Line 39:		Line 39:

	# Download the MATLAB submit functions		# Download the MATLAB submit functions
	#* [~~http~~://projects.uabgrid.uab.edu/matlab/browser/trunk/distributables/matlab-~~R2012a~~-nonshared.zip~~?format=raw~~ Submit Functions for MATLAB R2013a] -(updated 09/03/2013)		#* [https://projects.uabgrid.uab.edu/matlab/browser/trunk/distributables/matlab-R2013a-nonshared.zip Submit Functions for MATLAB R2013a] -(updated 09/03/2013)
	# Unzip the files to a directory included in your MATLAB PATH setting. Recommended locations are:		# Unzip the files to a directory included in your MATLAB PATH setting. Recommended locations are:
	#* Windows: <pre>My Documents\MATLAB</pre>		#* Windows: <pre>My Documents\MATLAB</pre>

Tanthony@uab.edu: /* Personalize the "cheaha" PCT Configuration */

2013-09-05T14:04:38Z

Personalize the "cheaha" PCT Configuration

← Older revision		Revision as of 14:04, 5 September 2013
Line 72:		Line 72:
	#Double click on cheaha in the Configuration Manager window to open the configuration editor. (Note: stretch the "Generic Scheduler Configuration Properties" window to the right so that you can view all of the text in the fields making it easier to read and edit correctly.)		#Double click on cheaha in the Configuration Manager window to open the configuration editor. (Note: stretch the "Generic Scheduler Configuration Properties" window to the right so that you can view all of the text in the fields making it easier to read and edit correctly.)
	# Edit the following fields to use your personal data directories		# Edit the following fields to use your personal data directories
	#* '''ClusterMatlabRoot''': Make sure that the Root directory of MATLAB installation for workers matches the exact version of MATLAB you are using on your workstation. In this example '''/share/apps/mathworks/~~R2012a~~''' matches a MATLAB R2012a workstation install. Change the "R2012a" to match your workstation MATLAB version.		#* '''ClusterMatlabRoot''': Make sure that the Root directory of MATLAB installation for workers matches the exact version of MATLAB you are using on your workstation. In this example '''/share/apps/mathworks/R2013a''' matches a MATLAB R2012a workstation install. Change the "R2012a" to match your workstation MATLAB version.
	#* '''JobStorageLocation''' : Change the directory path where job data is stored to an existing directory on your workstation where MATLAB can stage job files.		#* '''JobStorageLocation''' : Change the directory path where job data is stored to an existing directory on your workstation where MATLAB can stage job files.
	#* '''IndependentSubmitFcn''': Change the text "YOURUSERID" to your login id on Cheaha		#* '''IndependentSubmitFcn''': Change the text "YOURUSERID" to your login id on Cheaha

Tanthony@uab.edu: /* Using MATLAB DCS */

2013-09-05T14:04:04Z

Using MATLAB DCS

← Older revision		Revision as of 14:04, 5 September 2013
Line 24:		Line 24:
	# run the validation tests to confirm a working installation.		# run the validation tests to confirm a working installation.

	This page documents the DCS configuration for MATLAB ~~2012a and later~~. For DCS configuration instructions on previous versions of MATLAB, please see the page [[MatLab DCS R2010a and Earlier]] or [[MatLab_DCS_R2010b_2011a_2011b \| Matlab DCS R2010b -R2011b]]		This page documents the DCS configuration for MATLAB 2013a . For DCS configuration instructions on previous versions of MATLAB, please see the page [[MatLab DCS R2010a and Earlier]] or [[MatLab_DCS_R2010b_2011a_2011b \| Matlab DCS R2010b -R2011b]] or [[MatLab_DCS_R2012a \| MATLAB DCS R2012a]]

	Using MATLAB DCS requires you have a cluster account on [[Cheaha]]. Please request an account by sending an email to [[mailto:support@vo.uabgrid.uab.edu]] and include your campus affiliation and a brief statement of your research interests for using the cluster.		Using MATLAB DCS requires you have a cluster account on [[Cheaha]]. Please request an account by sending an email to [[mailto:support@vo.uabgrid.uab.edu]] and include your campus affiliation and a brief statement of your research interests for using the cluster.
Line 39:		Line 39:

	# Download the MATLAB submit functions		# Download the MATLAB submit functions
	#* [http://projects.uabgrid.uab.edu/matlab/browser/trunk/distributables/matlab-R2012a-nonshared.zip?format=raw Submit Functions for MATLAB ~~R2012a~~] -(updated 03/~~07/2012~~)		#* [http://projects.uabgrid.uab.edu/matlab/browser/trunk/distributables/matlab-R2012a-nonshared.zip?format=raw Submit Functions for MATLAB R2013a] -(updated 09/03/2013)
	# Unzip the files to a directory included in your MATLAB PATH setting. Recommended locations are:		# Unzip the files to a directory included in your MATLAB PATH setting. Recommended locations are:
	#* Windows: <pre>My Documents\MATLAB</pre>		#* Windows: <pre>My Documents\MATLAB</pre>

Tanthony@uab.edu: created page

2013-09-05T14:01:09Z

created page

New page

== Overview ==

The following outline highlights the steps involved to configure your MatLab install and write programs that submit tasks to the worker nodes of the Distributed Computing Server on Cheaha:

* Configure the Task Submit Environment (One-time Setup)
** [[MatLab|Install MatLab]] with the Parallel Computing Toolbox on your Windows / Linux / Mac workstation
** Download and extract the MatLab task submission functions to your workstation MatLab environment
** Define the "cheaha" parallel configuration in your workstation MatLab environment to submit tasks to Cheaha
** Run the validation tests to ensure your "cheaha" parallel configuration works
* Develop and Run Parallel Computing Applications
** Write, test and debug your parallel code on your local workstation using the default "local" parallel configuration
** Once your code works, select the "cheaha" parallel configuration to submit tasks to the Cheaha cluster. Note: your workstation MatLab application does not need to keep running after the tasks are submitted.
** You will receive an email when the tasks you submitted are complete
** Use your workstation MatLab application to retrieve the results
** When you are finished with your job contexts, clean up the job related content to free disk space

== Using MATLAB DCS ==

The MATLAB Distributed Computing Services (DCS) are accessed via the Parallel Computing Toolbox (PCT) which is installed as part of your desktop [[MATLAB|MATLAB installation]]. The PCT allows MATLAB running on your workstation to send MATLAB code and data (tasks) to the cluster directly from the comfort of your familiar MATLAB environment on your desktop. This makes the expanded compute power of [[Cheaha]] available to processes work loads that exceed the capabilities of your desktop computer. Once your tasks are submitted to [[Cheaha]], your desktop MATLAB is also free to move on to other tasks or be closed completely, freeing your desktop or laptop for your other activities.

Configuring the Parallel Computing Toolbox involves three steps documented below:
# install MATLAB submit functions on your workstation
# configure the "cheaha" parallel computing target to which PCT tasks can be submitted
# run the validation tests to confirm a working installation.

This page documents the DCS configuration for MATLAB 2012a and later. For DCS configuration instructions on previous versions of MATLAB, please see the page [[MatLab DCS R2010a and Earlier]] or [[MatLab_DCS_R2010b_2011a_2011b | Matlab DCS R2010b -R2011b]]

Using MATLAB DCS requires you have a cluster account on [[Cheaha]]. Please request an account by sending an email to [[mailto:support@vo.uabgrid.uab.edu]] and include your campus affiliation and a brief statement of your research interests for using the cluster.

=== MATLAB DCS from Your Desktop ===

==== MATLAB Submit Functions ====

The MATLAB submit functions create a cluster job context for your code and are responsible for transferring your code and the data it analyzes to the cluster for processing.

These submit functions must be installed on your computer and must be accessible to MATLAB via the MATLAB PATH environment. The easiest way to accomplish this is to copy the submit functions to the default directory created for by MATLAB. These directories on the respective operating systems are listed below.

All operating systems (Windows, Linux and Mac) are supported by the same set of submit functions. The functions are written in MATLAB making them cross-platform and only dependent on the version of MATLAB in use.

# Download the MATLAB submit functions
#* [http://projects.uabgrid.uab.edu/matlab/browser/trunk/distributables/matlab-R2012a-nonshared.zip?format=raw Submit Functions for MATLAB R2012a] -(updated 03/07/2012)
# Unzip the files to a directory included in your MATLAB PATH setting. Recommended locations are:
#* Windows: <pre>My Documents\MATLAB</pre>
#* Linux: <pre>$HOME/Documents/MATLAB</pre>
#* Mac: <pre>$HOME/Documents/MATLAB</pre>

Once the submit function files have been downloaded and unzipped in the above paths, restart MATLAB to ensure they are properly loaded in your environment.

NOTE: If you choose not to use the above path recommendations, your MATLAB PATH may be viewed/altered by starting the MATLAB client on your workstation and clicking File -> Set Path and adding the path in which you unpacked the submit functions.

==== Parallel Computing Toolbox Configuration ====

The Parallel Computing Toolbox (PCT) enables language extensions in MATLAB that support dividing your application into tasks that can be executed in parallel. By default, all of these tasks will run on your local workstation using the pre-defined "local" PCT configuration.

To run these tasks on the Cheaha compute cluster, a new configuration for the PCT must be defined. In this section we will create the "cheaha" configuration and run a quick validation test to confirm its operation.

'''Prior to continuing''', make sure you:
* can establish an SSH connection to Cheaha
* have followed the steps in the previous section

# [http://projects.uabgrid.uab.edu/matlab/browser/trunk/parallel-configs/cheaha-R2012a.settings?format=raw R2012a] cluster configuration file
#* Start MATLAB R2012a on your workstation
#* Click the "Parallel" menu
#* Click "Manage Cluster Profiles"
#* In the "Cluster Profile Manager" window, click the "Import" button on the toolbar
#* Browse to the location where you saved the '''cheaha-R2012a.settings''' file, select it, and click "Open"

[[Image:Screen_shot_2012-03-08_at_11.13.59_AM.png]]

===== Personalize the "cheaha" PCT Configuration =====

#Double click on cheaha in the Configuration Manager window to open the configuration editor. (Note: stretch the "Generic Scheduler Configuration Properties" window to the right so that you can view all of the text in the fields making it easier to read and edit correctly.)
# Edit the following fields to use your personal data directories
#* '''ClusterMatlabRoot''': Make sure that the Root directory of MATLAB installation for workers matches the exact version of MATLAB you are using on your workstation. In this example '''/share/apps/mathworks/R2012a''' matches a MATLAB R2012a workstation install. Change the "R2012a" to match your workstation MATLAB version.
#* '''JobStorageLocation''' : Change the directory path where job data is stored to an existing directory on your workstation where MATLAB can stage job files.
#* '''IndependentSubmitFcn''': Change the text "YOURUSERID" to your login id on Cheaha
#* '''CommunicatingSubmitFcn''' : Change the text "YOURUSERID" to your login id on Cheaha
# Click 'OK'to save the configuration
# SSH to cheaha and make sure to create the $USER_SCRATCH/matlab directory. If this directory does not exist, the parallel computing toolbox jobs will fail.

The initial configuration will look similar to this screen shot. You will need to edit the fields as describe in the preceding steps before you can use the configuration. '''NOTE: be sure to replace the template user name settings "YOURUSERNAME" with the appropriate settings for your desktop and cluster account.'''

[[Image:MATLAB_R2012a_configuration.png | 800px]]

===== Validate the "cheaha" PCT Configuration =====

# Before starting validation please make sure the directory '/scratch/user/YOURUSERID/matlab' exists on the scratch space on the Cheaha. If it does not please SSH into Cheaha and create the directory before proceeding.
# Select Cheaha on the configuration manager page and click 'Start Validation'
# Wait for the validation to complete. This might take a few minutes and you ask for User credentials on Cheaha. All tests other than 'Matlabpool' validate on the Cheaha and the output is as shown.

[[Image:Screen_shot_2012-03-08_at_11.36.27_AM.png]]

===== Begin Using MATLAB DCS from your Desktop =====

The MATLAB DCS is now configured for Desktop usage. A simple parallel wave job "rParforWave" to test the configuration is described in [[MatLab_DCS_Examples]].

A summary of the above steps is available at [[MATLAB_workshop_2011]] with additional examples and submit scripts available in the [[MATLAB_workshop_2011#Workshop_Demo.27s | workshop demo ]] section.

{{MATLAB Support}}

[[Category:MATLAB]][[Category:MATLAB installation]]