Configuring Resource Managers

Topics include:

• Resource managers
• Steps for defining a resource manager
1. Creating a resource manager
2. Configuring a resource manager
1. Local resource manager
2. Remote resource manager
3. Resource manager-specific configuration (OpenMPI example)
4. Finishing resource manager configuration
5. Starting the resource manager
• Editing a Resource Manager
• Removing a Resource Manager

Resource Managers

PTP uses the term resource manager to refer to any subsystem that controls the resources required for launching a parallel job. If the target parallel system employs a job scheduler for controlling access to compute resources, then the job scheduler would be considered the resource manager for the system. For a cluster with Open MPI installed, the Open MPI runtime system would be considered the resource manager.

In order for PTP to launch, monitor, and control applications on a target system, it must know what type of resource manager is being employed. PTP allows you to configure and manage resource managers that correspond to target systems. Each resource manager controls one target system, although a particular target system may have more than one type of resource manager.

Resource managers can be local or remote. A local resource manager controls resources on the local machine running Eclipse. A remote resource manager controls resources on a physically remote system. The process of configuring a local or remote resource manager is the same.

Step 1: Creating a resource manager

1. Open the Parallel Runtime Perspective using Window > Open Perspective > Other... and then choose Parallel Runtime from the list of perspectives.

   
   

   

   
   

2. Right-click in Resource Managers view and select Add Resource Manager...

   
   

   

   
   

3. Choose the resource manager that corresponds to the target system. In this example we will use the Open MPI resource manager, which is used to control the Open MPI Open Runtime Environment.

   
   

   

   
   

4. Select Next >

Step 2a: Configuring a local resource manager

In this example, we will show how to configure PTP to use a local resource manager, for example, where Eclipse is installed on your desktop machine or the head node of a cluster.

The Open MPI connection configuration dialog is used to configure how Eclipse will communicate with the Open MPI environment.

1. To configure the simple case of a local resource manager, select Local as the Remote service provider.

   
   

   

   
   

2. For the local case, the Connection name will be automatically set to Local.

   
   

3. The Tunneling Options allow communication to be tunneled over a single connection if necessary. For the local case, it is not required, and only None can be selected.

   
   

4. The Local address for proxy connection should be set to the local address of your local machine (localhost, or its host name or IP address).

   
   

5. Select Next >

Step 2b: Configuring a remote resource manager

This example will demonstrate configuring a remote resource manager, where Eclipse and PTP are on your local laptop or workstation, and PTP controls a remote target system.

A remote resource manager allows PTP to control a remote target machine. To accomplish this, PTP uses the services of a remote service provider. Currently supported remote service providers include the Remote Tools package (a part of PTP) and the Eclipse Remote Systems Explorer (RSE) which is an optional package that can be installed at any time. The preferred remote service provider is Remote Tools which supports all PTP and Remote Development Tools (RDT) functionality.

See also Local vs. Remote Projects for more information on the differences.

RSE may be used if your remote system does not use the ssh protocol for remote connections, or you wish to use the additional functionality that RSE provides. See the RSE documentation for more information. We will only consider Remote Tools here, but the steps for configuring RSE are similar.

1. In the Open MPI connection configuration dialog, select Remote Tools as the Remote service provider.

   
   

   

   
   

2. At this point, you either need to use an existing connection or configure new a Connection name.

   
   

3. If you are using an existing Connection, select it here (it may be selected already).

   
   

4. Configuring a new Connection name will differ depending on the remote service provider that you selected in the previous step. The following steps describe configuring a Remote Tools location. To create a new Connection,

1. Select New...

   
   

2. In the Remote Host dialog, enter a name for the connection in the Target Name field (can be anything, but it is suggested to not use a name with spaces).

   
   

   rr

   
   

3. Select the Remote Host radio button.

   
   

4. Enter the address of the remote host in the Host field.

   
   

5. Enter your user name on the remote machine in the User field.

   
   

6. If you use password authentication, select the Password based authentication radio button and enter the password in the Password field.

   
   

7. If you use key based authentication, select the Public key based authentication radio button, select the file containing your public key, and enter the passphrase for your key (or leave blank if you don't use a passphrase).

   
   

8. Click Finish

   
   

5. Back in the Open MPI connection configuration dialog, Tunneling Options allow communication to be tunneled over a single connection if supported by the remote service provider. To enable tunneling, select the SSH port forwarding radio button.

   
   

6. If you don't wish to use port forwarding, select the None radio button and enter the address of your local machine (its host name, or IP address) in the Local address field. You may need to reconfigure or disable the firewall on your local machine if this option is selection. Note that if your site does not allow outbound connections from the remote machine to your local machine, then you must use port forwarding.

   
   

7. Select Next >

Step 3: Resource manager-specific configuration

The contents of the resource manager-specific configuration page will depend on the type of resource manager that was initially selected. In this section we will show how to configure an Open MPI resource manager. Please refer to the IBM PE, IBM LoadLeveler, PBS, or SLURM resource manager documentation for information on these systems.

r

1. If you wish to specify the commands for the Open MPI environment, or add extra arguments, select a specific Open MPI version and uncheck the Use default settings checkbox.

   
   

1. Launch command: A command line executed to launch the parallel application with Open MPI.

   
   

2. Debug command: A command line executed to use Open MPI to launch a debug session for the parallel application.

   
   

3. Discover command: A command line executed when the Resource Manager is started, to collect information about the Open MPI environment..

   
   

4. Path to installation: If not empty, then all commands are prefixed with this path.

   
   

Only a single command is allowed on each command field. Several place holders (macros) are allowed, the most relevant are:

• Open_MPI_args: Command line arguments to be passed to the mpirun command, specifying options selected in the launch configuration dialog.
• Open_MPI_env: Command line arguments to be passed to the mpirun command, specifying name of environment variables.
• execPath and execName: Path and name of the executable of the parallel application to be launched by mpirun.
• progArgs: arguments to be passed to the parallel application.

2. If you have installed Open MPI in a non-standard location, or it is not in your path, uncheck the Use default location checkbox, then enter the path to the installation bin directory. So, for example if your installation is in /usr/local/openmpi-1.3.4, you would enter /usr/local/openmpi-1.3.4/bin for the location.

3. Select Next >

Step 4: Naming the resource manager configuration

The next dialog is Common Resource Manager Configuration which provides an opportunity to change how the resource manager is displayed.

1. If you wish to change the name or description, uncheck the Use default name and description checkbox.

   
   

1. Enter a new name in the Name field. Anything can be entered.

   
   

2. Enter a new description in the Description field. Anything can be entered.

   
   

2. If you want the resource manager to start automatially when you start a new Eclipse session, check the Automatically start resource manager when Eclipse starts checkbox.

   
   

Step 6: Starting the resource manager

1. To start the resource manager, right mouse click on the resource manager in the Resource Managers view, then select Start Resource Manager from the context menu.

   
   

   

   
   

2. The resource manager icon should change color to green to indicate has been successfully started.

   
   

   

   
   

3. In the Machines view you should see an icon representing your target system and icons showing status of the node(s).

   
   

   

   
   

4. If the resource manager fails to start (the icon is red), right click on the resource manager and select Stop Resource Manager. Check the log files for the reason that the resource manager failed to start, correct the error and restart again.

Editing a resource manager

It is sometimes necessary to change the configuration of an existing resource manager, for example, to change the remote machine that the resource manager controls. Note that the resource manager cannot be edited when it is running.

1. If the resource manager is running, stop it first. Right-click on the resource manager and select Stop Resource Manager

   
   

2. Right-click on the resource manager and select Edit Resource Manager

   
   

   

   
   

3. Modify the required configuration settings and click Finish.

   
   

4. Restart the resource manager.

Removing a Resource Manager

If the resource manager is no longer required, it can be removed from the Resource Managers view

1. If the resource manager is running, stop it first. Right-click on the resource manager and select Stop Resource Manager

   
   

2. Right-click on the resource manager and select Remove Resource Manager

   
   

   

   
   

3. You will be prompted to confirm removal. Click OK

Proceed to Launching a parallel application.

Back to Top | Back to Table of Contents