— User's Guide

Release 5.0.7-4

August 2011

Reproduction in any manner whatsoever without the written permission of ParTec Cluster Competence Center GmbH is strictly forbidden.

All rights reserved. ParTec and ParaStation are registered trademarks of ParTec Cluster Competence Center GmbH. The ParTec logo, the ParaStation logo and the ParaStation MPI logo are trademarks of ParTec Cluster Competence Center GmbH. Linux is a registered trademark of Linus Torvalds. All other marks and names mentioned herein may be trademarks or registered trademarks of their respective owners.

The ParaStation MPI Administrator's Guide and ParaStation MPI User's Guide provide detailed information about ParaStation MPI. Installation and configuration of ParaStation MPI including process management and communication libraries are described in-depth by the ParaStation MPI Administrator's Guide. Usage of MPI and related tools are described by the ParaStation MPI User's Guide.

Though it may seem hard to believe, this manual might contain errors. We welcome any reports on errors or problems that are found. We also would appreciate suggestions on improving this book. Please direct all comments and problems to .

The most up-to-date version of this document is available at http://docs.par-tec.com.


Share your knowledge with others. It's a way to achieve immortality.

 --Dalai Lama

Table of Contents

1. Preface
About this document
This book's audience
ParaStation MPI overview
The history of ParaStation MPI
2. Overview
The communication subsystem
Communication paths
Communication interfaces
The cluster management facility
Node management
Fault tolerance
Process management
Job control & error management
Integration into existing environments
3. Starting up programs
Spawning processes
Placing processes onto nodes
Redirecting standard input and output
Spawning the environment
Starting up serial tasks
Starting up administrative tasks
Using the ParaStation MPI queuing facility
Suspending ParaStation MPI tasks
4. Using MPI
Building MPI applications
Starting MPI applications
Selecting Compiler Alternatives for MPI Programs
Compiler & Linker Wrapper scripts
5. Building native ParaStation MPI applications
Using the management facility
The root process
The master process
Client processes
Using the PSPort interface
6. ParaStation MPI variables & application performance
Scope and audience
ParaStation MPI run-time tuning parameters
General scaling tuning variables
InfiniBand specific tuning variables
MPI tuning for connected service types - addressing scalability problems with InfiniBand
I. Reference Pages
mpiexec — run a ParaStation MPI program
mpirun_chp4 — run a MPIch/P4 MPI program on a ParaStation MPI cluster
mpirun_chgm — run a MPIch/GM MPI program on a ParaStation MPI cluster
mpirun_elan — run a QsNet MPI program on a ParaStation MPI cluster.
mpirun-ipath-ps — run a InfiniPath™ MPI program on a ParaStation MPI cluster.
mpirun_openib — run a MVAPIch MPI program on a ParaStation MPI cluster.
psh — run a command on or copy a file to multiple nodes.
psmstart — start a program on a remote node
pssh — run a command on a remote node.
pscp — copy a file to multiple nodes in parallel.
process_placement — Process placement strategies within ParaStation MPI
ps_environmentParaStation environment variables

List of Figures

2.1. The ParaStation MPI network setup.