Hinweise zum Einsatz der Google Suche

"Parallel Processing (Parallelverarbeitung)" (Lecture + Lab)    Winter 2023/24


You find some information on the MPI parallelization of the Jacobi Method in Sect. 5 of the slides.

For questions and help on the lab assignments, please use the Discord server set up for this course.

The next exam will presumably take place on July 29th, 2024 at 09:00 (s.t.) in room PB-C 101.

Exam duration will be 60 minutes. It will be an open book exam, i.e., you are allowed to use printed materials like lecture slides, scripts, books, own notes, etc., but no electronic devices or communication means. You also will get a PDF Dodument with the most important OpenMP pragmas and MPI routines.
The exam will be conducted electronically using the Q-Exam system. The computers (laptops) will be provided by the university. To get acquainted with the system, please have a look at the demo exams (select the exam named "Demo-Prüfung Parallelverarbeitung") and the screen casts provided in the moodle course! If you have questions or problems, please contact the e-assessment support team (e-klausuren@uni-siegen.de). You can also ask questions immediately before the exam starts.

Please notice that the laptops provide a German keyboard. The '#' is located left of the 'Enter' key, '{', '}', '[', and ']' can be entered by pressing the 'AltGr' key (right of the 'Space' key) together with '7', '8', '9', or '0'. The 'Ctrl' key is named 'Strg'. Please acquaint yoursef with that layout! See here for an accurate image or here for an interactive simulation (which actually differes slightly from the laptop keyboards).

The practical programming exercises should be done using a Linux operating system. However, most exercises can also be done in a Windows environment. You can find some technical information about this here.

If you want to install the Scalasca performance analysis tool on your Linux computer, you can use this script which contains all the necessary commands. Please be sure to also look at the documentation.

You can find old slides in German (from WiSe 15/16!) here: original size, 2-on-1.

IMPORTANT: In order to pass this module, you MUST register for the practical exercises in unisono until 05.01.2024 (for Exam Regulations 2012: "822120-SL - Parallelverarbeitung", see this screen dump; for Exam Regulations 2021: "4INFMA024-S - Studienleistung Parallelverarbeitung", see this screen dump). You must do this in this semester even if you want to take the exam in a later semester!

Start of the lecture: 16.10.2023; Start of the Lab: 10.10.2023 (with lecture!)

Course Materials


Solutions for compulsory exercises must be submitted via the moodle course.

No. Date of issue Deadline Presentation/ DiscussionExercise sheet/codePartial Solution

1 30.10.
21.11., 10:00
Tuesday, 21.11., 10:15, Room H-C 6321Exercise sheet, Code

2 13.11.
12.12., 10:00 Tuesday, 12.12., 10:15, Room H-C 6321Exercise sheet, Code

3 04.12.
16.01., 10:00 Tuesday, 16.01., 10:15, Room H-C 6321Exercise sheet, Code

4 18.12.
30.01., 10:00 Tuesday, 30.01., 10:15, Room H-C 6321Exercise sheet, Code

General Literature

  • A. Grama, A. Gupta, G. Karypis, V. Kumar: Introduction to Parallel Computing, 2. ed., Pearson Education, 2003.
  • Barry Wilkinson, Michael Allen: Parallel Programming, internat. ed., 2. ed., Pearson Education international, 2005.
  • R. Trobec, B. Slivnik, P. Bulic, B. Robic: Introduction to Parallel Computing. Springer, 2018.
  • Thomas Rauber, Gudula Rünger: Parallele und verteilte Programmierung. Springer, 2000.
  • Theo Ungerer: Parallelrechner und parallele Programmierung, Spektrum, Akad. Verl., 1997.
  • Ian Foster: Designing and Building Parallel Programs, Addison-Wesley, 1995.
  • Seyed Roosta: Parallel Processing and Parallel Algorithms, Springer, 2000.
  • Rainer Oechsle: Parallele Programmierung mit Java Threads, Fachbuchverlag Leipzig, 2001.
  • S. Hoffmann, R.Lienhart: OpenMP, Springer, 2008.
  • W. Gropp, E. Lusk, A. Skjellum: Using MPI, MIT Press, 1994.
  • Michael Wolfe: Optimizing Supercompilers for Supercomputers, MIT Press, 1989.

Sample codes (see also 'Course Materials' above!)