Advanced Topics in High Performance Scientific Computing [MA5327]

This site is currently under construction and is continuously amended.

Contact
Lecture: Dr. Manfred Liebmann, Room: 03.06.036, E-Mail: liebmannematma.tum.de
Schedule
Lecture: Monday, 14:15-15:45, Room 02.10.011
Tuesday, 10:15-11:45, Room 02.10.011
Exercises: Wednesday, 14:15-15:45, Room 02.10.011
Topics
The description of the module (5327) can be found here.
The lecture introduces in the first part the basics of the development of efficient parallel algorithms and programs for modern hardware architectures and high performance computers. In the second part advanced parallelization topics are discussed using case studies for a variety of problems of numerical analysis. The exercises investigate practical and theoretical aspects of the implementation of parallel algorithms and programs in C/C++ for different hardware architectures.
  • Modern hardware architectures and networks: CPUs, GPUs, and accelerators
  • Standard libraries and extensions for parallel programs: MPI, OpenMP, OpenACC, CUDA, intrinsics
  • Design patterns for parallel programs: memory access, vectorization, threads, templates, and automatic code generation
  • High performance computers: scripting languages, batch systems
  • Case studies: determinants, eigenvalue problems, iterative solvers, partial differential equations, fluid dynamics, quantum mechanics, semiclassical approximations, optimal control
Recommended preconditions
  • Numerical analysis
  • C/C++ programming languages
Literature
  • B. Stroustrup: The C++ Programming Language, AW 2013
  • J. Pitt-Francis: Guide to Scientific Computing in C++, Springer 2012
  • P. Pacheco: An Introduction to Parallel Programming, MK 2011
  • W. Gropp: Using MPI: Portable Parallel Programming with the Message-Passing Interface, MIT 2014
  • D. B. Kirk, W. W. Hwu: Programming Massively Parallel Processors, MK 2010
  • J. Reinders, J. Jeffers: High Performance Parallism Pearls, Multicore and Many-core Programming Approaches, MK 2015
Lecture notes and exercise sheets
Lecture notes and exercise sheets are available on the Moodle platform.
Topic attachments
I Attachment Action Size Date Who Comment
ACC1.pdfpdf ACC1.pdf manage 583.6 K 24 Dec 2015 - 01:30 ManfredLiebmann OpenACC 1
ATHPSC-2015-Sheet1.pdfpdf ATHPSC-2015-Sheet1.pdf manage 96.5 K 19 Oct 2015 - 17:04 ManfredLiebmann Exercise sheet 1
ATHPSC-2015-Sheet10.pdfpdf ATHPSC-2015-Sheet10.pdf manage 105.8 K 18 Dec 2015 - 21:29 ManfredLiebmann Exercise sheet 10
ATHPSC-2015-Sheet11.pdfpdf ATHPSC-2015-Sheet11.pdf manage 105.6 K 07 Jan 2016 - 23:55 ManfredLiebmann Exercise sheet 11
ATHPSC-2015-Sheet12.pdfpdf ATHPSC-2015-Sheet12.pdf manage 106.2 K 15 Jan 2016 - 01:44 ManfredLiebmann Exercise sheet 12
ATHPSC-2015-Sheet2.pdfpdf ATHPSC-2015-Sheet2.pdf manage 90.5 K 21 Oct 2015 - 18:11 ManfredLiebmann Exercise sheet 2
ATHPSC-2015-Sheet3.pdfpdf ATHPSC-2015-Sheet3.pdf manage 104.6 K 28 Oct 2015 - 21:18 ManfredLiebmann Exercise sheet 3
ATHPSC-2015-Sheet4.pdfpdf ATHPSC-2015-Sheet4.pdf manage 111.1 K 05 Nov 2015 - 01:27 ManfredLiebmann Exercise sheet 4
ATHPSC-2015-Sheet5.pdfpdf ATHPSC-2015-Sheet5.pdf manage 254.1 K 13 Nov 2015 - 02:56 ManfredLiebmann Exercise sheet 5
ATHPSC-2015-Sheet6.pdfpdf ATHPSC-2015-Sheet6.pdf manage 109.9 K 18 Nov 2015 - 20:34 ManfredLiebmann Exercise sheet 6
ATHPSC-2015-Sheet7.pdfpdf ATHPSC-2015-Sheet7.pdf manage 122.4 K 27 Nov 2015 - 02:31 ManfredLiebmann Exercise sheet 7
ATHPSC-2015-Sheet8.pdfpdf ATHPSC-2015-Sheet8.pdf manage 278.1 K 04 Dec 2015 - 02:07 ManfredLiebmann Exercise sheet 8
ATHPSC-2015-Sheet9.pdfpdf ATHPSC-2015-Sheet9.pdf manage 108.6 K 11 Dec 2015 - 16:22 ManfredLiebmann Exercise sheet 9
ATHPSC1.pdfpdf ATHPSC1.pdf manage 139.0 K 19 Oct 2015 - 16:59 ManfredLiebmann Lecture 1
ATHPSC2.pdfpdf ATHPSC2.pdf manage 133.0 K 03 Nov 2015 - 13:44 ManfredLiebmann Lecture 2
ATHPSC3.pdfpdf ATHPSC3.pdf manage 187.0 K 09 Nov 2015 - 23:33 ManfredLiebmann Lecture 3
ATHPSC4.pdfpdf ATHPSC4.pdf manage 204.4 K 10 Nov 2015 - 12:15 ManfredLiebmann Lecture 4
ATHPSC5.pdfpdf ATHPSC5.pdf manage 20012.6 K 16 Nov 2015 - 21:59 ManfredLiebmann Lecture 5
CASE1.pdfpdf CASE1.pdf manage 482.4 K 19 Oct 2015 - 17:02 ManfredLiebmann Case study 1
CASE2.pdfpdf CASE2.pdf manage 7324.6 K 19 Oct 2015 - 17:02 ManfredLiebmann Case study 2
CASE3.pdfpdf CASE3.pdf manage 475.7 K 19 Oct 2015 - 17:06 ManfredLiebmann Case study 3
CASE4.pdfpdf CASE4.pdf manage 508.3 K 20 Oct 2015 - 12:05 ManfredLiebmann Case study 4
CASE5.pdfpdf CASE5.pdf manage 2818.5 K 26 Oct 2015 - 20:00 ManfredLiebmann Case study 5
CASE6.pdfpdf CASE6.pdf manage 20014.6 K 27 Oct 2015 - 14:01 ManfredLiebmann Case study 6
CASE7.pdfpdf CASE7.pdf manage 529.0 K 03 Nov 2015 - 13:43 ManfredLiebmann Case study 7
CLUSTER.pdfpdf CLUSTER.pdf manage 1173.1 K 19 Oct 2015 - 17:03 ManfredLiebmann Exercise 1
CUDA-CODE1.zipzip CUDA-CODE1.zip manage 4.6 K 15 Dec 2015 - 15:31 ManfredLiebmann CUDA Code 1
CUDA-CODE2.zipzip CUDA-CODE2.zip manage 28068.7 K 24 Dec 2015 - 01:33 ManfredLiebmann CUDA Code 2
CUDA1.pdfpdf CUDA1.pdf manage 713.8 K 15 Dec 2015 - 15:30 ManfredLiebmann CUDA 1
CUDA2.pdfpdf CUDA2.pdf manage 802.9 K 15 Dec 2015 - 15:30 ManfredLiebmann CUDA 2
CUDA3.pdfpdf CUDA3.pdf manage 259.2 K 24 Dec 2015 - 01:29 ManfredLiebmann CUDA 3
INT-CODE1.zipzip INT-CODE1.zip manage 5.5 K 12 Jan 2016 - 12:22 ManfredLiebmann Intrinsics Code 1
INT1.pdfpdf INT1.pdf manage 3129.3 K 12 Jan 2016 - 12:22 ManfredLiebmann Intrinsics 1
MPI-CODE1.zipzip MPI-CODE1.zip manage 3.7 K 18 Nov 2015 - 20:54 ManfredLiebmann MPI Code 1
MPI-CODE2.zipzip MPI-CODE2.zip manage 6.0 K 27 Nov 2015 - 02:29 ManfredLiebmann MPI Code 2
MPI-CODE3.zipzip MPI-CODE3.zip manage 4.9 K 01 Dec 2015 - 12:28 ManfredLiebmann MPI Code 3
MPI-CODE4.zipzip MPI-CODE4.zip manage 160.4 K 01 Dec 2015 - 12:29 ManfredLiebmann MPI Code 4
MPI1.pdfpdf MPI1.pdf manage 215.4 K 18 Nov 2015 - 20:40 ManfredLiebmann MPI 1
MPI2.pdfpdf MPI2.pdf manage 212.0 K 23 Nov 2015 - 18:50 ManfredLiebmann MPI 2
MPI3.pdfpdf MPI3.pdf manage 177.7 K 27 Nov 2015 - 02:30 ManfredLiebmann MPI 3
MPI4.pdfpdf MPI4.pdf manage 165.6 K 01 Dec 2015 - 12:29 ManfredLiebmann MPI 4
MPI5.pdfpdf MPI5.pdf manage 777.9 K 01 Dec 2015 - 12:30 ManfredLiebmann MPI 5
OMP1.pdfpdf OMP1.pdf manage 132.3 K 07 Dec 2015 - 19:23 ManfredLiebmann OpenMP 1
OMP2.pdfpdf OMP2.pdf manage 150.5 K 08 Dec 2015 - 12:17 ManfredLiebmann OpenMP 2
OPENACC-CODE1.zipzip OPENACC-CODE1.zip manage 4.5 K 24 Dec 2015 - 01:34 ManfredLiebmann OpenACC Code 1
OPENMP-CODE1.zipzip OPENMP-CODE1.zip manage 9.1 K 08 Dec 2015 - 12:18 ManfredLiebmann OpenMP Code 1
PHI-CODE1.zipzip PHI-CODE1.zip manage 3.0 K 12 Jan 2016 - 12:21 ManfredLiebmann PHI Code 1
PHI1.pdfpdf PHI1.pdf manage 2250.2 K 11 Jan 2016 - 16:45 ManfredLiebmann PHI 1
STUDY1.pdfpdf STUDY1.pdf manage 663.9 K 01 Feb 2016 - 17:54 ManfredLiebmann Case Study 1
STUDY2.pdfpdf STUDY2.pdf manage 439.7 K 01 Feb 2016 - 17:55 ManfredLiebmann Case Study 2
STUDY3.pdfpdf STUDY3.pdf manage 476.9 K 01 Feb 2016 - 17:58 ManfredLiebmann Case Study 3
STUDY4.pdfpdf STUDY4.pdf manage 494.1 K 01 Feb 2016 - 17:56 ManfredLiebmann Case Study 4
STUDY5.pdfpdf STUDY5.pdf manage 1662.6 K 01 Feb 2016 - 17:56 ManfredLiebmann Case Study 5
STUDY6.pdfpdf STUDY6.pdf manage 8541.7 K 01 Feb 2016 - 17:57 ManfredLiebmann Case Study 6
STUDY7.pdfpdf STUDY7.pdf manage 241.4 K 02 Feb 2016 - 13:16 ManfredLiebmann Case Study 7
 
TUM Mathematik Rutschen TUM Logo TUM Schriftzug Mathematik Logo Mathematik Schriftzug Rutsche

picture math department

Impressum  |  Datenschutzerklärung  |  AnregungenCopyright Technische Universität München