Skip to content
Snippets Groups Projects
Commit e2d6ae3f authored by Mactavish Zhan's avatar Mactavish Zhan
Browse files

add basic recap contents

parent 6df30f2b
Branches
No related tags found
No related merge requests found
slides/images/SPMD.png

121 KiB

slides/images/cluster.png

95.1 KiB

slides/images/distributed-memory.png

76.7 KiB

slides/images/false-sharing.png

118 KiB

slides/images/fork-join-model.png

54.8 KiB

slides/images/shared-memory.png

59.8 KiB

......@@ -13,3 +13,7 @@ Any questions about:
<br/>
### Materials
- [The difference between modes of MPI send](https://iamsorush.com/posts/mpi-send-types/)
- [Message Passing with MPI - PPCES 2017](https://blog.rwth-aachen.de/itc-events/en/event/ppces-2017/)
---
title: Recap I
layout: center
---
# Recap & Discussion
# Recap
### Parallel Programming
### Parallel Architecture - Shared Memory
- Concurrency vs Parallelism
- Concurrent programming vs parallel programming
- Programming with shared memory vs message passing
- Shared Memory Computer: UMA vs NUMA
<div class="container flex justify-center mt-5">
<img src="/images/shared-memory.png" class="block w-lg"/>
</div>
#### Pros and Cons
- **Pros**: shared/direct memory access, fast, single OS instance
- **Cons**: cache coherence expensive, data races, complex hardware (NUMA)
---
title: Recap II
---
### Parallel Architecture - Distributed Memory
<div class="container flex justify-center mt-5">
<img src="/images/distributed-memory.png" class="block w-lg"/>
</div>
#### Pros and Cons
- **Pros**: separated main memories, better scalability, no data races
- **Cons**: communication overhead, more system complexity
---
title: Recap III
---
### Parallel Architecture - Cluster
<div class="container flex justify-center mt-5 mb-5">
<img src="/images/cluster.png" class="block w-lg"/>
</div>
- HPC market is at large dominated by distributed memory multicomputers: clusters and specialised supercomputers.
- _Usually_ separated machines, copies of the same OS (environment), connected via LAN.
---
title: Recap IV
---
### SPMD Model
Single Program Multiple Data:
<div class="container flex justify-center mt-5">
<img src="/images/SPMD.png" class="block w-lg"/>
</div>
- Abstractions make programming and understanding easier
- Multiple instruction flows (instances) from a Single Program working on Multiple (different parts of) Data
- Instances could be threads (OpenMP) and/or processes (MPI)
0% Loading or .
You are about to add 0 people to the discussion. Proceed with caution.
Please register or to comment