#Mpi

2 posts in tag “Mpi”.

• 

  The Hidden Backbone of Parallelism: How Prefix Sums Power Distributed Computation

  2025-09-21

  Discover how the humble prefix sum (scan) quietly powers GPUs, distributed clusters, and big data frameworks—an obscure but essential building block of parallel and distributed computation.

• 

  MPI vs. OpenMP in 2025: Where Each Wins

  2025-07-04

  A practical guide to choosing between message passing and shared-memory parallelism for modern HPC and hybrid nodes.