Memory

• Tuning CUDA with the GPU Memory Hierarchy · 2024-11-27

  Global, shared, and register memory each have distinct latency and bandwidth. Performance comes from the right access pattern.

• Cache‑Friendly Data Layouts: AoS vs. SoA (and the Hybrid In‑Between) · 2021-03-18

  How memory layout choices shape the performance of your hot loops. A practical guide to arrays‑of‑structs, struct‑of‑arrays, and hybrid layouts across CPUs and GPUs.

• Speculative Prefetchers: Designing Memory Systems That Read the Future · 2019-02-14

  A field guide to building and validating speculative memory prefetchers that anticipate demand in modern CPUs and data platforms.