#Optimization
4 posts in tag “Optimization”.
Information Geometry: Statistical Manifolds, the Fisher Information Metric, and Natural Gradient Descent
2022-07-12A rigorous journey through information geometry—the Riemannian geometry of statistical models, the Fisher metric as the unique invariant metric, natural gradient, and the dually flat structure of exponential families.
Branch Prediction and Speculative Execution: How Modern CPUs Gamble on the Future
2021-08-15Explore how modern processors predict branch outcomes and execute instructions speculatively, the algorithms behind branch predictors, the performance implications for your code, and the security vulnerabilities like Spectre that emerged from these optimizations.
Compiler Optimizations: From Source Code to Fast Machine Code
2020-09-23A deep dive into how modern compilers transform your code into efficient machine code. Explore optimization passes from constant folding to loop vectorization, and learn how to write code that compilers can optimize effectively.
Linear Programming: Simplex Geometry, Duality, and the Interior-Point Revolution
2019-04-19An exploration of linear programming from Dantzig's simplex method through von Neumann's duality to Karmarkar's interior-point breakthrough that reshaped optimization theory.