Algorithms

• The Theory Of Generalization Error In Support Vector Machines: Vc Dimension And Maximal Margin Classifiers · 2021-05-17

  A comprehensive technical exploration of the theory of generalization error in support vector machines: vc dimension and maximal margin classifiers, covering key concepts, practical implementations, and real-world applications.

• Building A Distributed Machine Learning System: Parameter Server Architecture With Asynchronous Stochastic Gradient Descent · 2021-05-05

  A comprehensive technical exploration of building a distributed machine learning system: parameter server architecture with asynchronous stochastic gradient descent, covering key concepts, practical implementations, and real-world applications.

• The Performance Of Attention Mechanisms In Transformers: Self Attention Vs. Multi Headed With Flashattention Optimization · 2021-05-01

  A comprehensive technical exploration of the performance of attention mechanisms in transformers: self attention vs. multi headed with flashattention optimization, covering key concepts, practical implementations, and real-world applications.

• A Comprehensive Guide To Quantization Aware Training: Simulated Quantization, Straight Through Estimator, And Calibration · 2021-04-30

  A comprehensive technical exploration of a comprehensive guide to quantization aware training: simulated quantization, straight through estimator, and calibration, covering key concepts, practical implementations, and real-world applications.

• Implementing A Neural Network Training Framework With Automatic Differentiation Using Wengert Lists · 2021-04-29

  A comprehensive technical exploration of implementing a neural network training framework with automatic differentiation using wengert lists, covering key concepts, practical implementations, and real-world applications.

• The Mathematics Of Gaussian Processes For Bayesian Optimization: Kernel Selection And Cholesky Factorization · 2021-03-26

  A comprehensive technical exploration of the mathematics of gaussian processes for bayesian optimization: kernel selection and cholesky factorization, covering key concepts, practical implementations, and real-world applications.

• Designing An Online Learning Algorithm For Adversarial Bandits: Exp3, Follow The Regularized Leader · 2021-03-02

  A comprehensive technical exploration of designing an online learning algorithm for adversarial bandits: exp3, follow the regularized leader, covering key concepts, practical implementations, and real-world applications.

• The Complexity Of The Edit Distance Problem: Needleman Wunsch, Smith Waterman, And Affine Gap Penalties · 2021-02-18

  A comprehensive technical exploration of the complexity of the edit distance problem: needleman wunsch, smith waterman, and affine gap penalties, covering key concepts, practical implementations, and real-world applications.

• A Deep Dive Into The Palindromic Tree (Eertree): Construction And Applications In Stringology · 2021-02-17

  A comprehensive technical exploration of a deep dive into the palindromic tree (eertree): construction and applications in stringology, covering key concepts, practical implementations, and real-world applications.

• Implementing A Fast Maximum Matching In General Graphs Using Blossom Algorithm (Edmonds) · 2021-02-15

  A comprehensive technical exploration of implementing a fast maximum matching in general graphs using blossom algorithm (edmonds), covering key concepts, practical implementations, and real-world applications.

• The Algorithmics Of Network Flow: Dinic’S Algorithm With Scaling Vs. Push Relabel With Gap Heuristics · 2021-02-14

  A comprehensive technical exploration of the algorithmics of network flow: dinic’s algorithm with scaling vs. push relabel with gap heuristics, covering key concepts, practical implementations, and real-world applications.

• Building A Game Theoretic Approach To Distributed Consensus: Rational Players, Payments, And Mechanism Design · 2021-02-12

  A comprehensive technical exploration of building a game theoretic approach to distributed consensus: rational players, payments, and mechanism design, covering key concepts, practical implementations, and real-world applications.

• The Performance Of Integer Linear Programming Solvers: Branch And Bound Vs. Cutting Planes For Real World Problems · 2021-02-08

  A comprehensive technical exploration of the performance of integer linear programming solvers: branch and bound vs. cutting planes for real world problems, covering key concepts, practical implementations, and real-world applications.

• Implementing A Linear Programming Solver Using The Simplex Algorithm: Degeneracy, Bland’S Rule, And Scaling · 2021-02-03

  A comprehensive technical exploration of implementing a linear programming solver using the simplex algorithm: degeneracy, bland’s rule, and scaling, covering key concepts, practical implementations, and real-world applications.

• A Rigorous Analysis Of The Fast Fourier Transform: Cooley Tukey Algorithm With Radix 2 Decimation In Time · 2021-01-14

  A comprehensive technical exploration of a rigorous analysis of the fast fourier transform: cooley tukey algorithm with radix 2 decimation in time, covering key concepts, practical implementations, and real-world applications.

• Designing A Randomized Algorithm For The Min Cut Problem: Karger’S Algorithm And Contractions · 2021-01-10

  A comprehensive technical exploration of designing a randomized algorithm for the min cut problem: karger’s algorithm and contractions, covering key concepts, practical implementations, and real-world applications.

• The Complexity Of Scheduling Dags With Minimum Makespan And Dependencies: List Scheduling Vs. Critical Path · 2020-12-28

  A comprehensive technical exploration of the complexity of scheduling dags with minimum makespan and dependencies: list scheduling vs. critical path, covering key concepts, practical implementations, and real-world applications.

• Implementing A Virtual Machine For A Stack Based Language: Bytecode Interpreter And Jit Compilation · 2020-12-23

  A comprehensive technical exploration of implementing a virtual machine for a stack based language: bytecode interpreter and jit compilation, covering key concepts, practical implementations, and real-world applications.

• The Design Of A Modern Hypervisor: Virtual Memory Translation, Cpu Virtualization, And I/O Passthrough · 2020-12-03

  A comprehensive technical exploration of the design of a modern hypervisor: virtual memory translation, cpu virtualization, and i/o passthrough, covering key concepts, practical implementations, and real-world applications.

• Building A Lightweight Container Runtime From Scratch: Namespaces, Cgroups, And Copy On Write Filesystems · 2020-11-29

  A comprehensive technical exploration of building a lightweight container runtime from scratch: namespaces, cgroups, and copy on write filesystems, covering key concepts, practical implementations, and real-world applications.

• A Performance Comparison Of Epoll, Io_Uring, And Kqueue For Asynchronous I/O In Linux · 2020-11-23

  A comprehensive technical exploration of a performance comparison of epoll, io_uring, and kqueue for asynchronous i/o in linux, covering key concepts, practical implementations, and real-world applications.

• The Implementation Of A User Level Threading Library For Cooperative Multitasking In C · 2020-11-18

  A comprehensive technical exploration of the implementation of a user level threading library for cooperative multitasking in c, covering key concepts, practical implementations, and real-world applications.

• Designing A Non Volatile Memory (Nvm) File System: Dax, Pmdk, And Fault Tolerance For Persistent Heaps · 2020-11-07

  A comprehensive technical exploration of designing a non volatile memory (nvm) file system: dax, pmdk, and fault tolerance for persistent heaps, covering key concepts, practical implementations, and real-world applications.

• The Cache Coherence Protocol Of Modern Cpus: Mesi, Moesi, And Mesif With Snooping Vs. Directory Based · 2020-11-02

  A comprehensive technical exploration of the cache coherence protocol of modern cpus: mesi, moesi, and mesif with snooping vs. directory based, covering key concepts, practical implementations, and real-world applications.