Theory

• Category Theory for Programmers: Functors, Monads, and Natural Transformations · 2021-08-10

  A rigorous yet intuitive journey through the categorical structures that secretly power functional programming—from categories and functors to adjunctions and the monad-as-monoid correspondence.

• Building A Count Min Sketch With Conservative Update For Heavy Hitters In Network Traffic · 2021-08-07

  A comprehensive technical exploration of building a count min sketch with conservative update for heavy hitters in network traffic, covering key concepts, practical implementations, and real-world applications.

• The Algorithm Of The T Digest: Order Statistics, Merging, And Quantile Approximations For Streaming Data · 2021-08-04

  A comprehensive technical exploration of the algorithm of the t digest: order statistics, merging, and quantile approximations for streaming data, covering key concepts, practical implementations, and real-world applications.

• Designing A Time Series Database With Downsampling And Continuous Aggregates: Timescaledb Internals · 2021-07-23

  A comprehensive technical exploration of designing a time series database with downsampling and continuous aggregates: timescaledb internals, covering key concepts, practical implementations, and real-world applications.

• A Formal Analysis Of Multi Version Concurrency Control (Mvcc) In Postgresql: Snapshots, Garbage Collection, And Serializable Isolation · 2021-07-17

  A comprehensive technical exploration of a formal analysis of multi version concurrency control (mvcc) in postgresql: snapshots, garbage collection, and serializable isolation, covering key concepts, practical implementations, and real-world applications.

• Implementing A B+ Tree With Bulk Loading And Prefix Compression For Write Optimized Databases · 2021-07-16

  A comprehensive technical exploration of implementing a b+ tree with bulk loading and prefix compression for write optimized databases, covering key concepts, practical implementations, and real-world applications.

• The Performance Of Database Caching Strategies: Lru, Clock, Arc, And 2Q Under Real World Workloads · 2021-07-06

  A comprehensive technical exploration of the performance of database caching strategies: lru, clock, arc, and 2q under real world workloads, covering key concepts, practical implementations, and real-world applications.

• Building A Distributed Log Structured Storage Engine: Wiredtiger’S B Tree And Concurrency Control · 2021-06-19

  A comprehensive technical exploration of building a distributed log structured storage engine: wiredtiger’s b tree and concurrency control, covering key concepts, practical implementations, and real-world applications.

• A Deep Dive Into The R Tree Spatial Index: Guttman’S Algorithm, Node Splitting, And R* Tree Variants · 2021-06-13

  A comprehensive technical exploration of a deep dive into the r tree spatial index: guttman’s algorithm, node splitting, and r* tree variants, covering key concepts, practical implementations, and real-world applications.

• The Implementation Of A Columnar Storage Format: Parquet Compression, Dictionary Encoding, And Row Groups · 2021-06-13

  A comprehensive technical exploration of the implementation of a columnar storage format: parquet compression, dictionary encoding, and row groups, covering key concepts, practical implementations, and real-world applications.

• Designing A Graph Database With Native Storage: Adjacency Lists, Property Graphs, And Traversal Optimization · 2021-06-02

  A comprehensive technical exploration of designing a graph database with native storage: adjacency lists, property graphs, and traversal optimization, covering key concepts, practical implementations, and real-world applications.

• A Detailed Analysis Of The Pagerank Algorithm: Power Iteration, Damping Factor, And Personalization · 2021-05-25

  A comprehensive technical exploration of a detailed analysis of the pagerank algorithm: power iteration, damping factor, and personalization, covering key concepts, practical implementations, and real-world applications.

• Implementing A K D Tree For Nearest Neighbor Search With Balanced Construction And Bounded Box Test · 2021-05-18

  A comprehensive technical exploration of implementing a k d tree for nearest neighbor search with balanced construction and bounded box test, covering key concepts, practical implementations, and real-world applications.

• The Theory Of Generalization Error In Support Vector Machines: Vc Dimension And Maximal Margin Classifiers · 2021-05-17

  A comprehensive technical exploration of the theory of generalization error in support vector machines: vc dimension and maximal margin classifiers, covering key concepts, practical implementations, and real-world applications.

• Building A Distributed Machine Learning System: Parameter Server Architecture With Asynchronous Stochastic Gradient Descent · 2021-05-05

  A comprehensive technical exploration of building a distributed machine learning system: parameter server architecture with asynchronous stochastic gradient descent, covering key concepts, practical implementations, and real-world applications.

• The Performance Of Attention Mechanisms In Transformers: Self Attention Vs. Multi Headed With Flashattention Optimization · 2021-05-01

  A comprehensive technical exploration of the performance of attention mechanisms in transformers: self attention vs. multi headed with flashattention optimization, covering key concepts, practical implementations, and real-world applications.

• A Comprehensive Guide To Quantization Aware Training: Simulated Quantization, Straight Through Estimator, And Calibration · 2021-04-30

  A comprehensive technical exploration of a comprehensive guide to quantization aware training: simulated quantization, straight through estimator, and calibration, covering key concepts, practical implementations, and real-world applications.

• Implementing A Neural Network Training Framework With Automatic Differentiation Using Wengert Lists · 2021-04-29

  A comprehensive technical exploration of implementing a neural network training framework with automatic differentiation using wengert lists, covering key concepts, practical implementations, and real-world applications.

• The Mathematics Of Gaussian Processes For Bayesian Optimization: Kernel Selection And Cholesky Factorization · 2021-03-26

  A comprehensive technical exploration of the mathematics of gaussian processes for bayesian optimization: kernel selection and cholesky factorization, covering key concepts, practical implementations, and real-world applications.

• Designing An Online Learning Algorithm For Adversarial Bandits: Exp3, Follow The Regularized Leader · 2021-03-02

  A comprehensive technical exploration of designing an online learning algorithm for adversarial bandits: exp3, follow the regularized leader, covering key concepts, practical implementations, and real-world applications.

• The Complexity Of The Edit Distance Problem: Needleman Wunsch, Smith Waterman, And Affine Gap Penalties · 2021-02-18

  A comprehensive technical exploration of the complexity of the edit distance problem: needleman wunsch, smith waterman, and affine gap penalties, covering key concepts, practical implementations, and real-world applications.

• A Deep Dive Into The Palindromic Tree (Eertree): Construction And Applications In Stringology · 2021-02-17

  A comprehensive technical exploration of a deep dive into the palindromic tree (eertree): construction and applications in stringology, covering key concepts, practical implementations, and real-world applications.

• Implementing A Fast Maximum Matching In General Graphs Using Blossom Algorithm (Edmonds) · 2021-02-15

  A comprehensive technical exploration of implementing a fast maximum matching in general graphs using blossom algorithm (edmonds), covering key concepts, practical implementations, and real-world applications.

• The Algorithmics Of Network Flow: Dinic’S Algorithm With Scaling Vs. Push Relabel With Gap Heuristics · 2021-02-14

  A comprehensive technical exploration of the algorithmics of network flow: dinic’s algorithm with scaling vs. push relabel with gap heuristics, covering key concepts, practical implementations, and real-world applications.