This book synthesizes those techniques from numerical analysis, algorithms, data structures, and optimization theory mostcommonly employed in statistics and machine learning. We provide concrete applications of these methods by giving complete reference implementations for a large set of the most commonly used statistical estimators. The goal is to provide a self-contained textbook explaining the inner algorithmic workings of statistical estimators.