1 Vectors and Matrices
1.1 Vectors and Linear Combinations
1.2 Lengths and Angles from Dot Products
1.3 Matrices and Their Column Spaces
1.4 Matrix Multiplication AB and CR
2 Solving Linear Equations Ax=b
2.1 Elimination and Back Substitution
2.2 Elimination Matrices and Inverse Matrices
2.3 Matrix Computations and A=LU
2.4 Permutations and Transposes
2.5 Derivatives and Finite Difference Matrices
3 The Four Fundamental Subspaces
3.1 Vector Spaces and Subspaces
3.2 Computing the Nullspace by Elimination: A=CR
3.3 The Complete Solution to Ax=b
3.4 Independence, Basis, and Dimension
3.5 Dimensions of the Four Subspaces
4 Orthogonality
4.1 Orthogonality of Vectors and Subspaces
4.2 Projections onto Lines and Subspaces
4.3 Least Squares Approximations
4.4 Orthonormal Bases and Gram-Schmidt
4.5 The Pseudoinverse of a Matrix
5 Determinants
5.1 3 by 3 Determinants and Cofactors
5.2 Computing and Using Determinants
5.3 Areas and Volumes by Determinants
6 Eigenvalues and Eigenvectors
6.1 Introduction to Eigenvalues: Ax=Xx
6.2 Diagonalizing a Matrix
6.3 Symmetric Positive Definite Matrices
6.4 Complex Numbers and Vectors and Matrices
6.5 Solving Linear Differential Equations
7 The Singular Value Decomposition (SVD)
7.1 Singular Values and Singular Vectors
7.2 Image Processing by Lincar Algebra
7.3 Principal Component Analysis (PCA by the SVD)
8 Linear Transformations
8.1 The Idea of a Linear Transformation
8.2 The Matrix of a Linear Transformation
8.3 The Search for a Good Basis
9 Linear Algebra in Optimization
9.1 Minimizing a Multivariable Function
9.2 Backpropagation and Stochastic Gradient Descent
9.3 Constraints, Lagrange Multipliers, Minimum Norms
9.4 Linear Programming, Game Theory, and Duality
10 Learning from Data
10.1 Piecewise Linear Learning Functions
10.2 Creating and Experimenting
10.3 Mean, Variance, and Covariance
Appendix 1 The Ranks of AB and A+ B due i
Appendix 2 Matrix Factorizations
Appendix 3 Counting Parameters in the Basic Factorizations
Appendix 4 Codes and Algorithms for Numerical Linear Algebra
Appendix 5 The Jordan Form of a Square Matrix
Appendix 6 Tensors
Appendix 7 The Condition Number of a Matrix Problem
Appendix 8 Markov Matrices and Perron-Frobenius
Appendix 9 Elimination and Factorization
Appendix 10 Computer Graphics
Index of Equations
Index of Notations
Index
