Covers: theory of Singular Value Decomposition
Estimated time needed to finish: 30 minutes
Questions this item addresses:
  • How to efficiently estimate missing entries of large matrices?
How to use this item?

This is an optional read.

  • Read sections 1,2,3. The main algorithm is presented in Algorithm 3.1.
  • Section 5 discusses the convergence analysis of the proposed algorithm.
  • Section 6 shows the performance results on the Netflix and MovieLens data.
Author(s) / creator(s) / reference(s)
Trevor Hastie, Rahul Mazumder, Jason D. Lee, Reza Zade
0 comment

Singular Value Decomposition (SVD)

Total time needed: ~2 hours
Learn the basics of SVD and its applications in dimensionality reduction
Potential Use Cases
Educational use. Gives basic introduction to SVD and some of its applications
Who is This For ?
INTERMEDIATEAnyone interested in SVD with basic linear algebra background.
Click on each of the following annotated items to see details.
VIDEO 1. Overview of Singular Value Decomposition (SVD)
  • What is SVD?
  • What are the factors of SVD?
  • How are the factors of SVD related to the data matrix?
13 minutes
BOOK_CHAPTER 2. The theory of SVD
  • What is the relation between the SVD factors of a matrix and its four fundamental subspaces?
  • How is SVD computed?
  • How can SVD be used for image compression?
18 minutes
VIDEO 3. Dimensionality Reduction via SVD
  • How is the best rank r approximation of a matrix obtained using SVD?
  • What is the Eckart-Young-Mirsky Theorem?
15 minutes
VIDEO 4. Choosing the Optimal Rank for Truncating SVD
  • How to choose truncation value in SVD?
12 minutes
ARTICLE 5. (Optional) Matrix Completion and Low-Rank SVD via Fast Alternating Least Squares
  • How to efficiently estimate missing entries of large matrices?
30 minutes

Concepts Covered

0 comment