Vectors and the dot product
A vector is an arrow and a list of numbers at the same time. The dot product measures how far two of them agree, and it is the operation behind similarity search and attention.
40 min
After this lesson you can
- Move between the arrow picture and the list-of-numbers picture of a vector
- Explain linear combinations and span, and recognise when two vectors are dependent
- Compute , and norms and say what each one measures
- Derive from the law of cosines
- Compute projections and cosine similarity, and read them in attention formulas
In this lesson
- One object, two pictures
- Adding and stretching
- Linear combinations and span
- How long is a vector? Norms
- The dot product, as arithmetic
- The dot product, as geometry
- In code
- Where this goes: attention
This lesson is part of Descent Pro
Descent Pro unlocks every lesson on the route, from base camp to the summit. Every plan starts with a free trial.