prof. seungchul lee industrial ai lab. · linear algebra prof. seungchul lee industrial ai lab....
TRANSCRIPT
Linear Algebra
Prof. Seungchul Lee
Industrial AI Lab.
Linear Equations
• Two linear equations
• In a vector form
• Solution using inverse
1 2
1 2
4 5 13
2 3 9
x x
x x
1
2
4 5 13, ,
2 3 9
xA x b
x
1 1
1
Ax b
A Ax A b
x A b
2
System of Linear Equations
• Consider a system of linear equations
• Can be written in a matrix form as 𝑦 = 𝐴𝑥, where
3
System of Linear Equations
1) Well-determined linear systems
2) Under-determined linear systems
3) Over-determined linear systems
4
1) Well-Determined Linear Systems
• System of linear equations
• Geometric point of view
5
1) Well-Determined Linear Systems
• System of linear equations
• Matrix form
6
2) Under-Determined Linear Systems
• System of linear equations
• Geometric point of view
7
2) Under-Determined Linear Systems
• System of linear equations
• Matrix form
8
3) Over-Determined Linear Systems
• System of linear equations
• Geometric point of view
9
3) Over-Determined Linear Systems
• System of linear equations
• Matrix form
10
Vector-Vector Products
• Inner product: 𝑥, 𝑦 ∈ ℝ𝑛
11
Norm
• 𝑙2 norm
• 𝑥 Measures length of vector (from the origin)
12
Orthogonality
• Two vectors 𝑥, 𝑦 ∈ ℝ𝑛 are orthogonal if
• They are orthonormal if
and
13
Angle between Vectors
• (unsigned) angle between vectors in ℝ𝑛 defined as
14
Half Space
• ȁ𝑥 𝑥𝑇𝑦 ≤ 0 defines a half space with outward normal vector 𝑦, and boundary passing through 0
15