Stefanos Zafeiriou Machine Learning(395)

Course 395: Machine Learning – Math. Intro.

Brief Intro to Matrices, Vectors and Derivatives:

•Equality: Two matrices and are equal iff

•Matrix addition

• Scalar Multilplication

Stefanos Zafeiriou Machine Learning(395)

Neural Networks – Math. Intro.

•Matrix transposition:

•Dot product:

Stefanos Zafeiriou Machine Learning(395)

•Matrix Multiplication: Let two matrices and then : the dot product of the i-th row of and the j-th column of

•Example:

Neural Networks – Math. Intro.

Stefanos Zafeiriou Machine Learning(395)

•Partial derivatives Example 1:

Neural Networks – Math. Intro.

Stefanos Zafeiriou Machine Learning(395)

•Example 2:

Neural Networks – Math. Intro.

Stefanos Zafeiriou Machine Learning(395)

•Optimization problem

Compute the partial derivatives

Neural Networks – Math. Intro.