Mathematical Foundations for Machine Learning
| Term | Definition |
|---|---|
| Norm/Length |
|
| Distance |
|
| Scalar product |
|
- Determinant
-
- Inverting
-
- Transposing
-
- Matrix multiplication
-
|
|
|
| Term | Definition |
|---|---|
| Addition |
|
| Multiplication |
|
| Product rule |
|
| Chain rule |
|
| Quotient rule |
|
| Term | Definition |
|---|---|
| Real valued function |
|
| Vector valued function |
|
| A function of variables |
|
| Softmax function | |
| RSS |
|
| -dimensional curve |
|
| -dimensional hyper-surface |
|
| Reparametrization |
|
|
| Function | Derivative |
|---|---|
|
|
|
|
|
|
|
|
|
- Common gradients
-
- Linearisation
-
- Chain rule
-
- Common jacobians
-
- Chain rule
-
- Differentiation properties
-
|
|
- Tangent space
-
- Graph of a linearisation
-
- Common hessians
-
Let a curve passing the stationary point
at and
- If , then defines a local minimum
- If , then defines a local maximum
- If , the point defines a saddle point
|
|
|
|
|
|
|
|---|---|---|---|---|---|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|