15 Inner Product Spaces, Orthogonal and Self-Adjoint Operators
Recall: bilinear forms
- A bilinear form
corresponds to , This gives an isomorphism . is nondegenerate if is an isomorphism.- In a basis
, represent by a matrix with entries : is symmetric iff is symmetric ( ), and nondegenerate iff is invertible.
Definition 15.1. If
Warning: this is most intuitive if
Lemma 15.2. If
Proof.
Example 15.3.
with the standard dot product : then , the “usual” orthogonal complement, because (see below) and .- But for
, if is the 1-dimensional subspace spanned by any nonzero vector , then !! (Because .)
Inner product spaces
Definition 15.4. An inner product space is a vector space
Symmetric:
This definition only makes sense over an ordered field, so that “
- Let
, , be the linear map corresponding to . Then definite positive is injective (since for all , ! ) (assuming ) is an iso , i.e. is nondegenerate. (The converse is false: nondegenerate positive.)
Proposition 15.5.
Proof.
- We’ve seen:
is nondegenerate, so . - Since
is positive definite, . So . Since the dimensions add up to , this implies .
∎
Definition 15.6.
- The norm of a vector is
. are orthogonal if .
Observe:
- If
and are orthogonal then (Pythagorean theorem). - In general, by analogy with the law of triangles, we define the angle between 2 vectors,
This only makes sense if ?
Theorem 15.7 (Cauchy–Schwarz inequality). For all
Proof. The inequality is unaffected by scaling, so we can assume
Orthonormal bases
Definition 15.8. Let
In such a basis,
Theorem 15.9. Every finite-dimensional inner product space (over
Proof 1. By induction on
Proof 2. Start with any basis
So: every finite-dimensional inner product space over
Notes not reached in this lecture, covered at the start of {{LINK:L16}}
Operators on inner product spaces
Let
Definition 15.10. Say
(In other terms,
Remarks.
- Orthogonal operators map orthonormal bases to orthonormal bases!
In particular, orthogonal operators are always invertible! - If
is orthogonal then is orthogonal: where the first equality is because is orthogonal. If are orthogonal then so is (check!).
Proposition 15.11. Hence: orthogonal operators form a subgroup of
- If
is the matrix representing in an orthonormal basis, then . Indeed: the entries of are the dot products of the columns of !
Adjoint operator
Definition 15.12. Let
Indeed: given
Equivalently:
Definition 15.13.
In an orthonormal basis
Proposition 15.14. Hence:
Note that self-adjoint operators (
Proposition 15.15. If
Proof. Let
Theorem 15.16 (The spectral theorem for real self-adjoint operators). If
The proof (to be seen next time) uses the following key observation:
Lemma 15.17. If
Proof. For all
Corollary 15.18. If
Proof. It is enough to show