No history yet

Inner Product Spaces

Adding Geometry to Vectors

So far, we've treated vector spaces as collections of objects we can add together and scale. This is useful, but it's missing something fundamental from our everyday experience with arrows in space: the concept of length and angle. How long is a vector? Are two vectors perpendicular? The basic rules of vector spaces don't tell us.

To answer these questions, we need to add more structure. We do this with a new tool called an inner product.

An inner product space is a vector space equipped with an inner product. This operation takes two vectors and produces a single scalar number.

In the context of quantum mechanics, we often write the inner product of two vectors, u|u\rangle and v|v\rangle, using bra-ket notation: uv\langle u | v \rangle. Think of it as a machine that eats two vectors and spits out a number. This number tells us how the two vectors relate to each other geometrically.

Rules of the Inner Product

An operation can only be called an inner product if it follows three specific rules. Let's take two vectors u|u\rangle and v|v\rangle from a complex vector space (the kind used in quantum mechanics).

PropertyDescriptionMathematical Form
Conjugate SymmetrySwapping the vectors gives the complex conjugate of the original inner product.$\langle u
LinearityThe inner product is linear in its second argument. It distributes over addition and scalar multiplication.$\langle u
Positive-DefinitenessThe inner product of a vector with itself is a non-negative real number. It's zero only if the vector is the zero vector.$\langle v

The most common example is the standard inner product in Cn\mathbb{C}^n. If we have two vectors u=(u1,u2,,un)|u\rangle = (u_1, u_2, \dots, u_n) and v=(v1,v2,,vn)|v\rangle = (v_1, v_2, \dots, v_n), their inner product is:

uv=u1v1+u2v2++unvn=i=1nuivi\langle u | v \rangle = u_1^* v_1 + u_2^* v_2 + \dots + u_n^* v_n = \sum_{i=1}^n u_i^* v_i

Notice the complex conjugate (*) on the components of the first vector, u|u\rangle. This ensures the positive-definiteness property holds, giving us a real number when we take the inner product of a vector with itself.

Length and Orthogonality

With the inner product defined, we can now talk about geometric concepts. The length, or norm, of a vector is defined as the square root of the inner product of the vector with itself.

Norm

noun

The length or magnitude of a vector in an inner product space.

v=vv\|v\| = \sqrt{\langle v | v \rangle}

This definition is a generalization of the Pythagorean theorem. For a vector (x,y)(x, y) in a 2D plane, its length is x2+y2\sqrt{x^2 + y^2}, which is exactly what our formula gives if you use the standard dot product.

The inner product also gives us a precise way to define what it means for two vectors to be perpendicular.

Orthogonal

adjective

Two vectors in an inner product space are orthogonal if their inner product is zero.

Two vectors u|u\rangle and v|v\rangle are orthogonal if uv=0\langle u | v \rangle = 0.

This is incredibly important in quantum mechanics. When two quantum states are orthogonal, it means they are perfectly distinguishable. If a system is in one state, a measurement will never find it in the orthogonal state.

This leads to the idea of an orthonormal basis. This is a basis for a vector space where every basis vector has a norm of 1 (they are normal) and is orthogonal to every other basis vector (they are ortho). Working with an orthonormal basis simplifies calculations immensely.

Building a Better Basis

Orthonormal bases are great, but what if you're given a basis that isn't orthonormal? You can build one using a procedure called the Gram-Schmidt process. It's like taking a skewed, messy set of basis vectors and straightening them out one by one.

The process works iteratively. You start with the first vector and normalize it. Then you take the second vector, subtract any part of it that lies along the first vector, and normalize what's left. You continue this for all vectors, at each step removing the components that align with the previously constructed basis vectors.

Let's formalize this. Given a basis {v1,v2,,vn},wecanconstructanorthonormalbasis{|v_1\rangle, |v_2\rangle, \dots, |v_n\rangle\}, we can construct an orthonormal basis \{|u_1\rangle, |u_2\rangle, \dots, |u_n\rangle} as follows:

  1. Start with v1|v_1\rangle. Normalize it to get u1|u_1\rangle.
u1=v1v1|u_1\rangle = \frac{|v_1\rangle}{\|v_1\|}
  1. Take v2|v_2\rangle. Subtract its projection onto u1|u_1\rangle. The result, w2|w_2\rangle, will be orthogonal to u1|u_1\rangle. Then normalize w2|w_2\rangle to get u2|u_2\rangle.
w2=v2u1v2u1u2=w2w2|w_2\rangle = |v_2\rangle - \langle u_1 | v_2 \rangle |u_1\rangle \\ |u_2\rangle = \frac{|w_2\rangle}{\|w_2\|}
  1. For each subsequent vector vk|v_k\rangle, subtract its projections onto all the previously created orthonormal vectors u1,,uk1|u_1\rangle, \dots, |u_{k-1}\rangle. Then normalize the result.
wk=vkj=1k1ujvkujuk=wkwk|w_k\rangle = |v_k\rangle - \sum_{j=1}^{k-1} \langle u_j | v_k \rangle |u_j\rangle \\ |u_k\rangle = \frac{|w_k\rangle}{\|w_k\|}

This procedure guarantees that you'll end up with a perfect orthonormal basis, which is often the first step in solving problems in quantum mechanics.

Quiz Questions 1/5

What is the primary purpose of introducing an inner product to a vector space?

Quiz Questions 2/5

Given a vector v=(3,4i)|v\rangle = (3, 4i) in the complex vector space C2\mathbb{C}^2, what is its norm, v||v||?

Inner product spaces provide the geometric foundation needed to make sense of quantum states. The concepts of length and orthogonality are not just mathematical curiosities; they are direct analogues to probability and distinguishability in the quantum world.