No history yet

Vectors and Vector Spaces

Vectors: More Than Just Numbers

In math, a scalar is a single number, like 5, -10, or 3.14. It just has magnitude. But what if we want to describe something that has both magnitude and direction? For that, we need vectors.

A vector is often visualized as an arrow. The arrow's length represents its magnitude, and the way it points shows its direction. Think about giving directions. "Go three miles" is a scalar instruction. "Go three miles north" is a vector instruction. It gives you both a distance and a direction.

Lesson image

We write vectors as a list of numbers called components. Each component corresponds to a direction in a coordinate system. For example, in a 2D plane, a vector v\vec{v} could be written as:

v=(23)\vec{v} = \begin{pmatrix} 2 \\ 3 \end{pmatrix}

This means "go 2 units along the x-axis, and 3 units along the y-axis."

Basic Vector Operations

Vectors aren't static. We can perform operations with them, just like with regular numbers. The two most basic operations are addition and scalar multiplication.

Vector Addition: To add two vectors, you add their corresponding components. This is like following one set of directions, and then another.

Imagine two vectors, u\vec{u} and v\vec{v}:

u=(14),v=(31)\vec{u} = \begin{pmatrix} 1 \\ 4 \end{pmatrix}, \quad \vec{v} = \begin{pmatrix} 3 \\ 1 \end{pmatrix}

Their sum, u+v\vec{u} + \vec{v}, is:

u+v=(1+34+1)=(45)\vec{u} + \vec{v} = \begin{pmatrix} 1+3 \\ 4+1 \end{pmatrix} = \begin{pmatrix} 4 \\ 5 \end{pmatrix}

Scalar Multiplication: This involves multiplying a vector by a scalar (a single number). This scales the vector, changing its length. If the scalar is negative, it also reverses the vector's direction.

Lesson image

Let's take our vector u\vec{u} and multiply it by the scalar 3:

3u=3(14)=(3×13×4)=(312)3\vec{u} = 3 \begin{pmatrix} 1 \\ 4 \end{pmatrix} = \begin{pmatrix} 3 \times 1 \\ 3 \times 4 \end{pmatrix} = \begin{pmatrix} 3 \\ 12 \end{pmatrix}

The new vector points in the same direction but is three times longer.

The Rules of the Game: Vector Spaces

Vectors don't just exist in a void. They live in a structured environment called a vector space. A vector space is a collection of vectors where the rules of vector addition and scalar multiplication work in a consistent and predictable way. For a collection of vectors to be a vector space, it must satisfy a set of rules, or axioms.

AxiomDescription
Closure under AdditionIf u\vec{u} and v\vec{v} are in the space, u+v\vec{u} + \vec{v} is also in the space.
Closure under Scalar MultiplicationIf u\vec{u} is in the space, then cuc\vec{u} is also in the space for any scalar cc.
Commutativity of Additionu+v=v+u\vec{u} + \vec{v} = \vec{v} + \vec{u}
Associativity of Addition(u+v)+w=u+(v+w)(\vec{u} + \vec{v}) + \vec{w} = \vec{u} + (\vec{v} + \vec{w})
Additive IdentityThere is a zero vector 0\vec{0} such that u+0=u\vec{u} + \vec{0} = \vec{u}.
Additive InverseFor every vector u\vec{u}, there is a vector u-\vec{u} such that u+(u)=0\vec{u} + (-\vec{u}) = \vec{0}.
Distributivityc(u+v)=cu+cvc(\vec{u} + \vec{v}) = c\vec{u} + c\vec{v} and (c+d)u=cu+du(c+d)\vec{u} = c\vec{u} + d\vec{u}.
Scalar Multiplication Identity1u=u1\vec{u} = \vec{u}

These rules ensure that the system behaves logically. The set of all 2D vectors, often called R2\mathbb{R}^2, is a common example of a vector space.

Vectors and Vector Spaces serve as the cornerstone of linear algebra.

Building Blocks of a Space

Inside a vector space, some vectors are more fundamental than others. They act like the primary colors, which can be mixed to create any other color. In linear algebra, these are called basis vectors.

span

verb

The set of all possible vectors that can be created by linear combinations of a set of vectors.

A key concept here is linear independence. A set of vectors is linearly independent if no vector in the set can be written as a combination of the others. If one can be written as a combination of others, the set is linearly dependent.

Think of it this way: if you're giving directions, "go one block east" and "go one block north" are independent. But "go one block east," "go one block north," and "go one block northeast" are dependent, because the third instruction is just a combination of the first two.

This brings us to the idea of a basis.

A basis for a vector space is a sequence of vectors that are linearly independent and they span the space.

A basis is the smallest set of vectors you need to build every other vector in the space. For the 2D plane (R2\\\mathbb{R}^2), the most common basis is:

i^=(10),j^=(01)\hat{i} = \begin{pmatrix} 1 \\ 0 \end{pmatrix}, \quad \hat{j} = \begin{pmatrix} 0 \\ 1 \end{pmatrix}

Any 2D vector can be described as a combination of these two. For example, the vector (23)\begin{pmatrix} 2 \\ 3 \end{pmatrix} is just 2i^+3j^2\hat{i} + 3\hat{j}.

The number of vectors in a basis is called the dimension of the vector space. Since the basis for R2\mathbb{R}^2 has two vectors, its dimension is 2. For R3\mathbb{R}^3, the dimension is 3, and so on. This neatly connects the abstract idea of a vector space back to our intuitive understanding of 1D, 2D, and 3D space.

Time to check your understanding of these foundational concepts.

Quiz Questions 1/5

What fundamental properties distinguish a vector from a scalar?

Quiz Questions 2/5

If a vector v=(46)\vec{v} = \begin{pmatrix} -4 \\ 6 \end{pmatrix}, what is the result of the scalar multiplication 12v-\frac{1}{2}\vec{v}?

Understanding vectors and the rules they follow in a vector space is the first major step in mastering linear algebra. These concepts are the foundation for everything that comes next.