Foundations of Linear Algebra
Systems of Linear Equations
Solving for the Unknown
Many problems in science, business, and engineering boil down to a simple challenge: finding a set of unknown values that satisfy several conditions at once. Each condition can often be written as a linear equation, and when you have more than one, you have a system of linear equations.
A linear equation is one where variables are only raised to the first power. For example, $3x + 2y - z = 7$ is linear, but $3x^2 + 2y = 7$ is not.
A solution to a system is a specific set of values for the variables that makes every single equation in the system true. For example, consider this system:
The solution is and . If you plug these values in, both equations hold true. , and . Finding this solution is our goal.
Gaussian Elimination
When systems get bigger, with more equations and variables, we need a reliable strategy. The most common one is called Gaussian elimination. The idea is to transform the system into an equivalent, simpler one that's easy to solve, without changing the actual solution.
Think of it like a puzzle. You can swap pieces, combine them, or modify them in specific ways to make the final picture clearer. The picture itself—the solution—doesn't change.
We do this using three basic moves, called elementary row operations:
- Swap any two equations.
- Multiply an entire equation by any non-zero number.
- Add a multiple of one equation to another one.
Let's use these moves on a system with three variables.
Our goal is to eliminate the term from the second and third equations. First, we'll add -2 times the first equation to the second equation.
Next, we add -3 times the first equation to the third equation to eliminate the other term.
Now we focus on the smaller 2x2 system that's left. We want to eliminate the term from the last equation. This is trickier. Let's multiply the second equation by 7 and the third by -5 to make the coefficients match and cancel.
Now, add the new second equation to the new third equation.
This system looks much easier to solve! From the last equation, we can see that , so . Now we can work backward, a process called back-substitution. Plug into the second equation to find , and then plug both and into the first equation to find . This step-by-step elimination and substitution process is the essence of Gaussian elimination.
The Nature of Solutions
Not every system has a nice, single solution. When you perform Gaussian elimination, the final form of the system tells you what kind of solution set to expect. There are only three possibilities.
1. A Unique Solution
This is what we saw above. The process leads to a specific value for each variable. Geometrically, this means the lines (or planes, in 3D) all intersect at a single point. A system with one or more solutions is called a consistent system.
2. Infinite Solutions
Sometimes, during elimination, an entire equation vanishes, turning into $0 = 0$. This is a true statement, but it gives us no information. It means one of our original equations was redundant—it was just a combination of the others.
When this happens, you don't have enough information to pin down a single solution. The system has infinite solutions. This is also a consistent system.
3. No Solution
The third possibility occurs when elimination leads to a contradiction, like $0 = 5$. This is clearly false. If you reach a nonsensical equation like this, it means the system has no solution. The original equations contradict each other. Such a system is called inconsistent.
Gaussian elimination is a powerful and systematic way to reveal the true nature of any system of linear equations, telling you whether there is one solution, many, or none at all.
What defines a solution to a system of linear equations?
Which of the following is the solution to the system of equations below?
Understanding these methods is the first major step into the world of linear algebra.