Mastering the Calculus of Variations
Functionals and Variations
From Functions to Functionals
In single-variable calculus, we find the minimum or maximum of a function by finding where its derivative is zero. The input is a number, , and the output is another number, . We are looking for a specific point that optimizes the function's value.
Now, let's level up. What if instead of finding a point, we needed to find an entire path or shape that minimizes some quantity? For instance, what is the shortest path between two points on a curved surface? The answer isn't a single point, but a whole curve.
This is where functionals come in. A functional is a mapping that takes a function as its input and returns a single real number. Think of it as a function of a function.
Functional
noun
A rule of correspondence that assigns a real number to each function in a given class.
A common form for a functional, which we'll call , takes a function and is defined by an integral:
Our goal is to find the specific function that makes the value of a minimum or maximum. This is the core task of the calculus of variations.
Finding the Optimal Path
How do we find the function that makes a functional stationary (a minimum, maximum, or saddle point)? In standard calculus, we'd take the derivative and set it to zero. We need an equivalent tool for functionals.
Let's assume we have the optimal function, let's call it . Now, consider a slightly different function, which we can call an admissible variation. It's the original function plus a small deviation, , scaled by a tiny number, . The function must be zero at the endpoints, because we assume the start and end points of our path are fixed.
If we plug this new function into our functional , we get a value that depends on . Since is the optimal path, the value of should be at an extremum when . This means the derivative of with respect to , evaluated at , must be zero.
This derivative is called the first variation of the functional, denoted . Setting it to zero is the fundamental step in finding the optimal function. When we work through the calculus, this condition leads to a remarkable result.
The Fundamental Lemma
After performing the differentiation and setting , we arrive at an integral equation that must hold for any admissible variation function .
At first glance, this looks difficult. The integral of a product is zero. But how does that help us? The function is our key. Since this equation must be true for any choice of , it forces the other part of the integrand to be zero everywhere.
This is the core idea of the Fundamental Lemma of Calculus of Variations (also known as the Du Bois-Reymond lemma). It states that if an integral of the form holds for all suitably smooth functions that vanish at the endpoints, then the function must be identically zero on the interval .
If the total is zero no matter how you weigh the parts, then the parts themselves must be zero everywhere.
Applying this powerful lemma to our integral gives us the celebrated Euler-Lagrange equation, which is a differential equation that the optimal function must satisfy.
We've now seen how the problem of minimizing a functional is transformed. Instead of testing an infinite number of functions, we can solve a differential equation to find the one that does the job. This is the bridge from an integral problem to a differential one.
In the context of the calculus of variations, what is the primary characteristic of a functional?
What is the core purpose of setting the first variation () of a functional to zero?