Learning PDEs

Sat 04 January 2014

Somehow I escaped undergrad and grad school without ever formally learning partial differential equations (PDEs), or much of any mathematical physics. I identify more with the discrete, algorithmic, data-structures side of the applied math universe -- beyond basic undergraduate physics, I was largely PDEngorant (sorry).

My reasoning always went along the lines of

  1. Most real physical systems I ever build will be of geometry sufficiently complex to need numeric solvers

  2. Modern numeric solvers are compelx enough that I probably won't learn much by implementing a trivial one myself

  3. Manipulating symbols is hard.

It turns out these things may all be true, but that's not really the point -- the amazing things about fluency with PDEs is that it makes learning all of physics much easier. By understanding simpler geometries and problems without getting held up by the math, we can build physical intuition.

Now that I'm an adult (ugh) I also really appreciate some of the beauty present in things like Sturm-Liouville theory.

Classic PDEs

So if you want to quickly grok PDEs, there are a few things you should know.

First, there are basically three "canonical" types of PDEs that show up in introductory mathematical physics, many of which you may have seen before:

The heat equation:

$$\frac{\partial u}{\partial t} = \alpha \frac{\partial ^2 u}{\partial x^2}$$

This says, roughly, that the rate of change in time at a point is proportional to how much the point differs from the average for its neighborhood. PDEs that can be transformed into equations analogous to the heat/diffusion equation are called parabolic PDEs.

The wave equation:

$$\frac{\partial^2 u}{\partial t^2} = c \frac{\partial ^2 u}{\partial x^2}$$

PDEs that look like the wave function are called hyperbolic, and retain discontinuities present in their initial conditions -- waves!

Laplace / Poisson's equation

$$\frac{\partial^2 u}{\partial x^2} = 0 $$

Laplace's equation (Poisson's equation is Laplace's equation with an inhomogeneous term) says a function must be "maximally boring". The second derivative everywhere must be zero! For the 1-d case this is a line; for higher-dimensions solutions 1. can only take their maximum on the boundary of the problem domain or, equivalently, 2. any point that's a solution must be the average of nearby points. These are called harmonic functions, and are the source of a lot of the "special" functions in mathematical physics.

These are linear and second-order and capture a tremendous amount of the intuition behind both a wide variety of physical systems and how to solve a large number of PDEs.

Methods of solution

Then there are a couple of methods for "solving" the PDEs above that arise from simple, convenient boundary boundary conditions including:

I actually started down this path by trying to better understand green's solutions in electrostatics problems.

Other Neat Facts

First-order PDEs

First-order PDEs can be just as complex to solve than some second-order PDEs, which is both surprising and neat. Traffic flow is often modeled via first-order PDEs. Finding good material to study first-order PDEs can be tricky, as there's a lot of sloppyness with symbols in most texts. I highly recommend watching the videos from Chris below.

Sturm Liouville theory

Many PDEs reduce (via separation of variables) to a class of ODEs described by Sturm-Liouville Theory. Now, this is really neat -- when combined with the right boundary conditions, these ODEs constitute a Hermitian differential operator which is guaranteed to have eigenvalues and eigenfunction solutions with very elegant properties. Bonus: You get to learn about weighted \(L^p\) spaces. I highly recommend chapter 10 of the Olver text.

Beam Theory

Euler-Bernoulli Beam Theory is one of the canonical examples of a fourth-order PDE!

At the time, science and engineering were generally seen as very distinct fields, and there was considerable doubt that a mathematical product of academia could be trusted for practical safety applications. Bridges and buildings continued to be designed by precedent until the late 19th century, when the Eiffel Tower and Ferris wheel demonstrated the validity of the theory on large scales.

Admittedly this is from wikipedia, but if true than this neat little PDE helped convince the world that science could inform engineering!

Material

One of the great things about studying as well-worn a path as PDEs is that there is almost certainly a textbook out there that speaks directly to your preferred learning style and background. Four sources of material I found exceptionally helpful were:

Also, if you want to continue to learn more about differential equations (both PDEs and ODEs) I recommend @diff_eq on Twitter.