Maxwell's Theorem
In a recent 3Blue1Brown video, it was mentioned that the 2D (centered) Gaussian are the unique distributions which are radial and have independent marginals. On a google I found out that this is known as Maxwell’s theorem, but the linked Wikipedia page is a little lacking. This blogpost does a better job. The blogpost says that the solution to is clearly of the form . For anyone else who doesn’t want to spend the 5 seconds necessary to unpack this, you should set (without loss of generality ) to find the equivalent equation which is essentially the defining characteristic of the exponential, i.e. .
However there are some pedantic points that one might bring up. The first is that the exponential is not the only solution: search for exponential in this Math.SE post. This can indeed be ignored since the other solutions will not lead to a probability distribution. The second is more interesting, and comes back to the rough state of the Wikipedia page. The proof given there is as follows:
We only need to prove the theorem for the 2-dimensional case, since we can then generalize it to n-dimensions by applying the theorem sequentially to each pair of coordinates.
Since rotating by degrees preserves the joint distribution, both has the same probability measure. Let it be . If is a Dirac delta distribution at zero, then it’s a gaussian distribution, just degenerate. Now assume that it is not.
By Lebesgue’s decomposition theorem, we decompose it to a sum of regular measure and an atomic measure: . We need to show that , with a proof by contradiction.
Suppose contains an atomic part, then there exists some such that . By independence of , the conditional variable is distributed the same way as . Suppose , then since we assumed is not concentrated at zero, , and so the double ray has nonzero probability. Now by rotational symmetry of , any rotation of the double ray also has the same nonzero probability, and since any two rotations are disjoint, their union has infinite probability, contradiction.
So now let have probability density function , and the problem reduces to solving the functional equation
Ignoring that the proof isn’t complete, the Wikipedia article points out that that it is assumed that there is a distribution function. What the earlier blogpost actually gives a proof for is the following result:
Theorem (Maxwell) The (centered) gaussians are the only absolutely continuous distributions on which are radial and have independent marginals.
Indeed, the Dirac mass at is a different solution, although it is quite natural as a kind of ‘degenerate’ Gaussian. It seems that the possible existence of singular continuous distributions is not settled. Some tangentially related links for if I come back to this (or the interested reader):
- If is singular continuous it is possible that is either singular continuous or absolutely continuous.
- Simple example of a singular distribution
- A paper that discusses singular distributions
- Another paper that discusses singular continuous distributions
- A more expository note discussing singular continuous functions
- A paper on Brownian motion with singular drift
- An example of a singular continuous distribution arising from a random walk