Maxwell's Theorem

In a recent 3Blue1Brown video, it was mentioned that the 2D (centered) Gaussian are the unique distributions which are radial and have independent marginals. On a google I found out that this is known as Maxwell’s theorem, but the linked Wikipedia page is a little lacking. This blogpost does a better job. The blogpost says that the solution to β„Ž(π‘₯)β„Ž(𝑦)=β„Ž(π‘₯2+𝑦2) is clearly of the form π‘’π‘Žπ‘₯2. For anyone else who doesn’t want to spend the 5 seconds necessary to unpack this, you should set 𝐻(π‘₯)β‰”β„Ž(π‘₯) (without loss of generality π‘₯β‰₯0) to find the equivalent equation 𝐻(π‘₯2)𝐻(𝑦2)=𝐻(π‘₯2+𝑦2), which is essentially the defining characteristic of the exponential, i.e. 𝐻(π‘₯)=π‘’π‘Žπ‘₯.

However there are some pedantic points that one might bring up. The first is that the exponential is not the only solution: search for exponential in this Math.SE post. This can indeed be ignored since the other solutions will not lead to a probability distribution. The second is more interesting, and comes back to the rough state of the Wikipedia page. The proof given there is as follows:

We only need to prove the theorem for the 2-dimensional case, since we can then generalize it to n-dimensions by applying the theorem sequentially to each pair of coordinates.

Since rotating by 90 degrees preserves the joint distribution, both 𝑋1,𝑋2 has the same probability measure. Let it be πœ‡. If πœ‡ is a Dirac delta distribution at zero, then it’s a gaussian distribution, just degenerate. Now assume that it is not.

By Lebesgue’s decomposition theorem, we decompose it to a sum of regular measure and an atomic measure: πœ‡=πœ‡π‘Ÿ+πœ‡π‘ . We need to show that πœ‡π‘ =0, with a proof by contradiction.

Suppose πœ‡π‘  contains an atomic part, then there exists some π‘₯βˆˆβ„ such that πœ‡π‘ ({π‘₯})>0. By independence of 𝑋1,𝑋2, the conditional variable 𝑋2|{𝑋1=π‘₯) is distributed the same way as 𝑋2. Suppose π‘₯=0, then since we assumed πœ‡ is not concentrated at zero, Pr(𝑋2𝑛=0)>0, and so the double ray {(π‘₯1,π‘₯2):π‘₯1=0,π‘₯2𝑛=0} has nonzero probability. Now by rotational symmetry of πœ‡Γ—πœ‡, any rotation of the double ray also has the same nonzero probability, and since any two rotations are disjoint, their union has infinite probability, contradiction.

So now let πœ‡ have probability density function 𝜌, and the problem reduces to solving the functional equation

𝜌(π‘₯)𝜌(𝑦)=𝜌(π‘₯cosπœƒ+𝑦sinπœƒ)𝜌(π‘₯sinπœƒβˆ’π‘¦cosπœƒ)

Ignoring that the proof isn’t complete, the Wikipedia article points out that that it is assumed that there is a distribution function. What the earlier blogpost actually gives a proof for is the following result:

Theorem (Maxwell) The (centered) gaussians are the only absolutely continuous distributions on ℝ𝑛 which are radial and have independent marginals.

Indeed, the Dirac mass at 0 is a different solution, although it is quite natural as a kind of β€˜degenerate’ Gaussian. It seems that the possible existence of singular continuous distributions is not settled. Some tangentially related links for if I come back to this (or the interested reader):

Related Posts