What Is a Random Orthogonal Matrix?

What Is a Random Orthogonal Matrix?

Various explicit parametrized formulas are available for constructing orthogonal matrices. To construct a random orthogonal matrix we can take such a formula and assign random values to the parameters. For example, a Householder matrix is orthogonal and symmetric and we can choose the nonzero vector randomly. Such an example is rather special, though, as it is a rank- perturbation of the identity matrix.

What is usually meant by a random orthogonal matrix is a matrix distributed according to the Haar measure over the group of orthogonal matrices. The Haar measure provides a uniform distribution over the orthogonal matrices. Indeed it is invariant under multiplication on the left and the right by orthogonal matrices: if is from the Haar distribution then so is for any orthogonal (possibly non-random) and . A random Householder matrix is not Haar distributed.

A matrix from the Haar distribution can be generated as the orthogonal factor in the QR factorization of a random matrix with elements from the standard normal distribution (mean , variance ). In MATLAB this is done by the code

The statement [Q,R] = qr(randn(n)), which returns the orthogonal factor , is not enough on its own to give a Haar distributed matrix, because the QR factorization is not unique. The second line adjusts the signs so that is from the unique factorization in which the triangular factor has nonnegative diagonal elements. This construction requires flops.

A more efficient construction is possible, as suggested by Stewart (1980). Let be an -vector of elements from the standard normal distribution and let be the Householder matrix that reduces to , where is the first unit vector. Then is Haar distributed, where , , and . This construction expresses as the product of Householder matrices of growing effective dimension, and the product can be formed from right to left in flops. The MATLAB statement Q = gallery('qmult',n) carries out this construction.

A similar construction can be made using Givens rotations (Anderson et al., 1987).

Orthogonal matrices from the Haar distribution can also be formed as , where the elements of are from the standard normal distribution. This is the orthogonal factor in the polar decomposition (where is symmetric positive semidefinite).

Random orthogonal matrices arise in a variety of applications, including Monte Carlo simulation, random matrix theory, machine learning, and the construction of test matrices with known eigenvalues or singular values.

All these ideas extend to random unitary (complex) matrices. In MATLAB, Haar distributed unitary matrices can be constructed by the code

This code exploits the fact that the factor computed by MATLAB has real diagonal entries. If the diagonal of were complex then this code would need to be modified to use the complex sign function given by .