TL;DR: In this article, a numerically stable and fairly fast scheme is described to compute the unitary matrices U and V which transform a given matrix A into a diagonal form π = U^ * AV, thus exhibiting A's singular values on π's diagonal.
Abstract: A numerically stable and fairly fast scheme is described to compute the unitary matrices U and V which transform a given matrix A into a diagonal form $\Sigma = U^ * AV$, thus exhibiting A’s singular values on $\Sigma $’s diagonal. The scheme first transforms A to a bidiagonal matrix J, then diagonalizes J. The scheme described here is complicated but does not suffer from the computational difficulties which occasionally afflict some previously known methods. Some applications are mentioned, in particular the use of the pseudo-inverse $A^I = V\Sigma ^I U^* $ to solve least squares problems in a way which dampens spurious oscillation and cancellation.
TL;DR: The use of the pseudo-inverse $A^I = V\Sigma ^I U^* $ to solve least squares problems in a way which dampens spurious oscillation and cancellation is mentioned.
Abstract: A numerically stable and fairly fast scheme is described to compute the unitary matrices U and V which transform a given matrix A into a diagonal form $\Sigma = U^ * AV$, thus exhibiting A’s singular values on $\Sigma $’s diagonal. The scheme first transforms A to a bidiagonal matrix J, then diagonalizes J. The scheme described here is complicated but does not suffer from the computational difficulties which occasionally afflict some previously known methods. Some applications are mentioned, in particular the use of the pseudo-inverse $A^I = V\Sigma ^I U^* $ to solve least squares problems in a way which dampens spurious oscillation and cancellation.
TL;DR: A new algorithm that computes all the sinusoid values of a bidiagonal matrix is presented, which is the final phase of the standard algorithm for the singular value decomposition of a general matrix.
Abstract: Computing the singular values of a bidiagonal matrix is the final phase of the standard algorithm for the singular value decomposition of a general matrix. A new algorithm that computes all the singular values of a bidiagonal matrix to high relative accuracy independent of their magnitudes is presented. In contrast, the standard algorithm for bidiagonal matrices may compute small singular values with no relative accuracy at all. Numerical experiments show that the new algorithm is comparable in speed to the standard algorithm, and frequently faster.
TL;DR: Demmel and Kahan as discussed by the authors showed that the standard bidiagonal QR algorithm can be simplified when the shift is zero and, of greater importance, no subtractions occur, allowing very small singular values to be found with (almost) all the accuracy permitted by the data and at no extra cost.
Abstract: In September 1991 J. W. Demmel and W. M. Kahan were awarded the second SIAM prize in numerical linear algebra for their paper ‘Accurate Singular Values of Bidiagonal Matrices’ [1], referred to as DK hereafter. Among several valuable results was the observation that the standard bidiagonal QR algorithm used in LINPACK [2], and in many other SVD programs, can be simplified when the shift is zero and, of greater importance, no subtractions occur. The last feature permits very small singular values to be found with (almost) all the accuracy permitted by the data and at no extra cost.
TL;DR: New O(n3) algorithms that, given the bidiagonal factors of a nonsingular TN matrix, compute its eigenvalues and SVD to high relative accuracy in floating point arithmetic, independent of the conventional condition number are presented.
Abstract: We consider the class of totally nonnegative (TN) matrices---matrices all of whose minors are nonnegative. Any nonsingular TN matrix factors as a product of nonnegative bidiagonal matrices. The entries of the bidiagonal factors parameterize the set of nonsingular TN matrices.
We present new O(n3) algorithms that, given the bidiagonal factors of a nonsingular TN matrix, compute its eigenvalues and SVD to high relative accuracy in floating point arithmetic, independent of the conventional condition number. All eigenvalues are guaranteed to be computed to high relative accuracy despite arbitrary nonnormality in the TN matrix.
We prove that the entries of the bidiagonal factors of a TN matrix determine its eigenvalues and SVD to high relative accuracy.
We establish necessary and sufficient conditions for computing the entries of the bidiagonal factors of a TN matrix to high relative accuracy, given the matrix entries.
In particular, our algorithms compute all eigenvalues and the SVD of TN Cauchy, Vandermonde, Cauchy--Vandermonde, and generalized Vandermonde matrices to high relative accuracy.