Faster Algorithms for Rectangular Matrix Multiplication
TL;DR: In this article, it was shown that α > 0.30298, which improved the previous record of α>0.29462 by Coppersmith and Winograd.
read more
Abstract: Let {\alpha} be the maximal value such that the product of an n x n^{\alpha} matrix by an n^{\alpha} x n matrix can be computed with n^{2+o(1)} arithmetic operations. In this paper we show that \alpha>0.30298, which improves the previous record \alpha>0.29462 by Coppersmith (Journal of Complexity, 1997). More generally, we construct a new algorithm for multiplying an n x n^k matrix by an n^k x n matrix, for any value k\neq 1. The complexity of this algorithm is better than all known algorithms for rectangular matrix multiplication. In the case of square matrix multiplication (i.e., for k=1), we recover exactly the complexity of the algorithm by Coppersmith and Winograd (Journal of Symbolic Computation, 1990).
These new upper bounds can be used to improve the time complexity of several known algorithms that rely on rectangular matrix multiplication. For example, we directly obtain a O(n^{2.5302})-time algorithm for the all-pairs shortest paths problem over directed graphs with small integer weights, improving over the O(n^{2.575})-time algorithm by Zwick (JACM 2002), and also improve the time complexity of sparse square matrix multiplication.
read more
Chat with Paper
AI Agents for this Paper
Find similar papers on Google Scholar, PubMed and Arxiv
Write a critical review of this paper
Analyze citations of this paper to find unaddressed research gaps
Figures
![Figure 2: Upper bounds on the exponent for the multiplication two n× n matrices with at most m nonzero entries. The horizontal axis represents logn(m). The dashed line represents the results by Yuster and Zwick [32] and shows that the term nω(1,1,λm) dominates the complexity when 1 ≤ logn(m) ≤ (1 + ω)/2. The plain line represents the improvements we obtain.](/figures/figure2-1-6p284svl2eql.png)
Figure 2: Upper bounds on the exponent for the multiplication two n× n matrices with at most m nonzero entries. The horizontal axis represents logn(m). The dashed line represents the results by Yuster and Zwick [32] and shows that the term nω(1,1,λm) dominates the complexity when 1 ≤ logn(m) ≤ (1 + ω)/2. The plain line represents the improvements we obtain. 
Figure 4: The second pruning (second version) 
Figure 1: Our upper bounds (in plain line) on ω(1, 1, k), for 0 ≤ k ≤ 1. The dashed line represents the upper bounds on ω(1, 1, k) obtained by using Equation (1) with the values α > 0.30298 and ω < 2.375477. 
Table 1: Our upper bounds on the exponent of the multiplication of an n × nk matrix by an nk × n matrix. 
Figure 3: The second pruning (first version) 
Table 2: Three solutions for our optimization problem. The first ten rows give (exact) values of the ten parameters. The numeral values of the next four rows show that the three conditions 0 < a004, a013 ≤ 1 and AA00 A A1 1 A A2 2 A A3 3 A A4 4 ≥ BB00 BB11 BB22 BB33 BB44 are satisfied. The numerical values of the last two rows show that ω(1, 1, 0.5302) < 2.060396, ω(1, 1, 0.75) < 2.190087 and ω(1, 1, 2) < 3.256689.
Citations
Fast approximation algorithms for the diameter and radius of sparse graphs
Liam Roditty,Virginia Vassilevska Williams +1 more
- 01 Jun 2013
TL;DR: This paper presents the first improvement over the diameter approximation algorithm of Aingworth et.
Faster all-pairs shortest paths via circuit complexity
Ryan Williams
- 31 May 2014
TL;DR: A new randomized method for computing the min-plus product of two n × n matrices is presented, yielding a faster algorithm for solving the all-pairs shortest path problem (APSP) in dense n-node directed graphs with arbitrary edge weights.
285
On some fine-grained questions in algorithms and complexity
Virginia Vassilevska Williams
- 01 May 2019
TL;DR: Mimicking NP-hardness, the approach is to select a key problem X that is conjectured to not be solvable by any O(t(n)1 ") time algorithm, and reduce X in a fine-grained way to many important problems, thus giving tight conditional time lower bounds for them.
228
Efficient Pseudorandom Correlation Generators: Silent OT Extension and More
Elette Boyle,Geoffroy Couteau,Niv Gilboa,Yuval Ishai,Lisa Kohl,Peter Scholl +5 more
- 18 Aug 2019
TL;DR: In this article, the authors propose a secure MPC with no honest majority, where input-independent correlated randomness enables a lightweight "non-cryptographic" online phase once the inputs are known.
Photonic tensor cores for machine learning
Mario Miscuglio,Volker J. Sorger +1 more
TL;DR: The introduction of an integrated photonics-based tensor core unit supported by numerical simulations shows that photonic specialized processors have the potential to augment electronic systems and may perform exceptionally well in network-edge devices in the looming 5G networks and beyond.
199
References
Matrix multiplication via arithmetic progressions
Don Coppersmith,Shmuel Winograd +1 more
TL;DR: In this article, a new method for accelerating matrix multiplication asymptotically is presented, based on the ideas of Volker Strassen, by using a basic trilinear form which is not a matrix product.
2.6K
Matrix multiplication via arithmetic progressions
Don Coppersmith,Shmuel Winograd +1 more
- 01 Jan 1987
TL;DR: A new method for accelerating matrix multiplication asymptotically is presented, by using a basic trilinear form which is not a matrix product, and making novel use of the Salem-Spencer Theorem.
2.4K
•Book
Algebraic Complexity Theory
Peter Brgisser,Michael Clausen,Mohammad Amin Shokrollahi +2 more
- 16 Dec 1996
TL;DR: This is the first book to present an up-to-date and self-contained account of Algebraic Complexity Theory that is both comprehensive and unified.
1.2K
Multiplying matrices faster than coppersmith-winograd
Virginia Vassilevska Williams
- 19 May 2012
TL;DR: An automated approach for designing matrix multiplication algorithms based on constructions similar to the Coppersmith-Winograd construction is developed and a new improved bound on the matrix multiplication exponent ω<2.3727 is obtained.
On Sets of Integers Which Contain No Three Terms in Arithmetical Progression.
TL;DR: By a modification of Salem and Spencer' method, the better estimate 1-_2/2log2 + e v(N) > N VloggN is shown.
566
Related Papers (5)
François Le Gall
- 27 Aug 2012
Michael B. Cohen,Yin Tat Lee,Zhao Song +2 more
- 23 Jun 2019
François Le Gall,Harumichi Nishimura +1 more
- 02 Jul 2014
Wei Zhou,George Labahn +1 more
- 28 Jul 2009