# Sequential Communication Bounds for Fast Linear Algebra

### Grey Ballard, James Demmel, Olga Holtz and Oded Schwartz

###
EECS Department

University of California, Berkeley

Technical Report No. UCB/EECS-2012-36

March 30, 2012

### http://www.eecs.berkeley.edu/Pubs/TechRpts/2012/EECS-2012-36.pdf

In this note we obtain communication cost lower and upper bounds on the algorithms for LU and QR given in (Demmel, Dumitriu, and Holtz 2007). The algorithms there use fast, stable matrix multiplication as a subroutine and are shown to be as stable and as computationally efficient as the matrix multiplication subroutine. We show here that they are also as communication-efficient (in the sequential, two-level memory model) as the matrix multiplication algorithm. The analysis for LU and QR extends to all the algorithms in (Demmel, Dumitriu, and Holtz 2007). Further, we prove that in the case of using Strassen-like matrix multiplication, these algorithms are communication optimal.

BibTeX citation:

@techreport{Ballard:EECS-2012-36, Author = {Ballard, Grey and Demmel, James and Holtz, Olga and Schwartz, Oded}, Title = {Sequential Communication Bounds for Fast Linear Algebra}, Institution = {EECS Department, University of California, Berkeley}, Year = {2012}, Month = {Mar}, URL = {http://www.eecs.berkeley.edu/Pubs/TechRpts/2012/EECS-2012-36.html}, Number = {UCB/EECS-2012-36}, Abstract = {In this note we obtain communication cost lower and upper bounds on the algorithms for LU and QR given in (Demmel, Dumitriu, and Holtz 2007). The algorithms there use fast, stable matrix multiplication as a subroutine and are shown to be as stable and as computationally efficient as the matrix multiplication subroutine. We show here that they are also as communication-efficient (in the sequential, two-level memory model) as the matrix multiplication algorithm. The analysis for LU and QR extends to all the algorithms in (Demmel, Dumitriu, and Holtz 2007). Further, we prove that in the case of using Strassen-like matrix multiplication, these algorithms are communication optimal.} }

EndNote citation:

%0 Report %A Ballard, Grey %A Demmel, James %A Holtz, Olga %A Schwartz, Oded %T Sequential Communication Bounds for Fast Linear Algebra %I EECS Department, University of California, Berkeley %D 2012 %8 March 30 %@ UCB/EECS-2012-36 %U http://www.eecs.berkeley.edu/Pubs/TechRpts/2012/EECS-2012-36.html %F Ballard:EECS-2012-36