Electrical Engineering
      and Computer Sciences

Electrical Engineering and Computer Sciences

COLLEGE OF ENGINEERING

UC Berkeley

Nexus: A Common Substrate for Cluster Computing

Benjamin Hindman, Andrew Konwinski, Matei Zaharia, Ali Ghodsi, Anthony D. Joseph, Scott Shenker and Ion Stoica

EECS Department
University of California, Berkeley
Technical Report No. UCB/EECS-2009-158
November 16, 2009

http://www.eecs.berkeley.edu/Pubs/TechRpts/2009/EECS-2009-158.pdf

The success of MapReduce has sparked the development of a diverse array of cluster computing frameworks. We believe that no single framework will be optimal for all applications, and that organizations will instead want to run multiple frameworks in the same cluster. Furthermore, to ease development of new frameworks, it is critical to identify common abstractions and modularize their architectures. To achieve these goals, we propose Nexus, a low-level substrate that provides isolation and efficient resource sharing across frameworks running on the same cluster, while giving each framework maximum control over the scheduling and execution of its jobs. Nexus fosters innovation in the cloud by letting organizations run new frameworks alongside existing ones and by letting framework developers focus on specific applications rather than building one-size-fits-all frameworks.


BibTeX citation:

@techreport{Hindman:EECS-2009-158,
    Author = {Hindman, Benjamin and Konwinski, Andrew and Zaharia, Matei and Ghodsi, Ali and Joseph, Anthony D. and Shenker, Scott and Stoica, Ion},
    Title = {Nexus: A Common Substrate for Cluster Computing},
    Institution = {EECS Department, University of California, Berkeley},
    Year = {2009},
    Month = {Nov},
    URL = {http://www.eecs.berkeley.edu/Pubs/TechRpts/2009/EECS-2009-158.html},
    Number = {UCB/EECS-2009-158},
    Abstract = {The success of MapReduce has sparked the development of a diverse array of
cluster computing frameworks.
We believe that no single framework will be optimal for all
applications, and that organizations will instead want to
run multiple frameworks in the same cluster.
Furthermore, to ease development of new frameworks, it is critical to
identify common abstractions and modularize their architectures.
To achieve these goals, we propose Nexus, a low-level substrate that
provides isolation and efficient resource sharing across frameworks
running on the same cluster, while giving each framework maximum control
over the scheduling and execution of its jobs.
Nexus fosters innovation in the cloud by letting organizations run new
frameworks alongside existing ones and by letting framework developers
focus on specific applications rather than building one-size-fits-all
frameworks.}
}

EndNote citation:

%0 Report
%A Hindman, Benjamin
%A Konwinski, Andrew
%A Zaharia, Matei
%A Ghodsi, Ali
%A Joseph, Anthony D.
%A Shenker, Scott
%A Stoica, Ion
%T Nexus: A Common Substrate for Cluster Computing
%I EECS Department, University of California, Berkeley
%D 2009
%8 November 16
%@ UCB/EECS-2009-158
%U http://www.eecs.berkeley.edu/Pubs/TechRpts/2009/EECS-2009-158.html
%F Hindman:EECS-2009-158